Elasticsearch Increase Disk

At my company we use AWS Elastic Search Service. It’s actually been great not having to manage the elastic cluster manually. As a test, I recently increased the disk space by 5GB per node to see how AWS manages this. In the AWS console you simply change your disk space size, then apply the changes.

You can query your cluster using the _cat API to see that AWS automatically brought three new nodes online with the designated disk space. The data will migrate to the new nodes with the higher disk space.

Here is the command to see your nodes (where $ES is your elastic search endpoint):

curl $ES/_cat/nodes?v

… and the resulting output:

shards disk.indices disk.used disk.avail disk.total disk.percent host          ip            node
     0           0b     3.9gb     30.2gb     34.2gb           11 x.x.x.x  x.x.x.x  hzvurRt
     0           0b     3.9gb     30.2gb     34.2gb           11 x.x.x.x  x.x.x.x  fHykXT9
    20       16.6gb    21.8gb     17.3gb     39.1gb           55 x.x.x.x  x.x.x.x  0ghAV5j
    14       15.1gb    18.8gb     20.2gb     39.1gb           48 x.x.x.x  x.x.x.x  S-SSb_q
    18       13.5gb    17.6gb     21.4gb     39.1gb           45 x.x.x.x x.x.x.x zJAnHvj
     0           0b     3.9gb     30.2gb     34.2gb           11 x.x.x.x x.x.x.x aSu9BkS

This operation didn’t take very long (about 10 minutes) since our data set is small. As you can see we now have three nodes again, which contain all of our migrated data:

shards disk.indices disk.used disk.avail disk.total disk.percent host          ip            node
    14       15.3gb      19gb       20gb     39.1gb           48 x.x.x.x  x.x.x.x  S-SSb_q
    20       16.6gb    21.8gb     17.3gb     39.1gb           55 x.x.x.x  x.x.x.x  0ghAV5j
    18       13.5gb    17.6gb     21.4gb     39.1gb           45 x.x.x.x x.x.x.x zJAnHvj

• elasticsearch