ElasticSearch - Reindexing your data with zero downtime

谁都会走 提交于 2019-12-01 21:59:01

问题


https://www.elastic.co/blog/changing-mapping-with-zero-downtime/

I try to create a new index and reindexing my data with zero downtime with this guide.

Now I have an index called "photoshooter" and I follow the steps

1) Create new index "photoshooter_v1" with the new mapping... (Done)

2) Create alias...

curl -XPOST localhost:9200/_aliases -d '

{
    "actions": [
        { "add": {
            "alias": "photoshooter",
            "index": "photoshooter_v1"
        }}
    ]
}

and I get this error...

{
    "error": "InvalidAliasNameException[[photoshooter_v1] Invalid alias name [photoshooter], an index exists with the same name as the alias]",
    "status": 400
}

I think I lose something with the logic..


回答1:


Lets say your current index is named as "photoshooter " if i am guessing it right ok.

Now Create a Alias for this index first - OK

     {
            "actions": [
                { "add": {
                    "alias": "photoshooter_docs",
                    "index": "photoshooter"
                }}
            ]
        }

test it - curl -XGET 'localhost:9200/photoshooter_docs/_search'

Note - now you will use 'photoshooter_docs' as index name to interact with your index which is actually 'photoshooter' Ok.

Now we create a new index with your new mapping let's say we name it 'photoshooter_v2' now copy your 'photoshooter' index data to new index(photoshooter_v2)

Once you have copied all your data now simply Remove the alias from previous index to new index -

      curl -XPOST localhost:9200/_aliases -d '
        {
            "actions": [
                { "remove": {
                    "alias": "photoshooter_docs",
                    "index": "photoshooter"
                }},
                { "add": {
                    "alias": "photoshooter_docs",
                    "index": "photoshooter_v2"
                }}
            ]
        }

test it again -> curl -XGET 'localhost:9200/photoshooter_docs/_search'

Congrats you have changed your mapping without zero downtime .

And to copy data you can use tools like this

    https://github.com/mallocator/Elasticsearch-Exporter 

Note - this tools also copies the mapping from old index to new index which you might don't want to do. So that you have read in its documentation or edit it according to your use .

Thanks

Hope this helps




回答2:


It's it very simple, you cannot create an alias with a name of an index that already exists.

You'll need to consider a new name for the new index, re-index the data in the new one and then remove the old one to be able to give it the same name.

If you want to do that on daily basis, you might consider adding per say the date to your index's name and switch upon it every day.



来源:https://stackoverflow.com/questions/29508955/elasticsearch-reindexing-your-data-with-zero-downtime

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!