Elastic Community Conference 2022

La ElasticCC est la conférence annuelle en ligne d’Elasticsearch.

A tale about ingestion

Par Baptiste Leduc

Before even searching in Elasticsearch, you have to feed it with your data. In this talk I’ll go through all the means we used to send millions of documents to our index from the worse to most optimized ones.

But even with optimizations, ingestion can take time. Meanwhile, our live index could have write operations which we also need to replicate on our new index! So I’ll also explain how we did to propagate these changes to both indexes so everything is fine once the new index is going live.