Hi, I'm pretty new to Beam, and I've been trying to use the ElasticSearchIO sink to write docs into ES. With this, I want to be able to 1. ingest and transform rows from DB (done) 2. write JSON docs/strings into a new ES index (done) 3. After (2) is complete and all documents are written into a new index, trigger an atomic index swap under an alias to replace the current aliased index with the new index generated in step 2. This is basically a single POST request to the ES cluster.
The problem I'm facing is that I don't seem to be able to find a way to have a way for (3) to happen after step (2) is complete. The ElasticSearchIO.Write transform returns a PDone, and I'm not sure how to proceed from there because it doesn't seem to let me do another apply on it to "define" a dependency. https://beam.apache.org/documentation/sdks/javadoc/2. 1.0/org/apache/beam/sdk/io/elasticsearch/ElasticsearchIO.Write.html Is there a recommended way to construct pipelines workflows like this? Thanks in advance, Philip
