jtmzheng commented on issue #2995: URL: https://github.com/apache/hudi/issues/2995#issuecomment-857903531
Interesting, @prashantwason so the timeline of how I ran the shadow pipeline was: 1. Stopped ingestion pipeline (0.6 without metadata table) 2. Ran s3-dist-cp job to replicate dataset to a separate path 3. Ran shadow pipeline (0.7 with metadata table enabled) against replica What I'm not understanding is how the table is only updated until 20201216222013.deltacommit since that commit was long before [1]. How is the metadata table initialized? Happy to dig through docs if you can point me to the right place :) Would you recommend waiting until 0.9? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
