Hello, I got this issue using hadoop client with both hadoop 2.9.1 and 3.4.1 (client 2.9.1 to write to HDFS 2.9.1 etc). For SequenceFile.Writer class, after doing hflush(), data is not visible to new readers, it is visible only after doing close(). The doc asserts that data must be visible to new readers https://hadoop.apache.org/docs/r3.4.1/hadoop-project-dist/hadoop-common/filesystem/outputstream.html
What should we do for this? Thanks, Sébastien.