----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/48811/ -----------------------------------------------------------
Review request for samza. Repository: samza Description ------- Create writer with appropriate API to ensure stream is closed with writer, and not just flushed Diffs ----- samza-hdfs/src/main/scala/org/apache/samza/system/hdfs/writer/SequenceFileHdfsWriter.scala 46ade333af6acf1f2646924854bc2290ff56b5cb Diff: https://reviews.apache.org/r/48811/diff/ Testing ------- Unit tests pass successfully. Performing manual test in our code base to ensure that files close properly (we currently see them remain open and several hour delays in propogating writes to HDFS) Open to suggestions for how to write a unit test for this use case. Thanks, Benjamin Smith
