DNS provider issue with hadoop-client 3.4.1

2025-01-30 Thread Sébastien Rebecchi
Hello I got this error while using hadoop-client 3.4.1: java.util.ServiceConfigurationError: java.net.spi.InetAddressResolverProvider: Provider org.xbill.DNS.spi.DnsjavaInetAddressResolverProvider not found The pb disappears if I downgrade to hadoop-client 3.4.0. But my HDFS cluster is 3.4.1 so I

Re: Data not visible to new readers after SequenceFile.writer.hflush()

2025-01-28 Thread Sébastien Rebecchi
; > We happen to implement hflush/hsync semantics in Ozone and therefore we're > quite familiar with it. > > > On Mon, Jan 27, 2025 at 6:30 AM Sébastien Rebecchi > wrote: > > > Hello, > > > > I got this issue using hadoop client with both hadoop 2.9.1 a

Data not visible to new readers after SequenceFile.writer.hflush()

2025-01-27 Thread Sébastien Rebecchi
Hello, I got this issue using hadoop client with both hadoop 2.9.1 and 3.4.1 (client 2.9.1 to write to HDFS 2.9.1 etc). For SequenceFile.Writer class, after doing hflush(), data is not visible to new readers, it is visible only after doing close(). The doc asserts that data must be visible to new