Re: Bug in SequenceFileHdfsFileWriter

2016-06-16 Thread Jagadish Venkatraman
> I've created: https://issues.apache.org/jira/browse/SAMZA-968 > > > I don't see anyway to assign it to myself though? > > > From: Yi Pan > Sent: Thursday, June 16, 2016 1:02:59 PM > To: dev@samza.apache.org > Subject: Re: Bug in Sequ

Re: Bug in SequenceFileHdfsFileWriter

2016-06-16 Thread Benjamin Smith
t: Re: Bug in SequenceFileHdfsFileWriter Hi, Benjamin, Thanks a lot for reporting this! It makes sense from reading the posts. Could you open a JIRA? Are you interested in assigning to yourself and contribute the fix? Thanks a lot again! -Yi On Thu, Jun 16, 2016 at 9:52 AM, Benjamin Smit

Re: Bug in SequenceFileHdfsFileWriter

2016-06-16 Thread Yi Pan
Hi, Benjamin, Thanks a lot for reporting this! It makes sense from reading the posts. Could you open a JIRA? Are you interested in assigning to yourself and contribute the fix? Thanks a lot again! -Yi On Thu, Jun 16, 2016 at 9:52 AM, Benjamin Smith < ben.sm...@ranksoftwareinc.com> wrote: > > H

Bug in SequenceFileHdfsFileWriter

2016-06-16 Thread Benjamin Smith
Hello, I am working on a project where we are integrating Samza and Hive. As part of this project, we ran into an issue where sequence files written from Samza were taking a long time (hours) to completely sync with HDFS. After some Googling and digging into the code, it appears that the issue