Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-31 Thread Stack
th the above. I'll take care of tying HDFS-9924 over to the new > issue. > > Thanks, > St.Ack > > > >> Thanks >> >> Anu >> >> >> >> *From: * on behalf of Stack >> *Date: *Thursday, May 3, 2018 at 9:04 PM >> *To: *Anu Engineer

Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-15 Thread Stack
ks > > Anu > > > > *From: * on behalf of Stack > *Date: *Thursday, May 3, 2018 at 9:04 PM > *To: *Anu Engineer > *Cc: *Wei-Chiu Chuang , "hdfs-dev@hadoop.apache.org" < > hdfs-dev@hadoop.apache.org> > *Subject: *Re: [DISCUSSION] Create a branch to wor

Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-03 Thread Anu Engineer
e.org" Subject: Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS Thanks for support Wei-Chiu and Anu. Thinking more on it, we should just open a new JIRA. HDFS-9924 is an old branch with commits we don't need full of commentary that is, ahem, a mite off-topic.

Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-03 Thread Stack
Thanks for support Wei-Chiu and Anu. Thinking more on it, we should just open a new JIRA. HDFS-9924 is an old branch with commits we don't need full of commentary that is, ahem, a mite off-topic. Duo can attach his design to the new issue. We can cite HDFS-9924 as provenance and aggregate the dis

Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-03 Thread Duo Zhang
Will prepare a design doc soon to roughly describe the things we want to do and how we plan to do it, and also the undecided things, such as how to support fan-out. Thanks. 2018-05-04 4:54 GMT+08:00 Anu Engineer : > Hi St.ack/Wei-Chiu, > > It is very kind of St.Ack to bring this question to HDFS

Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-03 Thread Anu Engineer
Hi St.ack/Wei-Chiu, It is very kind of St.Ack to bring this question to HDFS Dev. I think this is a good feature to have. As for the branch question, HDFS-9924 branch is already open, we could just use that and I am +1 on adding Duo as a branch committer. I am not familiar with HBase code base

Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-03 Thread Wei-Chiu Chuang
Given that HBase 2 uses async output by default, the way that code is maintained today in HBase is not sustainable. That piece of code should be maintained in HDFS. I am +1 as a participant in both communities. On Thu, May 3, 2018 at 9:14 AM, Stack wrote: > Ok with you lot if a few of us open a

[DISCUSSION] Create a branch to work on non-blocking access to HDFS

2018-05-03 Thread Stack
Ok with you lot if a few of us open a branch to work on a non-blocking HDFS client? Intent is to finish up the old issue "HDFS-9924 [umbrella] Nonblocking HDFS Access". On the foot of this umbrella JIRA is a proposal by the heavy-lifter, Duo Zhang. Over in HBase, we have a limited async DFS client