Re: Read or Save specific blocks of a file

2018-04-23 Thread Jim Clampffer
If you want to read replicas from a specific DN after determining the block bounds via getFileBlockLocations you could abuse the rack locality infrastructure by generating a dummy topology script to get the NN to order replicas such that the client tries to read from the DNs you prefer first. It's

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-28 Thread Jim Clampffer
t 3:09 PM, Anu Engineer wrote: > Would it be possible to add a maven flag like –skipShade, that helps in > reducing the compile time for people who does not need to build libhdfs++ ? > > > > Thanks > Anu > > > > > > *From: *Jim Clampffer > *Date: *Tuesda

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-27 Thread Jim Clampffer
es in Apache Hadoop HDFS Native > Client. For me it basically doubled the compilation time. > > Eric > > On Fri, Mar 16, 2018 at 4:01 PM, Deepak Majeti > wrote: > >> Thanks for all your hard work on getting this feature (with > 200 >> sub-tasks) in

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-16 Thread Jim Clampffer
s Douglas < > cdoug...@apache.org> wrote: > > > +1 (binding) -C > > > > On Thu, Mar 8, 2018 at 9:31 AM, Jim Clampffer < > james.clampf...@gmail.com> > > wrote: > > > Hi Everyone, &g

[VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-08 Thread Jim Clampffer
Hi Everyone, The feedback was generally positive on the discussion thread [1] so I'd like to start a formal vote for merging HDFS-8707 (libhdfs++) into trunk. The vote will be open for 7 days and end 6PM EST on 3/15/18. This branch includes a C++ implementation of an HDFS client for use in applic

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-03-01 Thread Jim Clampffer
ported? > > Thanks. > > > Regards, > Kai > > -- > 发件人:Chris Douglas > 发送时间:2018年3月1日(星期四) 05:08 > 收件人:Jim Clampffer > 抄 送:Hdfs-dev > 主 题:Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

[DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-02-28 Thread Jim Clampffer
Hi everyone, I'd like to start a thread to discuss merging the HDFS-8707 aka libhdfs++ into trunk. I sent originally sent a similar email out last October but it sounds like it was buried by discussions about other feature merges that were going on at the time. libhdfs++ is an HDFS client writte

[DISCUSS] Merging libhdfs++ (HDFS-8707) into trunk

2017-10-25 Thread Jim Clampffer
Hi everyone, I'd like to start a thread to discuss merging the HDFS-8707 aka libhdfs++ into trunk (as a beta release). libhdfs++ is an HDFS client written in C++ designed to be used in applications that are written in non-JVM based languages. In its current state it supports kerberos authenticat