I'm happy to help with this as well. I actually have a prototype patch that I built during a hackathon a few months ago, and was able to get a full stack trace including Client, NN, and DN. I'm on vacation this week but will try to post my prototype upstream when I get back. Feel free to ping me on this if I slack :)
-Todd On Wed, Jul 17, 2013 at 4:12 PM, Stack <st...@duboce.net> wrote: > Folks over at HBase would be interested in helping out. > > What does a mentor have to do? I poked around the icfoss link but didn't > see list of duties (I've been know to be certified blind on occasion). > > I am not up on the malleability of hdfs RPC; is it just a matter of adding > the trace info to a pb header record or would it require more (Sanjay was > saying something recently off-list that trace id is imminent -- but I've > not done the digging)? > > St.Ack > > > On Wed, Jul 17, 2013 at 1:44 PM, Sreejith Ramakrishnan < > sreejith.c...@gmail.com> wrote: > > > Hey, > > > > I was originally researching options to work on ACCUMULO-1197. Basically, > > it was a bid to pass trace functionality through the DFSClient. I > discussed > > with the guys over there on implementing a Google Dapper-style trace with > > HTrace. The guys at HBase are also trying to achieve the same HTrace > > integration [HBASE-6449] > > > > But, that meant adding stuff to the RPC in HDFS. For a start, we've to > add > > a 64-bit span-id to every RPC with tracing enabled. There's some more in > > the original Dapper paper and HTrace documentation. > > > > I was told by the Accumulo people to talk with and seek help from the > > experts at HDFS. I'm open to suggestions. > > > > Additionally, I'm participating in a Joint Mentoring Programme by Apache > > which is quite similar to GSoC. Luciano Resende (Community Development, > > Apache) is incharge of the programme. I'll attach a link. The last date > is > > 19th July. So, I'm pretty tensed without any mentors :( > > > > [1] https://issues.apache.org/jira/browse/ACCUMULO-1197 > > [2] https://issues.apache.org/jira/browse/HDFS-4680 > > [3] https://github.com/cloudera/htrace > > [4] http://community.apache.org/mentoringprogramme-icfoss-pilot.html > > [5] https://issues.apache.org/jira/browse/HBASE-6449 > > > > Thank you, > > Sreejith R > > > -- Todd Lipcon Software Engineer, Cloudera
