Re: socket buffer sizes hardcoded

2009-09-04 Thread Dhruba Borthakur
Making it configurable seems like a good thing. There is a JIRA (owned by Sanjay) that describes that some of these configuration variables on the client side might become "undocumented"; tjois means that they might change semantics from a release to another. thanks, dhruba On Wed, Sep 2, 2009 a

socket buffer sizes hardcoded

2009-09-03 Thread Jay Kreps
Hey Guys, I am interested in increasing the throughput of an HDFS read while transferring data between datacenters that are geographically far apart and hence have a network latency of around 60ms. I see in the HDFS code that the DFSClient and DataNode seem to hardcode their socket buffer sizes to