Hi,
In my opinion, this feature of short circuit reads (HDFS-347 or HDFS-2246)
is not a desirable feature for HDFS. We should be working towards removing
this feature instead of enhancing it and making it popular.
Maybe short-circuit reads were something that HBase needed for performance
at a poi
ck, including scale tests. This is made possible only
with the contribution from many many folks in the community. Following
people contributed to this work: Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas
Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao,
Sumadhur Reddy Bolli,
If you are working on Windows and willing to build the code yourself (which
should be straightforward) then you can try to download the code from
Hadoop git repo and use it. The following branches will give you Hadoop
that runs natively on Windows without Cygwin support. This would be the way
to go
+1.
Using it locally for Tez.
Bikas
-Original Message-
From: Arun C Murthy [mailto:a...@hortonworks.com]
Sent: Tuesday, July 30, 2013 6:30 AM
To: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org;
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: [VOTE] Release
+1 (non-binding)
Bikas
-Original Message-
From: Hitesh Shah [mailto:hit...@apache.org]
Sent: Wednesday, August 21, 2013 4:25 PM
To: yarn-...@hadoop.apache.org; Arun Murthy
Cc: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org;
mapreduce-...@hadoop.apache.org
Subject: Re: [VOTE] Rel
+1 (non binding)
-Original Message-
From: Arpit Gupta [mailto:ar...@hortonworks.com]
Sent: Thursday, October 10, 2013 10:06 AM
To: common-...@hadoop.apache.org
Cc: hdfs-dev@hadoop.apache.org; yarn-...@hadoop.apache.org;
mapreduce-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Had
Clap! Clap!
Bikas
On 3/2/12 5:07 PM, "Uma Maheswara Rao G" wrote:
>Great Work! Congratulations to all of Us. Now trunk build will support HA
>(manual failover :-) )
>
>Especially we have to say many thanks to Todd, Aaron, Eli, Suresh,
>Jitendra
>
>Great design doc by Suresh and Sanjay!
>
>Very
+1 (binding).
Ran it with Apache Tez.
I agree with Suresh about including only critical regressions/bugs at this
point. The less code we change the less new bugs we bring in at the last
moment.
Bikas
-Original Message-
From: Jonathan Eagles [mailto:jeag...@gmail.com]
Sent: Monday, April
Bikas Saha created HDFS-5098:
Summary: Enhance FileSystem.Statistics to have locality information
Key: HDFS-5098
URL: https://issues.apache.org/jira/browse/HDFS-5098
Project: Hadoop HDFS
Issue
Bikas Saha created HDFS-3518:
Summary: Provide API to check HDFS operational state
Key: HDFS-3518
URL: https://issues.apache.org/jira/browse/HDFS-3518
Project: Hadoop HDFS
Issue Type: Bug
Bikas Saha created HDFS-3565:
Summary: Fix streaming job failures with
WindowsResourceCalculatorPlugin
Key: HDFS-3565
URL: https://issues.apache.org/jira/browse/HDFS-3565
Project: Hadoop HDFS
Bikas Saha created HDFS-3602:
Summary: Enhancements to HDFS for Windows Server and Windows Azure
development and runtime environments
Key: HDFS-3602
URL: https://issues.apache.org/jira/browse/HDFS-3602
[
https://issues.apache.org/jira/browse/HDFS-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha resolved HDFS-5098.
--
Resolution: Duplicate
> Enhance FileSystem.Statistics to have locality informat
[
https://issues.apache.org/jira/browse/HDFS-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha resolved HDFS-2806.
--
Resolution: Not A Problem
The class implements FailoverProxyProvider which is already in common and
SBN should not allow browsing of the file system
Key: HDFS-2845
URL: https://issues.apache.org/jira/browse/HDFS-2845
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Bikas Saha
Issue Type: Sub-task
Reporter: Bikas Saha
Assignee: Bikas Saha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
/HDFS-2859
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Bikas Saha
Assignee: Bikas Saha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org
[
https://issues.apache.org/jira/browse/HDFS-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha resolved HDFS-2858.
--
Resolution: Fixed
Fixed in patch for -[HDFS-2859|https://issues.apache.org/jira/browse/HDFS-2859
Reporter: Bikas Saha
Assignee: Bikas Saha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see
Standby NN NPE when shared edits dir is deleted
---
Key: HDFS-2905
URL: https://issues.apache.org/jira/browse/HDFS-2905
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Bikas Saha
: Hadoop HDFS
Issue Type: Sub-task
Reporter: Bikas Saha
Assignee: Bikas Saha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure
/browse/HDFS-2910
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Bikas Saha
Assignee: Bikas Saha
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https
: Sub-task
Components: name-node
Affects Versions: HA branch (HDFS-1623)
Reporter: Bikas Saha
Assignee: Bikas Saha
When there is an error in shared edits dir then current policy requires the
active name node to abort and shutdown.
Currently there is no way to
Versions: HA branch (HDFS-1623)
Reporter: Bikas Saha
Assignee: Bikas Saha
Ideally, NameNode.stop() needs to be called because it will change the HA state
and shutdown all services. NameNode reference is not available anywhere. Hence
it is not possible to shutdown the name
Type: Sub-task
Components: name-node
Affects Versions: HA branch (HDFS-1623)
Reporter: Bikas Saha
Assignee: Bikas Saha
Priority: Minor
The test deletes the shared edits dir to simulate a failure. Then it calls
rollEditLogs() to trigger the deleted
: data-node
Affects Versions: 1.0.0, 0.23.0
Reporter: Bikas Saha
Assignee: Bikas Saha
Fix For: 0.23.2, 1.0.2
dfs.datanode.data.dir.perm is used by the datanode to set the permissions of it
data directories. This is set by default to 755 which gives read
26 matches
Mail list logo