[jira] [Created] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7276: - Summary: Limit the number of byte arrays used by DFSOutputStream Key: HDFS-7276 URL: https://issues.apache.org/jira/browse/HDFS-7276 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7015) Implement C++ interface for file system for libhdfs3

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7015. Resolution: Duplicate > Implement C++ interface for file system for libhdfs3 > --

[jira] [Created] (HDFS-7275) Add TLSv1.2 to HttpFS

2014-10-21 Thread Robert Kanter (JIRA)
Robert Kanter created HDFS-7275: --- Summary: Add TLSv1.2 to HttpFS Key: HDFS-7275 URL: https://issues.apache.org/jira/browse/HDFS-7275 Project: Hadoop HDFS Issue Type: Bug Components: w

[jira] [Created] (HDFS-7274) Disable SSLv3 (POODLEbleed vulnerability) in HttpFS

2014-10-21 Thread Robert Kanter (JIRA)
Robert Kanter created HDFS-7274: --- Summary: Disable SSLv3 (POODLEbleed vulnerability) in HttpFS Key: HDFS-7274 URL: https://issues.apache.org/jira/browse/HDFS-7274 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-7273) Add start and stop wrapper scripts for mover

2014-10-21 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-7273: -- Summary: Add start and stop wrapper scripts for mover Key: HDFS-7273 URL: https://issues.apache.org/jira/browse/HDFS-7273 Project: Hadoop HDFS Issue Type: Improv

Re: HDFS Snapshots

2014-10-21 Thread Andrew Wang
Why would the state go backwards? Let me try to restate your scenario: t1: snapshot a file with length 5 t2: append to the file, now length 6 t3: delete the snapshot After this, since we deleted the snapshot, we only have the current filesystem state which is length 6. There's no "restore" funct

[jira] [Created] (HDFS-7272) Concurrency problem in Dfsck/URLConnectionFactory classes

2014-10-21 Thread Maciej Arciuch (JIRA)
Maciej Arciuch created HDFS-7272: Summary: Concurrency problem in Dfsck/URLConnectionFactory classes Key: HDFS-7272 URL: https://issues.apache.org/jira/browse/HDFS-7272 Project: Hadoop HDFS I

Re: HDFS Snapshots

2014-10-21 Thread Pushparaj Motamari
Hi, Actually, how does namenode handle when block report is sent from datanodes? After removing snapshot the file size = 0.5*BLOCK_SIZE. but the block report says it is 0.6*BLOCK_SIZE,(if we do not shrink the block) there is a mismatch. On Tue, Oct 21, 2014 at 8:34 PM, Pushparaj Motamari wrote

Re: HDFS Snapshots

2014-10-21 Thread Pushparaj Motamari
Hi, Generally the user expectation is to get back to the previous state of FileSystem, so we should see the old state of block(the block size should shrink). I couldn't find the semantics of this kind of operations in design document either. Thank You Pushparaj On Tue, Oct 21, 2014 at 8:23 PM,

Re: HDFS Snapshots

2014-10-21 Thread Andrew Wang
Hi Pushparaj, Based on those steps, isn't the expectation that you end up with a 0.6*size block at the end? Blocks are append only (i.e. only grow in length), so deleting a snapshot cannot result in a block shrinking. Best, Andrew On Tue, Oct 21, 2014 at 7:20 AM, Pushparaj Motamari wrote: > Hi

HDFS Snapshots

2014-10-21 Thread Pushparaj Motamari
Hi, Consider the scenario below. /A/file.txt in HDFS 1. file.txt size = 0.5*(Size of Block). 2. Take Snapshot on directory A 3. Append to the file.txt, making its size as 0.6*(Size of Block) 4. Remove/delete the snapshot on folder taken in step2. My Question

Build failed in Jenkins: Hadoop-Hdfs-trunk #1908

2014-10-21 Thread Apache Jenkins Server
See Changes: [kasha] HADOOP-11194. Ignore .keep files (kasha) [benoy] HDFS-7184. Allow data migration tool to run as a daemon. (Benoy Antony) [zjshen] YARN-2673. Made timeline client put APIs retry if ConnectException happens. Cont

Hadoop-Hdfs-trunk - Build # 1908 - Still Failing

2014-10-21 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1908/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6242 lines...] [INFO] [INFO] --- maven-source-plugin:2.1

Re: How to run hdfs unit tests ?

2014-10-21 Thread xiaohe lan
Really thanks for your prompt reply Charles. I can run the unit test now. Thanks, Xiaohe On Tue, Oct 21, 2014 at 7:52 PM, Charles Lamb wrote: > On 10/21/2014 7:33 AM, xiaohe lan wrote: > >> Hello, >> >> I am new to hdfs, I want to know how to run a specific unit test of hdfs. >> I >> have impo

Re: How to run hdfs unit tests ?

2014-10-21 Thread Charles Lamb
On 10/21/2014 7:33 AM, xiaohe lan wrote: Hello, I am new to hdfs, I want to know how to run a specific unit test of hdfs. I have imported hdfs project into IntelliJ IDEA, I can run a test just by right-click on the test and select Run test. Can I run a unit test from terminal and how ? I want to

How to run hdfs unit tests ?

2014-10-21 Thread xiaohe lan
Hello, I am new to hdfs, I want to know how to run a specific unit test of hdfs. I have imported hdfs project into IntelliJ IDEA, I can run a test just by right-click on the test and select Run test. Can I run a unit test from terminal and how ? I want to learn some hdfs APIs so I may add some cod