Block creation in HDFS

Hi, I am new in this group. I had a question regarding block creation in HDFS. By default the file is split into multiple blocks of size equal to block size. I need to introduce new block creation policy into the system. In my case the main file is divided into multiple partitions. My goal is to c

Theory question: good values for FileStatus.getBlockSize()

HADOOP-11601 tightens up the filesystem spec by saying "if len(file) > 0, getFileStatus().getBlockSize() > 0" this is to stop filesystems (most recently s3a) returning 0 as a block size, which then kills any analytics work that tries to partition the workload by blocksize. I'm currently chang

[jira] [Created] (HDFS-7805) NameNode recovery prompt should be printed on console

surendra singh lilhore created HDFS-7805: Summary: NameNode recovery prompt should be printed on console Key: HDFS-7805 URL: https://issues.apache.org/jira/browse/HDFS-7805 Project: Hadoop HDFS

Hadoop-Hdfs-trunk - Build # 2038 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2038/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6463 lines...] [INFO] [INFO] --- maven-clean-plugin:2.5:

Build failed in Jenkins: Hadoop-Hdfs-trunk #2038

See Changes: [junping_du] YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk. (Contributed by Xuan Gong) -- [...truncated 6270 lines...] Tests run: 2, Failures: 0, Err

[jira] [Created] (HDFS-7804) haadmin command usage #HDFSHighAvailabilityWithQJM.html

Brahma Reddy Battula created HDFS-7804: -- Summary: haadmin command usage #HDFSHighAvailabilityWithQJM.html Key: HDFS-7804 URL: https://issues.apache.org/jira/browse/HDFS-7804 Project: Hadoop HDFS

[jira] [Created] (HDFS-7803) Wrong command mentioned in HDFSHighAvailabilityWithQJM documentation

Arshad Mohammad created HDFS-7803: - Summary: Wrong command mentioned in HDFSHighAvailabilityWithQJM documentation Key: HDFS-7803 URL: https://issues.apache.org/jira/browse/HDFS-7803 Project: Hadoop HD

[jira] [Resolved] (HDFS-7802) Reach xceiver limit once the watcherThread die

[ https://issues.apache.org/jira/browse/HDFS-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie resolved HDFS-7802. - Resolution: Duplicate sorry, close this jira, seems it should be in HADOOP catalogy not HDFS... > Reach xc

[jira] [Created] (HDFS-7802) Reach xceiver limit once the watcherThread die

Liang Xie created HDFS-7802: --- Summary: Reach xceiver limit once the watcherThread die Key: HDFS-7802 URL: https://issues.apache.org/jira/browse/HDFS-7802 Project: Hadoop HDFS Issue Type: Bug