ayushtkn opened a new pull request, #7050: URL: https://github.com/apache/hadoop/pull/7050
### Description of PR Fix Hadoop CLI MiniCluster ### How was this patch tested? Tested Manually 1. **Log on Console** ``` 2024-09-18 11:00:50,989 INFO mapreduce.MiniHadoopClusterManager: Started MiniDFSCluster -- namenode on port 62569 ``` 2. **Tried CLI commands on the cluster** ``` ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -mkdir hdfs://127.0.0.1:62569/ayush 2024-09-18 11:01:55,405 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -ls hdfs://127.0.0.1:62569/ 2024-09-18 11:01:58,113 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Found 3 items drwxrwxrwx - ayushsaxena supergroup 0 2024-09-18 11:00 hdfs://127.0.0.1:62569/Users drwxr-xr-x - ayushsaxena supergroup 0 2024-09-18 11:01 hdfs://127.0.0.1:62569/ayush drwxr-xr-x - ayushsaxena supergroup 0 2024-09-18 11:00 hdfs://127.0.0.1:62569/user ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -copyFromLocal bin/hdfs hdfs://127.0.0.1:62569/ayush 2024-09-18 11:02:16,333 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -ls hdfs://127.0.0.1:62569/ayush 2024-09-18 11:02:28,387 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Found 1 items -rw-r--r-- 3 ayushsaxena supergroup 11730 2024-09-18 11:02 hdfs://127.0.0.1:62569/ayush/hdfs ``` 3. **Namenode UI** <img width="1442" alt="image" src="https://github.com/user-attachments/assets/5e5831a5-4f09-4fb5-8439-ffb43c499288";> 4. **Cat the config dump file** ``` ayushsaxena@ayushsaxena incubator % cat abc.xml <?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration> <property><name>mapreduce.jobhistory.jhist.format</name><value>binary</value><final>false</final><source>mapred-default.xml</source></property> <property><name>dfs.namenode.available-space-rack-fault-tolerant-block-placement-policy.balanced-space-tolerance</name><value>5</value><final>false</final><source>hdfs-default.xml</source></property> <property><name>fs.s3a.retry.interval</name><value>500ms</value><final>false</final><source>core-default.xml</source></property> <property><name>dfs.block.access.token.lifetime</name><value>600</value><final>false</final><source>hdfs-default.xml</source></property> <property><name>mapreduce.job.heap.memory-mb.ratio</name><value>0.8</value><final>false</final><source>mapred-default.xml</source></property> <property><name>mapreduce.map.log.level</name><value>INFO</value><final>false</final><source>mapred-default.xml</source></property> <property><name>dfs.namenode.lazypersist.file.scrub.interval.sec</name><value>300</value><final>false</final><source>hdfs-default.xml</source></property> <property><name>file.bytes-per-checksum</name><value>512</value><final>false</final><source>core-default.xml</source></property> <property><name>mapreduce.client.completion.pollinterval</name><value>5000</value><final>false</final><source>mapred-default.xml</source></property> ``` ### For code changes: - [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')? - [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation? - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)? - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
