Re: [ANNOUNCE] New Hadoop PMC Sun Chao

2022-03-08 Thread tom lee
Congratulations, Sun!👍 Wei-Chiu Chuang 于2022年3月9日周三 11:47写道: > On behalf of the Apache Hadoop PMC, I am pleased to announce that Sun > Chao(sunchao) has accepted the PMC's invitation to become a PMC on > the project. We appreciate all of Sun's generous contributions thus far > and look forward t

Re: Next Mandarin Hadoop Online Meetup Jan 6th.

2022-01-03 Thread tom lee
Thanks @Wei-Chiu Chuang , @Hui Fei for informing us of this. Looking forward to more discussions.😊 Wei-Chiu Chuang 于2022年1月3日周一 17:40写道: > Hello community, > > This week we'll going to have Tao Li (tomscut) speaking about the > experience of operating HDFS at BIGO. See you on Thursday! > > 题目:

Re: [DISCUSS] Add remote port information to HDFS audit log

2021-10-13 Thread tom lee
gt; - Takanobu > > 2021年10月11日(月) 18:19 tom lee : > >> Thanks @Masatake Iwasaki for your >> suggestion. This is a good idea. >> >> Masatake Iwasaki 于2021年10月11日周一 下午3:26写道: >> >> > > I am not sure whether we can directly go and change this. An

Re: [DISCUSS] Add remote port information to HDFS audit log

2021-10-11 Thread tom lee
fs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java#L8480-L8498 > > If we need to add fields, making it optional might be an option. > > Masatake Iwasaki > > On 2021/10/11 16:09, tom lee wrote: > > However, adding port is to modify the internal content of

Re: [DISCUSS] Add remote port information to HDFS audit log

2021-10-11 Thread tom lee
However, adding port is to modify the internal content of the IP field, which has little impact on the overall layout. In our cluster, we parse the audit log through Vector and send the data to Kafka, which is unaffected. tom lee 于2021年10月11日周一 下午2:44写道: > Thank Ayush for reminding me. I a

Re: [DISCUSS] Add remote port information to HDFS audit log

2021-10-10 Thread tom lee
s. Any changes to > Audit Log format are considered incompatible. > > > https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/Compatibility.html#Audit_Log_Output > > -Ayush > > On 10-Oct-2021, at 7:57 PM, tom lee wrote: > > Hi all, > > In o

[DISCUSS] Add remote port information to HDFS audit log

2021-10-10 Thread tom lee
Hi all, In our production environment, we occasionally encounter a problem where a user submits an abnormal computation task, causing a sudden flood of requests, which causes the queueTime and processingTime of the Namenode to rise very high, causing a large backlog of tasks. We usually locate an

Re: [DISCUSS] Hadoop 3.3.2 release?

2021-09-08 Thread tom lee
+1 (non-binding) Ayush Saxena 于2021年9月9日周四 上午1:12写道: > +1, > Thanx Chao for volunteering!!! > > > On 07-Sep-2021, at 10:36 PM, Chao Sun wrote: > > > > Hi all, > > > > It has been almost 3 months since the 3.3.1 release and branch-3.3 has > > accumulated quite a few commits (118 atm). In partic

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread tom lee
+1 Masatake Iwasaki 于2021年6月3日周四 下午5:43写道: > +1 > > Masatake Iwasaki > > On 2021/06/03 15:14, Akira Ajisaka wrote: > > Dear Hadoop developers, > > > > Given the feedback from the discussion thread [1], I'd like to start > > an official vote > > thread for the community to vote and start the 3.1

Re: Please cherrypick to lower branches

2021-03-25 Thread tom lee
Hello, Thank you for your advice. I will pay attention to this problem later. Cheers, Tom Wei-Chiu Chuang 于2021年3月24日周三 下午2:30写道: > Hello, > > Now that we're gradually switching to github PRs for code review, there > appears to be a tendency to leave the commits in the trunk. > > I am sweepin