ShowMeYourHammar opened a new issue #3234: HDFS BROKER LOAD username configuration is not effective URL: https://github.com/apache/incubator-doris/issues/3234 **Describe the bug** While using hdfs broker to load hdfs files with username configuration, hdfs broker always uses system environment variable HADOOP_USER_NAME as hadoop user to read hdfs files. Otherwise if HADOOP_USER_NAME is not set, it will use the linux user launchs the hdfs broker service. And the load script is like this. LOAD LABEL db.xx ( DATA INFILE( "xx" ) INTO TABLE `xx` COLUMNS TERMINATED BY "\\x01" ) WITH BROKER hdfs_broker ( "hadoop.security.authentication" = "simple", "username" = "hadoop_user_name", "password" = "hadoop_password", "dfs.nameservices" = "nameservices", "dfs.ha.namenodes.nameservices" = "nn1,nn2", "dfs.namenode.rpc-address.nameservices.nn1" = "host1:port2", "dfs.namenode.rpc-address.nameservices.nn2" = "host2:port2" ) PROPERTIES ( "exec_mem_limit" = "4294967296" );
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
