Using IntelliJ debugger with Tez

2022-04-27 Thread Julien Phalip
Hi, I'm able to successfully use the IntelliJ debugger and set breakpoints with Hive while using the MapReduce engine by running this command: HADOOP_OPTS="-Djava.library.path=/usr/local/hadoop/lib -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=7070" hi --service hiveserver2 Howev

RE: Re: Custom OutputCommitter not called by Tez

2022-04-27 Thread Julien Phalip
Thanks Peter. By chance could I get things to work by keeping my current version of Hive (3.1.2) and only upgrading Tez? Which version(s) should I use? Thank you, Julien On 2022/04/27 08:59:08 Peter Vary wrote: > We had the same issue with the IcebergOutputCommitter. > > The first solution was

Re: Custom OutputCommitter not called by Tez

2022-04-27 Thread Peter Vary
We had the same issue with the IcebergOutputCommitter. The first solution was this: https://issues.apache.org/jira/browse/HIVE-25006 It needed https://issues.apache.org/jira/browse/TEZ-4279 Later