Re: migrating Hadoop tables to tables with hive catalog

2021-06-30 Thread Huadong Liu
FYI, I was able to do the migration by casting ManifestFile to GenericManifestFile, resetting sequence number and snapshot id and adding them to AppendFiles. On Mon, Jun 28, 2021 at 3:49 PM Huadong Liu wrote: > Hi, > > I am trying to migrate an Iceberg Hadoop table to a table using the hive > ca

Re: Welcoming OpenInx as a new PMC member!

2021-06-30 Thread Daniel Weeks
Congrats! On Wed, Jun 30, 2021 at 10:32 AM Yan Yan wrote: > Congratulations!! And thanks for sharing the information! > > On Wed, Jun 30, 2021 at 8:47 AM Palash Goel wrote: > >> Congratulations πŸŽ‰ >> >> On Wed, 30 Jun, 2021, 21:14 Eduard Tudenhoefner, >> wrote: >> >>> Congratulations! >>> >>> O

Re: iceberg-hive-metastore dependencies

2021-06-30 Thread Huadong Liu
Thanks Jack. *hadoop-common 3.1.0* is a dependency of hive-metastore. Unfortunately it didn't make a difference by adding that. I see other versions of hadoop-common (2.6.0 and 2.7.1) from other chained dependencies updated to 3.1.0 from *gradle dependencies*. Maybe they get messed up? On Wed, Jun

Re: iceberg-hive-metastore dependencies

2021-06-30 Thread Jack Ye
Hadoop dependencies are also compileOnly in Iceberg, so you also need to add Hadoop packages such as hadoop-common and hadoop-client in your project dependency. -Jack Ye On Wed, Jun 30, 2021 at 10:35 AM Huadong Liu wrote: > Hi, I made a shadowJar with *org.apache.hive:hive-metastore:3.1.2 and go

iceberg-hive-metastore dependencies

2021-06-30 Thread Huadong Liu
Hi, I made a shadowJar with *org.apache.hive:hive-metastore:3.1.2 and got errors:* *Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/JobConf at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5141) at org.apache.hadoop.hive.conf.HiveConf.(HiveCon

Re: Welcoming OpenInx as a new PMC member!

2021-06-30 Thread Yan Yan
Congratulations!! And thanks for sharing the information! On Wed, Jun 30, 2021 at 8:47 AM Palash Goel wrote: > Congratulations πŸŽ‰ > > On Wed, 30 Jun, 2021, 21:14 Eduard Tudenhoefner, > wrote: > >> Congratulations! >> >> On Wed, Jun 30, 2021 at 4:43 PM Peidian Li wrote: >> >>> Congratulations! >

Re: iceberg code style

2021-06-30 Thread Yufei Gu
Thanks Eduard for the write-up. I left comments on the PR. Best, Yufei `This is not a contribution` On Wed, Jun 30, 2021 at 7:45 AM Eduard Tudenhoefner wrote: > Yufei, > > I did a quick write-up to get you started with setting up the Code > Formatter with IntelliJ IDEA in > https://github.co

Re: Welcoming OpenInx as a new PMC member!

2021-06-30 Thread Palash Goel
Congratulations πŸŽ‰ On Wed, 30 Jun, 2021, 21:14 Eduard Tudenhoefner, wrote: > Congratulations! > > On Wed, Jun 30, 2021 at 4:43 PM Peidian Li wrote: > >> Congratulations! >> >>

Re: Welcoming OpenInx as a new PMC member!

2021-06-30 Thread Eduard Tudenhoefner
Congratulations! On Wed, Jun 30, 2021 at 4:43 PM Peidian Li wrote: > Congratulations! > >

Re: iceberg code style

2021-06-30 Thread Eduard Tudenhoefner
Yufei, I did a quick write-up to get you started with setting up the Code Formatter with IntelliJ IDEA in https://github.com/apache/iceberg/pull/2766 . On Tue, Jun 22, 2021 at 8:46 PM Russell Spitzer wrote: > I have had this on my to do list since I joined the project :P > > On Tue, Jun 22, 20

Re: Welcoming OpenInx as a new PMC member!

2021-06-30 Thread Peidian Li
Congratulations!

Re: Welcoming OpenInx as a new PMC member!

2021-06-30 Thread Danny Chan
Congratulations! Best, Danny Chan RD 于2021εΉ΄6月30ζ—₯ ε‘¨δΈ‰δΈ‹εˆ10:02ε†™ι“οΌš > Congrats OpenInx(Zheng Hu)! > > On Tue, Jun 29, 2021 at 11:41 PM Gautam wrote: > >> Congratulations Zheng Hu! >> >> On Tue, Jun 29, 2021 at 8:17 PM OpenInx wrote: >> >>> Thanks all ! >>> >>> I really appreciate the trust from the

Re: Welcoming OpenInx as a new PMC member!

2021-06-30 Thread RD
Congrats OpenInx(Zheng Hu)! On Tue, Jun 29, 2021 at 11:41 PM Gautam wrote: > Congratulations Zheng Hu! > > On Tue, Jun 29, 2021 at 8:17 PM OpenInx wrote: > >> Thanks all ! >> >> I really appreciate the trust from the Apache iceberg community. For me, >> this is not only an honor, but also a re