Re: Question for view and secondary index

2022-08-23 Thread Ryan Blue
Yes, that's probably right. Views get expanded to a logical plan instead of a simple scan. So what typically happens is you parse the original SQL, then parse the view SQL and insert it into the first plan to get a combined plan. That combined plan is what gets optimized, so your filters on the vie

Question for view and secondary index

2022-08-23 Thread Steven Wu
I have a question related to the view feature for this scenario. Physical table is a byte[] column + some promoted columns. We create a view table that explodes the byte[] column to many columns in the logical view (probably via some UDF function). If the physical table has a secondary index (say b

Temporal Iceberg Service

2022-08-23 Thread Taher Koitawala
Hi All, I am creating an iceberg writer over temporal service that converts CDC parquet files to Iceberg format. That means that the file will have a record and corresponding timestamp flags like `inserted_at`, `deleted_at` and `updated_at`, each of which will have a value defining the acti

Re: Welcome Fokko Driesprong as a committer!

2022-08-23 Thread Driesprong, Fokko
Thanks, everyone for the kind words. Honored to be a committer on the Iceberg project and be part of this great community. Looking forward to contributing more in the future! Kind regards, Fokko Op di 23 aug. 2022 om 09:30 schreef Omar Al-Safi : > Congrats! > > On Mon, Aug 22, 2022 at 11:13 PM S

Re: Welcome Fokko Driesprong as a committer!

2022-08-23 Thread Omar Al-Safi
Congrats! On Mon, Aug 22, 2022 at 11:13 PM Steve Zhang wrote: > Congrats Fokko! > > Thanks, > Steve Zhang > > > > On Aug 22, 2022, at 2:05 PM, Szehon Ho wrote: > > Congratulations! > Szehon > > On Mon, Aug 22, 2022 at 12:25 PM Péter Váry > wrote: > >> Congratulations Fokko! >> >> On Mon, Aug 2