Re: [DISCUSS] Modify ThreadPools.newWorkerPool to avoid unnecessary Shutdown Hook registration

2024-09-17 Thread Péter Váry
Bumping this thread a bit. Cleaning up the pool in non-static cases should be a responsibility of the user. If they want a pool which is closed by a hook when the JVM exists they should explicitly "say" so, for example calling "newExitingWorkerPool". This is a behaviour change in the API, so I th

[DISCUSS] Column to Column filtering

2024-09-17 Thread Baldwin, Jennifer
I’m starting a thread to discuss a feature for comparisons using column references on the left and right side of an expression wherever iceberg supports column reference to literal value(s) comparisons. The use case we want to support is filtering of date columns from a single table. For insta

Re: [DISCUSS] Improving Position Deletes in V3

2024-09-17 Thread Bryan Keller
Thanks for the doc Anton, I reviewed it and it looks good to me. Let me know if I can help with anything, it is an area of interest for me. -Bryan > On Aug 21, 2024, at 2:28 PM, Anton Okolnychyi wrote: > > Hey folks, > > As discussed during the sync, I've been working on a proposal to improv

Re: Hive 4 integration to store table on S3 and ADLS gen2

2024-09-17 Thread Ayush Saxena
Hi Somesh, But while trying so we are seeing following exception : > hadoop fs -ls s3a://somesh.qa.bucket/ -: This has nothing to do with Hive as such, You have configured Hadoop S3 client wrong, you are missing configs, your hadoop ls command itself is failing, there is no Hive involved here.