Re: Connection pool shut down in Spark Iceberg Streaming Connector

2023-10-05 Thread Ajantha Bhat
gt; > *From:* Eduard Tudenhoefner > *Sent:* Thursday, October 5, 2023 2:48 PM > *To:* dev@iceberg.apache.org > *Subject:* [EXT] Re: Connection pool shut down in Spark Iceberg Streaming > Connector > > > > This sounds similar to https://github.co

RE: Connection pool shut down in Spark Iceberg Streaming Connector

2023-10-05 Thread Agrawal, Sanket
Hi Eduard, Can you please help me with the steps to build a jar for Iceberg-spark using master branch? From: Eduard Tudenhoefner Sent: Thursday, October 5, 2023 2:48 PM To: dev@iceberg.apache.org Subject: [EXT] Re: Connection pool shut down in Spark Iceberg Streaming Connector This sounds

Re: Connection pool shut down in Spark Iceberg Streaming Connector

2023-10-05 Thread Eduard Tudenhoefner
This sounds similar to https://github.com/apache/iceberg/issues/8601, which has just been fixed on master. Other people on Slack reported the same issue. Given that this didn't make it into 1.4.0, I wonder whether this is critical enough to do a 1.4.1 release. On Thu, Oct 5, 2023 at 10:58 AM Agra

Connection pool shut down in Spark Iceberg Streaming Connector

2023-10-05 Thread Agrawal, Sanket
Hello Everyone, We are trying to stream the changes in our Iceberg tables stored in AWS S3. We are achieving this through Spark-Iceberg Connector and using JAR files for Spark-AWS. Suddenly we have started receiving error "Connection pool shut down". Spark Version: 3.4.1 Iceberg: 1.3.1 Any hel