r
From: Jack Ye mailto:yezhao...@gmail.com>>
Sent: Thursday, September 23, 2021 2:35 PM
To: Iceberg Dev List mailto:dev@iceberg.apache.org>>
Subject: Re: Error when writing large number of rows with S3FileIO
Thanks, while I am looking into this, this seems to be a very old version, is
there an
yur
>
>
>
> *From:* Jack Ye
> *Sent:* Thursday, September 23, 2021 2:35 PM
> *To:* Iceberg Dev List
> *Subject:* Re: Error when writing large number of rows with S3FileIO
>
>
>
> Thanks, while I am looking into this, this seems to be a very old version,
> is ther
I’ll try to upgrade the version and retry.
Thanks,
Mayur
From: Jack Ye
Sent: Thursday, September 23, 2021 2:35 PM
To: Iceberg Dev List
Subject: Re: Error when writing large number of rows with S3FileIO
Thanks, while I am looking into this, this seems to be a very old version, is
there any
ack Ye
> *Sent:* Thursday, September 23, 2021 1:24 PM
> *To:* Iceberg Dev List
> *Subject:* Re: Error when writing large number of rows with S3FileIO
>
>
>
> Hi Mayur,
>
>
>
> Thanks for reporting this issue, could you report what version of AWS SDK
> V2 you are
No problem Jack.
I’m using https://mvnrepository.com/artifact/software.amazon.awssdk/s3/2.10.53
Thanks,
Mayur
From: Jack Ye
Sent: Thursday, September 23, 2021 1:24 PM
To: Iceberg Dev List
Subject: Re: Error when writing large number of rows with S3FileIO
Hi Mayur,
Thanks for reporting this
Hi Mayur,
Thanks for reporting this issue, could you report what version of AWS SDK
V2 you are using?
Best,
Jack Ye
On Thu, Sep 23, 2021 at 8:39 AM Mayur Srivastava <
mayur.srivast...@twosigma.com> wrote:
> Hi,
>
>
>
> I've an Iceberg table partitioned by a single "time" (monthly partitioned)
>
Hi,
I've an Iceberg table partitioned by a single "time" (monthly partitioned)
column that has 400+ columns and >100k rows. I'm using parquet files and
PartitionedWriter + S3FileIO to write the data. When I write <~50k
rows, the writer works. But it fails with the exception below if I write mor
