hopefully to the community.
>
>
>
> Meanwhile, I’ll checkout S3FileIO and try to change my benchmarks to use
> it.
>
>
>
> Thanks,
>
> Mayur
>
>
>
>
>
> *From:* Daniel Weeks
> *Sent:* Tuesday, March 23, 2021 7:17 PM
> *To:* Iceberg Dev List
>
optimizations? This will quite useful for us and
hopefully to the community.
Meanwhile, I’ll checkout S3FileIO and try to change my benchmarks to use it.
Thanks,
Mayur
From: Daniel Weeks
Sent: Tuesday, March 23, 2021 7:17 PM
To: Iceberg Dev List
Subject: Re: Single Reader Benchmarks on S3-like Storage
Hey Mayur, thanks for the detailed writeup.
I would say that what you're looking at in terms of performance is very
specific to the file system implementation (like you've already discovered
by replacing the GHFS implementation).
Within iceberg, this is scoped very specifically to the FileIO
impl
Hi,
I've been running performance benchmarks on core Iceberg readers on Google
Cloud Storage (GCS). I would like to share some of my results and check whether
there are ways to improve performance on S3-like storage in general. The
details (including sample code) are listed below the question
