Thanks for your thoughts, JB. I agree with the concerns, but note that
reading table metadata from the file system for each commit report is not
cost-free.
I'd rather use the system time instead of reading table metadata.
Regards,
Manu
On Wed, May 21, 2025 at 3:56 PM Jean-Baptiste Onofré
wrote:
+0
I don't see much value compared to reading the table metadata via snapshot id.
I'm not against it, but it seems a bit redundant. Giving direct access
via REST Catalog could be discussed also.
Regards
JB
On Thu, May 8, 2025 at 5:01 PM Manu Zhang wrote:
>
> Hi all,
>
> I'd like to start a vote
Thanks Daniel for your thorough explanation. I understand your concern now
and agree with this point.
I feel like we're adding additional information that isn't accurate and
> doesn't add a whole lot of value.
>
Actually, maintenance tasks scheduling doesn't require an accurate
timestamp, which
Hey Manu,
I didn't see a discuss thread on this topic, so I'll add my concerns here.
The issue I have is around the fidelity of what we're using as a commit
timestamp. I feel like we're adding additional information that isn't
accurate and doesn't add a whole lot of value.
The metrics already in
Thanks Yufei. I'm still seeking more votes here.
Manu
On Wed, May 14, 2025 at 1:37 AM Yufei Gu wrote:
> +1 I'm OK to add it as long as it's optional.
>
> Yufei
>
>
> On Mon, May 12, 2025 at 8:47 PM Manu Zhang
> wrote:
>
>> Hi all,
>>
>> The background is that we schedule maintenance jobs based
+1 I'm OK to add it as long as it's optional.
Yufei
On Mon, May 12, 2025 at 8:47 PM Manu Zhang wrote:
> Hi all,
>
> The background is that we schedule maintenance jobs based on commit
> reports for Iceberg tables, and we want to know *when commits happen*.
> Adding timestamp to the commit repo
Hi all,
The background is that we schedule maintenance jobs based on commit reports
for Iceberg tables, and we want to know *when commits happen*.
Adding timestamp to the commit report would save us from loading metadata
of every table from the filesystem.
Please take a look at the PR and cast yo
