Re: [Discuss] Spark 3.2 support?

+1 John Zhuge On Thu, Dec 14, 2023 at 4:03 PM Jack Ye wrote: > +1 > > -Jack > > On Wed, Dec 13, 2023 at 11:25 PM Eduard Tudenhoefner > wrote: > >> +1 on removing Spark 3.2 >> >> On Wed, Dec 13, 2023 at 8:01 PM Jean-Baptiste Onofré >> wrote: >> >>> +1 >>> >>> Regards >>> JB >>> >>> On Wed, De

Re: Proposal for REST APIs for Iceberg table scans

The tasks might look something like this: CombinedPlanTask - List ManifestPlanTask - int start - int length - ManifestFile dataManifest - List deleteManifests On Thu, Dec 14, 2023 at 4:07 PM Ryan Blue wrote: > Seems like that track has expired (This Internet-Draft will expire on 13 > May 2022)

Re: Proposal for REST APIs for Iceberg table scans

Seems like that track has expired (This Internet-Draft will expire on 13 May 2022) Yeah, looks like we should just use POST. That’s too bad. QUERY seems like a good idea to me. Distinguish planning using shard or not I think this was a mistake on my part. I was still thinking that we would have

Re: [Discuss] Spark 3.2 support?

+1 -Jack On Wed, Dec 13, 2023 at 11:25 PM Eduard Tudenhoefner wrote: > +1 on removing Spark 3.2 > > On Wed, Dec 13, 2023 at 8:01 PM Jean-Baptiste Onofré > wrote: > >> +1 >> >> Regards >> JB >> >> On Wed, Dec 13, 2023 at 7:10 PM Ajantha Bhat >> wrote: >> > >> > Hi All, >> > >> > In our recent

Pagination for List APIs in the REST spec

Hi everyone, During the conversation of the Scan API for REST spec, we touched on the topic of pagination when REST response is large or takes time to be produced. I just want to discuss this separately, since we also see the issue for ListNamespaces and ListTables/Views, when integrating with a

Re: CDC Merge Failing - https://github.com/apache/iceberg/issues/8333

Thanks for reaching out about this. It does look like a bug somewhere. I'm curious whether it works in Spark 3.5 if you have a chance to try it out. It looks like the cause is a missing cast or incorrect schema somewhere in Spark. The data coming in is a Spark string, but for some reason Spark thi

CDC Merge Failing - https://github.com/apache/iceberg/issues/8333

Hey Folks, My team members and me have been stuck in this issue for a long time. Can you please check this issue once. With the snippet given in the following question - https://stackoverflow.com/questions/77655115/org-apache-spark-unsafe-types-utf8string-cannot-be-cast-to-java-lang-long-except yo