I am not familiar with this environment setup, but I heard that because Iceberg requires Spark extensions and Databricks has its own extensions loaded automatically it causes conflicts and unexpected behaviors.
Could you provide more details for why the cluster stops? Is there any stacktrace you can provide? Best, Jack Ye On Fri, Nov 19, 2021 at 2:06 PM Ridam Arora <ridamaror...@gmail.com> wrote: > Hi everyone, > > I'm trying to query data on databricks using iceberg tables saved on S3, > but not able to figure out , > my cluster stops everytime I load metadata files into it even though the > amount of data is very small. Is there any documentation related to it? > Any help would be appreciated. > > Thanks, > Ridam >
