Re: Issue Upgrading to 3.2

2021-11-02 Thread Linhong Liu
Hello Adam, I just made a PR that should fix your issue. Would you like to give it a try? PR Link: https://github.com/apache/spark/pull/34473 Thanks, Linhong On Tue, Nov 2, 2021 at 1:16 AM Adam Binford wrote: > Sorry yeah good question. It happens on the call to spark.table("pixels") > > On Mon

Re: Issue Upgrading to 3.2

2021-11-01 Thread Adam Binford
Sorry yeah good question. It happens on the call to spark.table("pixels") On Mon, Nov 1, 2021 at 12:36 PM Wenchen Fan wrote: > To confirm: Does the error happen during view creation, or when we read > the view later? > > On Mon, Nov 1, 2021 at 11:28 PM Adam Binford wrote: > >> I don't have a mi

Re: Issue Upgrading to 3.2

2021-11-01 Thread Wenchen Fan
To confirm: Does the error happen during view creation, or when we read the view later? On Mon, Nov 1, 2021 at 11:28 PM Adam Binford wrote: > I don't have a minimal reproduction right now but here's more relevant > code snippets. > > Stacktrace: > org.apache.spark.sql.AnalysisException: Undefin

Re: Issue Upgrading to 3.2

2021-11-01 Thread Adam Binford
I don't have a minimal reproduction right now but here's more relevant code snippets. Stacktrace: org.apache.spark.sql.AnalysisException: Undefined function: 'ST_PolygonFromEnvelope'. This function is neither a registered temporary function nor a permanent function registered in the database 'def

Re: Issue Upgrading to 3.2

2021-11-01 Thread Wenchen Fan
Hi Adam, Thanks for reporting this issue! Do you have the full stacktrace or a code snippet to reproduce the issue at Spark side? It looks like a bug, but it's not obvious to me how this bug can happen. Thanks, Wenchen On Sat, Oct 30, 2021 at 1:08 AM Adam Binford wrote: > Hi devs, > > I'm work