Cannot create custom streaming source in Spark 2.3.0

2018-03-19 Thread Thakrar, Jayesh
I am trying to create a custom streaming source in Spark 2.3.0 and getting the following error: scala> 2018-03-19 17:43:20 ERROR MicroBatchExecution:91 - Query [id = 48bb7a4c-7c66-4ad3-926b-81f8369a6efb, runId = 50800f9b-434d-43df-8d6a-3e0fdc865aeb] terminated with error java.lang.AssertionErro

Re: Reserved Words in Spark SQL as TableAliases

2018-03-19 Thread Reynold Xin
I agree but the issue was backward compatibility... On Mon, Mar 19, 2018 at 4:02 PM Russell Spitzer wrote: > I found > https://issues.apache.org/jira/browse/SPARK-20964 > > but currently it seems like strictIdentifiers are allowed to contain any > reserved key words > > > https://github.com/apac

Reserved Words in Spark SQL as TableAliases

2018-03-19 Thread Russell Spitzer
I found https://issues.apache.org/jira/browse/SPARK-20964 but currently it seems like strictIdentifiers are allowed to contain any reserved key words https://github.com/apache/spark/blob/master/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4#L501-L503 https://github.