Matthew J Meyer created ZEPPELIN-3547:
-----------------------------------------
Summary: Spark scala line breaks not working (illegal start of
definition)
Key: ZEPPELIN-3547
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3547
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.8.1
Reporter: Matthew J Meyer
If I format spark scala statements with line breaks (for readability) and then
run the para I get:
{{<console>:1: error: illegal start of definition
.read.format("com.databricks.spark.csv")}}
The following will produce this error:
{{%spark}}
{{val path = z.textbox("dataDir")}}
{{val filename = z.textbox("projectName")}}{{val dfArticles = spark}}
{{ .read.format("com.databricks.spark.csv")}}
{{ .option("header", "true")}}
{{ .option("inferSchema", "true")}}
{{ .load(path+"/"+filename+"-articles.csv"}}
If the entire statement is on one continuous line, it runs successfully.
I am a aware that I can wrap the block with curly braces to get around this but
that is not really a solution since it affects the scope of the statements
making things defined in the block not available in other paragraphs in the
notebook.
Using continuous lines is not really a workable option when working with
anything more than trivial spark queries.
I'd really like to be using things like Helium spell extensions, notebook level
form fields and all of the other good stuff in 0.8.0 but this issue is so
debilitating it has me sticking with 0.7.3.
Please fix this soon.
I built from branch-0.8.0 with:
{{mvn clean package -Pspark-2.1 -Phadoop-2.4 -Pscala-2.11 -DskipTests}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
