antonkulaga created ZEPPELIN-4177:
-------------------------------------

             Summary: org.apache.commons:commons-lang3 dependency Hell with 
Spark 2.4.x
                 Key: ZEPPELIN-4177
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4177
             Project: Zeppelin
          Issue Type: Improvement
    Affects Versions: 0.8.1
            Reporter: antonkulaga


I get a dependency Hell when I try to load any csv with Spark 2.4.3
```
sparkSession.read
      .option("sep", "\t")
      .option("comment", "#")
      .option("inferSchema", true)
      .option("header", true)
      .option("ignoreLeadingWhiteSpace", true)
      .option("ignoreTrailingWhiteSpace", true)
      .option("ignoreTrailingWhiteSpace", true)
      .option("maxColumns", 150000)
      .csv(pathToTheFile)
```
I managed to find a workaround by adding 
"org.apache.commons:commons-lang3:3.8.1 to the spark interpreter dependencies, 
however the true fix will be updating Zeppelin org.apache.commons:commons-lang3 
dependency to a newer one.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to