Re: Antlr plugin for sql/catalyst project

2019-04-15 Thread William Wong
Hi Sean, I just submitted a PR for updating the develop-tools.html. ( https://github.com/apache/spark-website/pull/195). May i know if you may help review it? Many thanks for your help. Best regards, William On Mon, Apr 15, 2019 at 7:04 AM William Wong wrote: > I built the spark with build/

Re: Antlr plugin for sql/catalyst project

2019-04-14 Thread William Wong
I built the spark with build/mvn via terminal. It also downloaded maven with the right version. After changing the maven to the right version in IntelliJ, everything worked perfectly again. Thanks for the info. I will enhance that a bit later. Hope it helps the community. On Mon, 15 Apr 2019 at 1

Re: Antlr plugin for sql/catalyst project

2019-04-14 Thread Sean Owen
That's right, Spark needs Maven 3.6.0. Just install it locally and then configure IntelliJ to use the local Maven, not built-in 3.3.9. The docs you're looking at are actually in github.com/apache/spark-website as they aren't version-specific and tied to a release. On Sun, Apr 14, 2019 at 12:00 PM

Re: Antlr plugin for sql/catalyst project

2019-04-14 Thread William Wong
Hi Sean, I would like to open a PR for updating the documentation. However, i cannot share any file for 'http://spark.apache.org/developer-tools.html' It seems that this file is not a part of the documentation (under folder docs)... Thanks and regards, William On Sun, Apr 14, 2019 at 11:58 PM Wi

Re: Antlr plugin for sql/catalyst project

2019-04-14 Thread William Wong
Hi Sean, I tried the button, but antlr4 source was not generate as expected. I checked the IntelliJ log and found some error message like: *2019-04-14 16:05:24,796 [ 314609] INFO - #org.jetbrains.idea.maven - [WARNING] Rule 0: org.apache.maven.plugins.enforcer.RequireMavenVersion failed wi

Re: Antlr plugin for sql/catalyst project

2019-04-14 Thread Sean Owen
For IntelliJ, in the Maven pane, there's a button to generate all sources and resources that the build creates. That's the easier option. You can open a PR to add a note about it along with other docs for IntelliJ users. On Sun, Apr 14, 2019 at 4:24 AM William Wong wrote: > > Dear all, > > I trie

Antlr plugin for sql/catalyst project

2019-04-14 Thread William Wong
Dear all, I tried to follow the guide at 'http://spark.apache.org/developer-tools.html' to setup an IntelliJ project for Spark. However, the project was failed to build. It was due to missing classes generated via antlr on sql/catalyst project. I would like to enhance the document to hint other n