Finally got a chance to sit down and run through a few tests. Upfront, I have been able to resolve my issue sufficiently to move forward, but seems there’s an issue with the current bits for both 1.0-SNAPSHOT and 0.10-SNAPSHOT in the remote Maven repos.
Notes wordcount-processing <https://github.com/OCExercise/wordcount-processing> is a customized version of the Flink quickstart archetype I’m using to test Flink integration with Spring Boot. It is instrumented for Maven and Gradle build and execution. I’m targeting Scala 2.11 and Flink 0.10. 0.10-SNAPSHOT source build Steps Checked out release–0.10 branch (snapshot version 0.10-SNAPSHOT). Built with mvn clean install -DskipTests=true -Dmaven.javadoc.skip=true -Dscala.version=2.11.7 -Dscala.binary.version=2.11. Ran wordcount-process with mvn clean spring-boot:run -Drun.arguments=“localhost,9999”. Ran wordcount-process with gradle bootRun -Drun.arguments=“localhost 9999”. Result Maven execution of test succeeds without incident. Gradle execution of test succeeds without incident. 0.10-SNAPSHOT with fetched binary dependencies Steps Cleaned out local maven repository with rm -rf $HOME/.m2/repo/org/apache/flink && rm -rf $HOME/.m2/repo/org/scala*. Cleaned out local gradle repository with rm -rf $HOME/.gradle/caches/modules-2/files-2.1/org.apache.flink && rm -rf $HOME/.gradle/caches/modules-2/files-2.1/org.scala*. Ran wordcount-process with mvn clean spring-boot:run -Drun.arguments=“localhost,9999”. Ran wordcount-process with gradle bootRun -Drun.arguments=“localhost 9999”. Result Maven build completed without incident. Maven execution error’d out with issue supposedly resolved with pull request 1511 <https://github.com/apache/flink/pull/1511>. Gradle execution of test succeeds without incident. 1.0-SNAPSHOT source build Steps Cleaned out local maven repository with rm -rf $HOME/.m2/repo/org/apache/flink && rm -rf $HOME/.m2/repo/org/scala*. Cleaned out local gradle repository with rm -rf $HOME/.gradle/caches/modules-2/files-2.1/org.apache.flink && rm -rf $HOME/.gradle/caches/modules-2/files-2.1/org.scala*. Checked out release–0.10 branch (snapshot version 0.10-SNAPSHOT). Built with mvn clean install -DskipTests=true -Dmaven.javadoc.skip=true -Dscala.version=2.11.7 -Dscala.binary.version=2.11. Ran wordcount-process with mvn clean spring-boot:run -Drun.arguments=“localhost,9999”. Ran wordcount-process with gradle bootRun -Drun.arguments=“localhost 9999”. Result Maven build completed without incident. Maven execution error’d out with issue supposedly resolved with pull request 1511 <https://github.com/apache/flink/pull/1511>. Gradle execution of test succeeds without incident. 1.0-SNAPSHOT with fetched binary dependencies Steps Cleaned out local maven repository with rm -rf $HOME/.m2/repo/org/apache/flink && rm -rf $HOME/.m2/repo/org/scala*. Cleaned out local gradle repository with rm -rf $HOME/.gradle/caches/modules-2/files-2.1/org.apache.flink && rm -rf $HOME/.gradle/caches/modules-2/files-2.1/org.scala*. Ran wordcount-process with mvn clean spring-boot:run -Drun.arguments=“localhost,9999”. Ran wordcount-process with gradle bootRun -Drun.arguments=“localhost 9999”. Result Maven build error’d out with could not find implicit value for evidence parameter of type org.apache.flink.api.common.typeinfo.TypeInformation[String], and can't expand macros compiled by previous versions of Scala[ERROR] val text = env.fromElements("To be, or not to be,--that is the question:—“. (Gist <https://gist.github.com/revprez/c70a6f3976b091413c8c>). Gradle build error’d out with java.lang.NoClassDefFoundError: scala/reflect/macros/Context (gist <https://gist.github.com/revprez/298a0302711908975add>). Discussion As it stands, I can move forward with building 0.10-SNAPSHOT from source for my own purposes. I’m guessing pull request 1511 <https://github.com/apache/flink/pull/1511> hasn’t made it into the the upstream snapshot repos yet. I’m not sure as to why 1.0-SNAPSHOT is suffering from a macros incident and not 0.10-SNAPSHOT. Both are bringing in dependencies (quasiquotes, scala-library, scala-reflect, and a bunch of akka-* stuff) compiled for 2.10, but 0.10-SNAPSHOT does not invite the macro-related errors some of us have seen when building against 1.0-SNAPSHOT dependencies. Prez Cannady p: 617 500 3378 e: revp...@opencorrelate.org <mailto:revp...@opencorrelate.org> GH: https://github.com/opencorrelate <https://github.com/opencorrelate> LI: https://www.linkedin.com/in/revprez <https://www.linkedin.com/in/revprez> > On Jan 18, 2016, at 3:57 AM, Till Rohrmann <trohrm...@apache.org> wrote: > > This might be related to the problem mentioned in > https://issues.apache.org/jira/browse/FLINK-3241 and > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/flink-1-0-SNAPSHOT-scala-2-11-compilation-error-td4303.html > . > > Cheers, > Till > > On Sun, Jan 17, 2016 at 6:26 PM, Prez Cannady <revp...@correlatesystems.com> > wrote: > >> I concur. Already had "import org.apache.flink.streaming.api.scala._”, >> and just tried adding "import org.apache.flink.api.scala._”. Same issue. >> >> >> >> Prez Cannady >> p: 617 500 3378 >> e: revp...@opencorrelate.org <mailto:revp...@opencorrelate.org> >> GH: https://github.com/opencorrelate <https://github.com/opencorrelate> >> LI: https://www.linkedin.com/in/revprez < >> https://www.linkedin.com/in/revprez> >> >> >> >> >> >> >> >> >> >>> On Jan 17, 2016, at 8:59 AM, Aljoscha Krettek <aljos...@apache.org> >> wrote: >>> >>> Hi, >>> I think it’s more complicated than a missing import statement (the code >> has the correct import statement). I’ll look into it. >>> >>> Cheers, >>> Aljoscha >>>> On 17 Jan 2016, at 13:32, Stephan Ewen <se...@apache.org> wrote: >>>> >>>> Hi! >>>> >>>> I think this no Scala version issue, you probably miss an import >> statement: >>>> >>>> "import org.apache.flink.streaming.api.scala._" or "import >>>> org.apache.flink.api.scala._" >>>> >>>> See also here: >>>> >> http://flink.apache.org/faq.html#in-scala-api-i-get-an-error-about-implicit-values-and-evidence-parameters >>>> >>>> Greetings, >>>> Stephan >>>> >>>> On Sat, Jan 16, 2016 at 9:09 PM, Prez Cannady < >> revp...@opencorrelate.org> >>>> wrote: >>>> >>>>> Attempting to get settled with Flink under Scala 2.11, but running into >>>>> some odd issues with macro expansion in a project that depends on >>>>> flink-scala_2.11 and flink-runtime_211. >>>>> >>>>> I’ve instrumented the SocketStreamWordCount quick start < >>>>> https://github.com/OCExercise/wordcount-processing> to test this >> issue. >>>>> It depends on Flink 1.0-SNAPSHOT, so you can test against a local >> build of >>>>> Flink for 2.11. >>>>> >>>>> Steps taken >>>>> >>>>> Cloned source and checked out release-0.1 >>>>> Ran tools/change-scala-version.sh 2.11 >>>>> Ran mvn clean install -Dscala.version=2.11.4 >> -Dscala.binary.version=2.11 >>>>> -Dakka.version=2.4.1 -DskipTests=true at Flink root; build succeeds >>>>> Ran my spring-booted downstream project’s build and boot run. >>>>> Expected result >>>>> >>>>> Success >>>>> >>>>> Actual result >>>>> >>>>> During compilation, I get the following error: >>>>> >>>>> [ERROR] >>>>> >> /Users/revprez/dev/exercise/systems/jvm/flink/wordcount-processing/src/main/scala/org/opencorrelate/jvm/scala/SocketTextStreamWordCount.scala:73: >>>>> error: could not find implicit value for evidence parameter of type >>>>> org.apache.flink.api.common.typeinfo.TypeInformation[String] >>>>> [ERROR] val counts = text.flatMap { _.toLowerCase.split("\\W+") >>>>> filter { _.nonEmpty } } >>>>> [ERROR] ^ >>>>> [ERROR] >>>>> >> /Users/revprez/dev/exercise/systems/jvm/flink/wordcount-processing/src/main/scala/org/opencorrelate/jvm/scala/WordCount.scala:40: >>>>> error: can't expand macros compiled by previous versions of Scala >>>>> [ERROR] val text = env.fromElements("To be, or not to be,--that is >> the >>>>> question:--", >>>>> >>>>> >>>>> Discussion >>>>> >>>>> I’m not sure how the Maven build actually succeeded, as there doesn’t >> seem >>>>> to be any quasiquotes_2.11 under org.scalamacros < >>>>> http://central.maven.org/maven2/org/scalamacros/> of any version in >> the >>>>> public repos, nor in the four vendor repos configured in flink-parent’s >>>>> pom.xml. Unless I’m missing something, >>>>> >>>>> <dependencies> >>>>> <dependency> >>>>> <groupId>org.scalamacros</groupId> >>>>> >>>>> <artifactId>quasiquotes_${scala.binary.version}</artifactId> >>>>> <version>${scala.macros.version}</version> >>>>> </dependency> >>>>> </dependencies> >>>>> >>>>> >>>>> I recall an earlier discussion about issues with 2.10 stuff polluting >> the >>>>> 2.11 build. Not sure if this is related–I’m able to get through >> everything >>>>> I’ve identified up to this point by simply overriding properties in >>>>> flunk-parent with command line arguments. >>>>> >>>>> Also not sure what next steps to take. Don’t know enough about Scala >>>>> Macros to know if substituting, say, >> org.scalameta:quasiquotes_2.11:0.0.4 >>>>> is a viable option (actually tried it, seems to be more trouble than >> it’s >>>>> worth). >>>>> >>>>> If anyone has any ideas, I’m more than willing to try thing—Flink’s on >> our >>>>> critical path and if we can get it operational under 2.11 then we’er >> golden. >>>>> >>>>> >>>>> >>>>> Prez Cannady >>>>> p: 617 500 3378 >>>>> e: revp...@opencorrelate.org <mailto:revp...@opencorrelate.org> >>>>> GH: https://github.com/opencorrelate <https://github.com/opencorrelate >>> >>>>> LI: https://www.linkedin.com/in/revprez < >>>>> https://www.linkedin.com/in/revprez> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>> >> >>
