Re: SAM Scala aggregate

2018-09-13 Thread Michael Eugene
_ From: John Roesler Sent: Wednesday, September 12, 2018 8:12:57 PM To: users@kafka.apache.org Subject: Re: SAM Scala aggregate I'm not 100% certain, but you might need to do "import _root_.scala.collection.JavaConverters._" etc. Sometimes, you run into trouble with ambi

Re: SAM Scala aggregate

2018-09-12 Thread John Roesler
2.0 for sbt? And it doesn't matter if the system is > not > >> Kafka 2.0? Upgrading Kafka itself is probably not an option or me right > now. > >> > >> > >> > >> > >> > >> > >> From: J

Re: SAM Scala aggregate

2018-09-12 Thread Michael Eugene
s >> and kafka streams 2.0 for sbt? And it doesn't matter if the system is not >> Kafka 2.0? Upgrading Kafka itself is probably not an option or me right now. >> >> >> >> >> >> ____ >> From: John Roesler

Re: SAM Scala aggregate

2018-09-10 Thread Liam Clarke
m is not > Kafka 2.0? Upgrading Kafka itself is probably not an option or me right now. > > > > > > > From: John Roesler > Sent: Monday, September 10, 2018 4:18:24 PM > To: users@kafka.apache.org > Subject: Re: SAM Scala aggregate &g

Re: SAM Scala aggregate

2018-09-10 Thread Michael Eugene
onday, September 10, 2018 4:18:24 PM To: users@kafka.apache.org Subject: Re: SAM Scala aggregate In addition to the other suggestions, if you're having too much trouble with the interface, you can always fall back to creating anonymous Initializer/Aggregator instances the way you would if prog

Re: SAM Scala aggregate

2018-09-10 Thread John Roesler
In addition to the other suggestions, if you're having too much trouble with the interface, you can always fall back to creating anonymous Initializer/Aggregator instances the way you would if programming in Java. This way, you wouldn't need SAM conversion at all (all it's doing is turning your fun

Re: SAM Scala aggregate

2018-09-10 Thread Sean Glover
Hi, SAM conversions can be enabled in 2.11 with the -Xexperimental to scalac. However, this version of SAM conversions isn't recommended for production and was significantly refactored for 2.12. When we contributed this API to Kafka we explicitly removed the SAM conversions because we didn't want

Re: SAM Scala aggregate

2018-09-09 Thread Michael Eugene
I’m integrating with lot of other applications and it would be a little cowboy to chose my own version. I can commend that we all went to 2.0 but there are already working application me so it won’t be possible to upgrade everything that everyone else is doing. That will have to happen sometim

Re: SAM Scala aggregate

2018-09-09 Thread Matthias J. Sax
Why can't you use Kafka Streams 2.0? Note: Kafka Streams is backward compatible and it can connect to older brokers -- it's not required to upgrade your cluster to use Kafka Streams 2.0 -- updating you maven/gradle dependency is sufficient. Also, AFAIK SAM conversions are only available in Scala

Re: SAM Scala aggregate

2018-09-09 Thread Michael Eugene
I can’t do Kafka 2.0. I am limited to this version right now. If I continue to struggle with it this much, I can eventually do that. However, I know other people in the organization have things kafka working with Scala. Probably not a good idea to say it’s a necessity when it’s not completely

Re: SAM Scala aggregate

2018-09-09 Thread Debasish Ghosh
I don't have the environment to run the Scala code right now. Will be tomorrow until I have one .. Now that Scala API is part of the official Kafka distribution. Can u please try that out instead of kafka-streams-scala ? The library is now deprecated and I remember we ran into some SAM related iss

Re: SAM Scala aggregate

2018-09-09 Thread Michael Eugene
I’m using 2.11.11 Sent from my iPhone > On Sep 9, 2018, at 12:13 PM, Debasish Ghosh wrote: > > Which version of Scala are u using ? > >> On Sun, 9 Sep 2018 at 10:44 AM, Michael Eugene wrote: >> >> Hi, >> >> I am using kafak-sreams-scala >> https://github.com/lightbend/kafka-streams-scala,

Re: SAM Scala aggregate

2018-09-09 Thread Michael Eugene
I already thought I tried that. I tried explicitly creating the KeyValueMapper and supplying the apply override. I think it looks like SAM syntax but it might be something else. Sent from my iPhone > On Sep 9, 2018, at 11:08 AM, Ryanne Dolan wrote: > > This means the types of k, v, vr don'

Re: SAM Scala aggregate

2018-09-09 Thread Debasish Ghosh
Which version of Scala are u using ? On Sun, 9 Sep 2018 at 10:44 AM, Michael Eugene wrote: > Hi, > > I am using kafak-sreams-scala > https://github.com/lightbend/kafka-streams-scala, and I am trying to > implement something very simple and I am getting a compilation error by the > "aggregate"

Re: SAM Scala aggregate

2018-09-09 Thread Ryanne Dolan
This means the types of k, v, vr don't match those expected by the aggregate() function. Add explicit types to your code and you'll find the problem. You'll probably find that Scala is inferring an Any somewhere. Ryanne On Sun, Sep 9, 2018, 12:14 AM Michael Eugene wrote: > Hi, > > I am using

SAM Scala aggregate

2018-09-08 Thread Michael Eugene
Hi, I am using kafak-sreams-scala https://github.com/lightbend/kafka-streams-scala, and I am trying to implement something very simple and I am getting a compilation error by the "aggregate" method. The error is "Cannot resolve overload method 'aggregate'" and "Unspecified value parameters: