Re: Why Scala?

HN is a cesspool safely ignored. On Thu, May 29, 2014 at 1:55 PM, Nick Chammas wrote: > I recently discovered Hacker News and started reading through older posts > about Scala . It > looks like the language is fairly controversial on ther

Re: Spark with SSL?

way? I would expect it to pretty negatively > impact performance on communication-heavy jobs. > > > On Tue, Apr 8, 2014 at 3:23 PM, Benjamin Black > > > wrote: > >> Only if you trust the provider networks and everyone who might have >> access to them. I don&#x

Re: Spark with SSL?

Only if you trust the provider networks and everyone who might have access to them. I don't. On Tuesday, April 8, 2014, Ognen Duzlevski wrote: > Ideally, you just run it in Amazon's VPC or whatever other providers' > equivalent is. In this case running things over SSL would be an overkill. > >

Re: Spark streaming kafka _output_

do no? >> >> >> On Fri, Mar 21, 2014 at 3:58 PM, Benjamin Black wrote: >> >>> Howdy, folks! >>> >>> Anybody out there having a working kafka _output_ for Spark streaming? >>> Perhaps one that doesn't involve instantiating a new producer for every >>> batch? >>> >>> Thanks! >>> >>> b >>> >> >> >

Re: closures & moving averages (state)

Perhaps you want reduce rather than map? On Wednesday, March 26, 2014, Adrian Mocanu wrote: > I'm passing a moving average function during the map phase like this: > > val average= new Sma(window=3) > > stream.map(x=> average.addNumber(x)) > > > > where > > class Sma extends Serializable {

Spark streaming kafka _output_

Howdy, folks! Anybody out there having a working kafka _output_ for Spark streaming? Perhaps one that doesn't involve instantiating a new producer for every batch? Thanks! b