Unsubscribe

2023-08-01 Thread Zoran Jeremic
Unsubscribe

Unsubscribe

2023-07-17 Thread Zoran Jeremic
Unsubscribe

Re: Using Spark in mixed Java/Scala project

2016-01-27 Thread Zoran Jeremic
Hi Jakob, Thanks a lot for your help. I'll try this. Zoran On Wed, Jan 27, 2016 at 10:49 AM, Jakob Odersky wrote: > JavaSparkContext has a wrapper constructor for the "scala" > SparkContext. In this case all you need to do is declare a > SparkContext that is accessible both from the Java and S

Re: Problem to persist Hibernate entity from Spark job

2015-09-13 Thread Zoran Jeremic
sion.getTransaction() != null) { > session.getTransaction().rollback() > ex.printStackTrace() > } > } > } > } > } > } > session.close() > } > Thanks, Zoran On Sun, Sep 6, 2015 at 1:42 PM, Zoran Jeremic wrote: > I have GenericDAO class which

Re: Problem to persist Hibernate entity from Spark job

2015-09-06 Thread Zoran Jeremic
;> how do you create your session? do you reuse it across threads? how do >> you create/close session manager? >> look for the problem in session creation, probably something deadlocked, >> as far as I remember hib.session should be created per thread >> >> On 6 Septem

Problem to persist Hibernate entity from Spark job

2015-09-05 Thread Zoran Jeremic
Hi, I'm developing long running process that should find RSS feeds that all users in the system have registered to follow, parse these RSS feeds, extract new entries and store it back to the database as Hibernate entities, so user can retrieve it. I want to use Apache Spark to enable parallel proc

Re: Twitter streaming with apache spark stream only a small amount of tweets

2015-07-29 Thread Zoran Jeremic
erian >> wrote: >> >>> This question was answered with sample code a couple of days ago, please >>> look back. >>> >>> On Sat, Jul 25, 2015 at 11:43 PM, Zoran Jeremic >> > wrote: >>> >>>> Hi, >>>> >>>

Re: Twitter streaming with apache spark stream only a small amount of tweets

2015-07-29 Thread Zoran Jeremic
1% of tweets, and if you use filter API, Twitter limits you to 400 hashtags you can follow. Thanks, Zoran On Wed, Jul 29, 2015 at 8:40 AM, Peyman Mohajerian wrote: > This question was answered with sample code a couple of days ago, please > look back. > > On Sat, Jul 25, 2015 at

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

2015-07-26 Thread Zoran Jeremic
On Thu, Jul 23, 2015 at 9:22 PM, Zoran Jeremic > wrote: > >> Hi Yana, >> >> Sorry for late response. I just saw your email. At the end I ended with >> the following pom https://www.dropbox.com/s/19fldb9qnnfieck/pom.xml?dl=0 >> There were multiple problems I had

Re: Twitter streaming with apache spark stream only a small amount of tweets

2015-07-25 Thread Zoran Jeremic
e that I missed something obvious. Thanks, Zoran On Sat, Jul 25, 2015 at 8:44 PM, Zoran Jeremic wrote: > Hi, > > I've implemented Twitter streaming as in the code given at the bottom of > email. It finds some tweets based on the hashtags I'm following. However, > it seems that a

Twitter streaming with apache spark stream only a small amount of tweets

2015-07-25 Thread Zoran Jeremic
Hi, I've implemented Twitter streaming as in the code given at the bottom of email. It finds some tweets based on the hashtags I'm following. However, it seems that a large amount of tweets is missing. I've tried to post some tweets that I'm following in the application, and none of them was recei

Re: How to restart Twitter spark stream

2015-07-24 Thread Zoran Jeremic
se) > > val filtered = rdd.filter(status =>{ > var found = false > for(tag <- sampleHashTags){ > if(status.getText.toLowerCase.contains(tag)) found = true > } > found > }) > > filtered > }) > >

Re: How to restart Twitter spark stream

2015-07-23 Thread Zoran Jeremic
".toLowerCase))* > val newRDD = samplehashtags.map { x => (x,1) } > val joined = newRDD.join(rdd) > > joined > }) > > filteredStream.print() > > Thanks > Best Regards > > On Wed, Jul 22, 2015 at 3:58 AM, Zoran Jeremic > wrote: > >

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

2015-07-23 Thread Zoran Jeremic
time > classpath anywhere? Curious on what a minimal setup here is. > > > Thanks a lot (I'd love to see your .pom if you have it on github or somewhere > accessible). > > > On Fri, Jul 10, 2015 at 2:24 PM, Zoran Jeremic > wrote: > >> It looks like th

Re: How to restart Twitter spark stream

2015-07-21 Thread Zoran Jeremic
ilteredStream= stream.transform(rdd =>{ > val samplehashtags=Array("music","film") > val newRDD= samplehashtags.map { x => (x,1) } > rdd.join(newRDD) > }) > Did I miss something here? Thanks, Zoran On Mon, Jul 20, 2015 at 9:54 AM, Zor

Re: How to restart Twitter spark stream

2015-07-20 Thread Zoran Jeremic
orm(rdd =>{ > > val newRDD = > scc.sc.textFile("/this/file/will/be/updated/frequently").map(x => (x,1)) > > rdd.join(newRDD) > > }) > > ​newRDD will work like a filter when you do the join.​ > > > Thanks > Best Regards > > On Sun, Jul 19, 20

Re: How to restart Twitter spark stream

2015-07-19 Thread Zoran Jeremic
tags from disk in a regular interval > > Le dim. 19 juil. 2015 à 7:40, Zoran Jeremic a > écrit : > >> Hi, >> >> I have a twitter spark stream initialized in the following way: >> >> val ssc:StreamingContext = >>> SparkLauncher.getSparkSca

How to restart Twitter spark stream

2015-07-18 Thread Zoran Jeremic
Hi, I have a twitter spark stream initialized in the following way: val ssc:StreamingContext = > SparkLauncher.getSparkScalaStreamingContext() > val config = getTwitterConfigurationBuilder.build() > val auth: Option[twitter4j.auth.Authorization] = > Some(

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

2015-07-10 Thread Zoran Jeremic
It looks like there is no problem with Tomcat 8. On Fri, Jul 10, 2015 at 11:12 AM, Zoran Jeremic wrote: > Hi Ted, > > I'm running Tomcat 7 with Java: > > java version "1.8.0_45" > Java(TM) SE Runtime Environment (build 1.8.0_45-b14) > Java HotSpot(TM) 64-B

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

2015-07-10 Thread Zoran Jeremic
t run ? > > Thanks > > > > On Jul 10, 2015, at 10:09 AM, Zoran Jeremic > wrote: > > Hi, > > I've developed maven application that uses mongo-hadoop connector to pull > data from mongodb and process it using Apache spark. The whole process runs > smoothly if

Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

2015-07-10 Thread Zoran Jeremic
Hi, I've developed maven application that uses mongo-hadoop connector to pull data from mongodb and process it using Apache spark. The whole process runs smoothly if I run it on embedded Jetty server. However, if I deploy it to Tomcat server 7, it's always interrupted at the line of code which col