Run STA/LTA python function using spark streaming: java.lang.IllegalArgumentException: requirement failed: No output operations registered, so nothing to execute

Hello, I'm trying to run the sta/lta python code which I got it from obspy website using spark streaming and plot the events but I keep getting the following error! "java.lang.IllegalArgumentException: requirement failed: No output operations registered, so nothing to execute" H

Fwd: Spark streaming app that processes Kafka DStreams produces no output and no error

-- Forwarded message -- From: Shixiong(Ryan) Zhu Date: Fri, Jan 20, 2017 at 12:06 PM Subject: Re: Spark streaming app that processes Kafka DStreams produces no output and no error To: shyla deshpande That's how KafkaConsumer works right now. It will retry forever for ne

Re: Spark streaming app that processes Kafka DStreams produces no output and no error

; >> Can I run a spark streaming job with just 2 cores? >> >> Appreciate your time and help. >> >> Thanks >> >> >> >> >> >> On Fri, Jan 13, 2017 at 10:46 PM, shyla deshpande < >> deshpandesh...@gmail.com> wrote: >> &

Re: Spark streaming app that processes Kafka DStreams produces no output and no error

;> Hello, >> >> My spark streaming app that reads kafka topics and prints the DStream >> works fine on my laptop, but on AWS cluster it produces no output and no >> errors. >> >> Please help me debug. >> >> I am using Spark 2.0.2 and kafka-0-10 >> >

Re: Spark streaming app that processes Kafka DStreams produces no output and no error

g job with just 2 cores? Appreciate your time and help. Thanks On Fri, Jan 13, 2017 at 10:46 PM, shyla deshpande wrote: > Hello, > > My spark streaming app that reads kafka topics and prints the DStream > works fine on my laptop, but on AWS cluster it produces no output and no >

Spark streaming app that processes Kafka DStreams produces no output and no error

Hello, My spark streaming app that reads kafka topics and prints the DStream works fine on my laptop, but on AWS cluster it produces no output and no errors. Please help me debug. I am using Spark 2.0.2 and kafka-0-10 Thanks The following is the output of the spark streaming app... 17/01/14

Re: spark-submit stuck and no output in console

Our hadoop NFS Gateway seems to be malfunctioning. I basically restart it. Now spark jobs have resumed successfully. Problem solved.

Re: spark-submit stuck and no output in console

cluster. On Nov 17, 2015 4:16 PM, "Kayode Odeyemi" wrote: > Sonal, SparkPi couldn't run as well. Stuck to the screen with no output > > hadoop-user@yks-hadoop-m01:/usr/local/spark$ ./bin/run-example SparkPi > > On Tue, Nov 17, 2015 at 12:22 PM, Steve Loughran > wro

Re: spark-submit stuck and no output in console

Sonal, SparkPi couldn't run as well. Stuck to the screen with no output hadoop-user@yks-hadoop-m01:/usr/local/spark$ ./bin/run-example SparkPi On Tue, Nov 17, 2015 at 12:22 PM, Steve Loughran wrote: > 48 hours is one of those kerberos warning times (as is 24h, 72h and 7 > days)

Re: spark-submit stuck and no output in console

On 17 Nov 2015, at 09:54, Kayode Odeyemi mailto:drey...@gmail.com>> wrote: Initially, I submitted 2 jobs to the YARN cluster which was running for 2 days and suddenly stops. Nothing in the logs shows the root cause. 48 hours is one of those kerberos warning times (as is 24h, 72h and 7 days) ..

Re: spark-submit stuck and no output in console

How did the example spark jobs go? SparkPI etc..? Best Regards, Sonal Founder, Nube Technologies Reifier at Strata Hadoop World Reifier at Spark Summit 2015

Re: spark-submit stuck and no output in console

Thanks for the reply Sonal. I'm on JDK 7 (/usr/lib/jvm/java-7-oracle) My env is a YARN cluster made of 7 nodes (6 datanodes/ node manager, 1 namenode/resource manager). On the namenode, is where I executed the spark-submit job while on one of the datanodes, I executed 'hadoop fs -put /binstore

Re: spark-submit stuck and no output in console

Could it be jdk related ? Which version are you on? Best Regards, Sonal Founder, Nube Technologies Reifier at Strata Hadoop World Reifier at Spark Summit 2015

Re: spark-submit stuck and no output in console

Anyone experienced this issue as well? On Mon, Nov 16, 2015 at 8:06 PM, Kayode Odeyemi wrote: > > Or are you saying that the Java process never even starts? > > > Exactly. > > Here's what I got back from jstack as expected: > > hadoop-user@yks-hadoop-m01:/usr/local/spark/bin$ jstack 31316 > 3131

Re: spark-submit stuck and no output in console

> Or are you saying that the Java process never even starts? Exactly. Here's what I got back from jstack as expected: hadoop-user@yks-hadoop-m01:/usr/local/spark/bin$ jstack 31316 31316: Unable to open socket file: target process not responding or HotSpot VM not loaded The -F option can be used

Re: spark-submit stuck and no output in console

He means for you to use jstack to obtain a stacktrace of all of the threads. Or are you saying that the Java process never even starts? On Mon, Nov 16, 2015 at 7:48 AM, Kayode Odeyemi wrote: > Spark 1.5.1 > > The fact is that there's no stack trace. No output from that command a

Re: spark-submit stuck and no output in console

Spark 1.5.1 The fact is that there's no stack trace. No output from that command at all to the console. This is all I get: hadoop-user@yks-hadoop-m01:/usr/local/spark/bin$ tail -1 /tmp/spark-profile-job.log nohup: ignoring input /usr/local/spark/bin/spark-class: line 76: 29516 K

Re: spark-submit stuck and no output in console

Which release of Spark are you using ? Can you take stack trace and pastebin it ? Thanks On Mon, Nov 16, 2015 at 5:50 AM, Kayode Odeyemi wrote: > ./spark-submit --class com.migration.UpdateProfiles --executor-memory 8g > ~/migration-profiles-0.1-SNAPSHOT.jar > > is stuck and outputs nothing to

spark-submit stuck and no output in console

./spark-submit --class com.migration.UpdateProfiles --executor-memory 8g ~/migration-profiles-0.1-SNAPSHOT.jar is stuck and outputs nothing to the console. What could be the cause of this? Current max heap size is 1.75g and it's only using 1g.

Re: spark no output

s > > On Sun, Aug 2, 2015 at 7:04 AM, Pa Rö > wrote: > >> hi community, >> >> i have run my k-means spark application on 1million data points. the >> program works, but no output in the hdfs is generated. when it runs on >> 10.000 points, a output is written. >> >> maybe someone has an idea? >> >> best regards, >> paul >> > >

Re: spark no output

ta points. the > program works, but no output in the hdfs is generated. when it runs on > 10.000 points, a output is written. > > maybe someone has an idea? > > best regards, > paul >

spark no output

hi community, i have run my k-means spark application on 1million data points. the program works, but no output in the hdfs is generated. when it runs on 10.000 points, a output is written. maybe someone has an idea? best regards, paul

Re: Re: spark streaming printing no output

rom another console.) >>> >>> -- >>> bit1...@163.com >>> >>> >>> *From:* Shushant Arora >>> *Date:* 2015-04-15 17:11 >>> *To:* Akhil Das >>> *CC:* user@spark.apache.org >>> *Subject:* Re

Re: Re: spark streaming printing no output

gt;> typed on this port from another console.) >> >> -- >> bit1...@163.com >> >> >> *From:* Shushant Arora >> *Date:* 2015-04-15 17:11 >> *To:* Akhil Das >> *CC:* user@spark.apache.org >> *Subject:* Re: spark streaming printing no output >&g

Re: Re: spark streaming printing no output

user@spark.apache.org > *Subject:* Re: spark streaming printing no output > When I launched spark-shell using, spark-shell ---master local[2]. > Same behaviour, no output on console but only timestamps. > > When I did, lines.saveAsTextFiles("hdfslocation",suffix); > I ge

Re: Re: spark streaming printing no output

Looks the message is consumed by the another console?( can see messages typed on this port from another console.) bit1...@163.com From: Shushant Arora Date: 2015-04-15 17:11 To: Akhil Das CC: user@spark.apache.org Subject: Re: spark streaming printing no output When I launched spark-shell

Re: spark streaming printing no output

When I launched spark-shell using, spark-shell ---master local[2]. Same behaviour, no output on console but only timestamps. When I did, lines.saveAsTextFiles("hdfslocation",suffix); I get empty files of 0 bytes on hdfs On Wed, Apr 15, 2015 at 12:46 PM, Akhil Das wrote: > Just

Re: spark streaming printing no output

Just make sure you have atleast 2 cores available for processing. You can try launching it in local[2] and make sure its working fine. Thanks Best Regards On Tue, Apr 14, 2015 at 11:41 PM, Shushant Arora wrote: > Hi > > I am running a spark streaming application but on console nothing is > gett

Re: spark streaming printing no output

0 ms strings gets printed on console. > No output is getting printed. > And timeinterval between two strings of form ( time:ms)is very less > than Streaming Duration set in program. > > On Wed, Apr 15, 2015 at 5:11 AM, Shixiong Zhu wrote: > >> Could you s

Re: spark streaming printing no output

Yes only Time: 142905487 ms strings gets printed on console. No output is getting printed. And timeinterval between two strings of form ( time:ms)is very less than Streaming Duration set in program. On Wed, Apr 15, 2015 at 5:11 AM, Shixiong Zhu wrote: > Could you see something l

Re: spark streaming printing no output

Could you see something like this in the console? --- Time: 142905487 ms --- Best Regards, Shixiong(Ryan) Zhu 2015-04-15 2:11 GMT+08:00 Shushant Arora : > Hi > > I am running a spark streaming application but o

spark streaming printing no output

Hi I am running a spark streaming application but on console nothing is getting printed. I am doing 1.bin/spark-shell --master clusterMgrUrl 2.import org.apache.spark.streaming.StreamingContext import org.apache.spark.streaming.StreamingContext._ import org.apache.spark.streaming.dstream.DStream

Re: No Output

7, 2015 at 2:40 PM, Deep Pradhan >> > wrote: >>> >>>> Hi, >>>> I am using Spark-1.0.0 in a single node cluster. When I run a job with >>>> small data set it runs perfectly but when I use a data set of 350 KB, no >>>> output is being produced and when I try to run it the second time it is >>>> giving me an exception telling that SparkContext was shut down. >>>> Can anyone help me on this? >>>> >>>> Thank You >>>> >>> >>> >> >

Re: No Output

5 at 2:40 PM, Deep Pradhan >> wrote: >> >>> Hi, >>> I am using Spark-1.0.0 in a single node cluster. When I run a job with >>> small data set it runs perfectly but when I use a data set of 350 KB, no >>> output is being produced and when I try to ru

Re: No Output

n 17, 2015 at 2:40 PM, Deep Pradhan > wrote: > >> Hi, >> I am using Spark-1.0.0 in a single node cluster. When I run a job with >> small data set it runs perfectly but when I use a data set of 350 KB, no >> output is being produced and when I try to run it the second t

Re: No Output

of 350 KB, no > output is being produced and when I try to run it the second time it is > giving me an exception telling that SparkContext was shut down. > Can anyone help me on this? > > Thank You >

No Output

Hi, I am using Spark-1.0.0 in a single node cluster. When I run a job with small data set it runs perfectly but when I use a data set of 350 KB, no output is being produced and when I try to run it the second time it is giving me an exception telling that SparkContext was shut down. Can anyone