Re: A problem of using spark streaming to capture network packets

2015-04-29 Thread Dean Wampler
ing > as root? If not, that might explain the problem. > > From: Dean Wampler > To: Lin Hao Xu/China/IBM@IBMCN > Cc: Hai Shan Wu/China/IBM@IBMCN, user > Date: 2015/04/29 09:40 > Subject: Re: A problem of using spark streaming to capture network packets > --

Re: A problem of using spark streaming to capture network packets

2015-04-28 Thread Lin Hao Xu
/29 09:40 Subject:Re: A problem of using spark streaming to capture network packets Are the tasks on the slaves also running as root? If not, that might explain the problem. dean Dean Wampler, Ph.D. Author: Programming Scala, 2nd EditionĀ (O'Reilly) Typesafe @deanwampler

Re: A problem of using spark streaming to capture network packets

2015-04-28 Thread Lin Hao Xu
hina/IBM@IBMCN Cc: user , Lin Hao Xu/China/IBM@IBMCN Date: 2015/04/28 20:07 Subject: Re: A problem of using spark streaming to capture network packets It's probably not your code. What's the full command line you use to submit the job? Are you sure the job on th

Re: A problem of using spark streaming to capture network packets

2015-04-28 Thread Dean Wampler
full command line you > u]Dean > Wampler ---2015/04/28 20:07:54---It's probably not your code. What's the > full command line you use to submit the job? > > From: Dean Wampler > To: Hai Shan Wu/China/IBM@IBMCN > Cc: user , Lin Hao Xu/China/IBM@IBMCN > Date: 2015/04/2

Re: A problem of using spark streaming to capture network packets

2015-04-28 Thread Lin Hao Xu
Cc: user , Lin Hao Xu/China/IBM@IBMCN Date: 2015/04/28 20:07 Subject:Re: A problem of using spark streaming to capture network packets It's probably not your code. What's the full command line you use to submit the job? Are you sure the job on the cluster

Re: A problem of using spark streaming to capture network packets

2015-04-28 Thread Dean Wampler
It's probably not your code. What's the full command line you use to submit the job? Are you sure the job on the cluster has access to the network interface? Can you test the receiver by itself without Spark? For example, does this line work as expected: List nifs = Pcaps.findAllDevs(); dean D