You should be doing something like this:
data = sc.textFile('file:///path1/path/test1.csv')
header = data.first() #extract header
#print header
data = data.filter(lambda x:x !=header)
#print data
Hope it helps.
Sincerely,
Abhishek
+91-7259028700
From: nihed mbarek [mailto:nihe...@gmail.com]
Sen
Hello All,
If someone has any leads on this please help me.
Sincerely,
Abhishek
From: Mishra, Abhishek
Sent: Wednesday, February 24, 2016 5:11 PM
To: user@spark.apache.org
Subject: LDA topic Modeling spark + python
Hello All,
I am doing a LDA model, please guide me with something.
I
Hello All,
I am doing a LDA model, please guide me with something.
I have a csv file which has two column "user_id" and "status". I have to
generate a word-topic distribution after aggregating the user_id. Meaning to
say I need to model it for users on their grouped status. The topic leng
Hello All,
I am new to spark and python, here is my doubt, please suggest...
I have a csv file which has 2 column "user_id" and "status".
I have read it into a rdd and then removed the header of the csv file. Then I
split the record by "," (comma) and generate pair rdd. On that rdd I
groupByKe
...@gmail.com [mailto:ndj...@gmail.com]
Sent: Monday, February 22, 2016 7:31 PM
To: Sainath Palla
Cc: Mishra, Abhishek; user@spark.apache.org
Subject: Re: Sample project on Image Processing
Hi folks,
KeystoneML has some image processing features:
http://keystone-ml.org/examples.html
Cheers,
Ardo
Hello,
I am working on image processing samples. Was wondering if anyone has worked on
Image processing project in spark. Please let me know if any sample project or
example is available.
Please guide in this.
Sincerely,
Abhishek
.
Abhishek
From: Corey Nolet [mailto:cjno...@gmail.com]
Sent: Friday, September 11, 2015 7:58 PM
To: Sandeep Giri
Cc: Mishra, Abhishek; user@spark.apache.org; d...@spark.apache.org
Subject: Re: MongoDB and Spark
Unfortunately, MongoDB does not directly expose its locality via its client API
so the
Anything using Spark RDD’s ???
Abhishek
From: Sandeep Giri [mailto:sand...@knowbigdata.com]
Sent: Friday, September 11, 2015 3:19 PM
To: Mishra, Abhishek; user@spark.apache.org; d...@spark.apache.org
Subject: Re: MongoDB and Spark
use map-reduce.
On Fri, Sep 11, 2015, 14:32 Mishra, Abhishek
Hello ,
Is there any way to query multiple collections from mongodb using spark and
java. And i want to create only one Configuration Object. Please help if
anyone has something regarding this.
Thank You
Abhishek
, 2015 8:22 PM
To: Mishra, Abhishek
Cc: User
Subject: Re: Spark Interview Questions
Hi Abhishek,
Please learn spark ,there are no shortcuts for sucess.
Regards,
Vaquar khan
On 29 Jul 2015 11:32, "Mishra, Abhishek"
mailto:abhishek.mis...@xerox.com>> wrote:
Hello,
Please help
Hello,
Please help me with links or some document for Apache Spark interview questions
and answers. Also for the tools related to it ,for which questions could be
asked.
Thanking you all.
Sincerely,
Abhishek
-
To unsubscribe,
I got it upright Matei,
Thank you. I was giving wrong directory path. Thank you...!!
Thanks,
Abhishek Mishra
-Original Message-
From: Mishra, Abhishek [mailto:abhishek.mis...@xerox.com]
Sent: Wednesday, August 27, 2014 4:38 PM
To: Matei Zaharia
Cc: user@spark.apache.org
Subject: RE
, I am unable to debug the same. Please guide me.
Thanks,
Abhishek
-Original Message-
From: Matei Zaharia [mailto:matei.zaha...@gmail.com]
Sent: Saturday, August 23, 2014 9:47 AM
To: Mishra, Abhishek
Cc: user@spark.apache.org
Subject: Re: Installation On Windows machine
You should be
Hello Team,
I was just trying to install spark on my windows server 2012 machine and use it
in my project; but unfortunately I do not find any documentation for the same.
Please let me know if we have drafted anything for spark users on Windows. I am
really in need of it as we are using Windows
14 matches
Mail list logo
