ssage-
From: "Amit Hora"
Sent: 4/13/2016 11:41 AM
To: "Jörn Franke"
Cc: "user@spark.apache.org"
Subject: RE: Unable to Access files in Hadoop HA enabled from using Spark
There are DNS entries for both of my namenode
Ambarimaster is standby and it resolves to ip per
There are DNS entries for both of my namenode
Ambarimaster is standby and it resolves to ip perfectly
Hdp231 is active and it also resolves to ip
Hdpha is my Hadoop HA cluster name
And hdfs-site.xml has entries related to these configuration
-Original Message-
From: "Jörn Franke"
Sent: 4
Thanks for sharing the link.Yes I understand that accumulators and broadcast
variables state are not recovered from checkpoint but is there any way by which
I can say that the HBaseContext in this context should nt be recovered from
checkpoint rather must be reinitialized
-Original Message
-
From: "Ted Yu"
Sent: 20-10-2015 21:30
To: "Amit Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
I need to dig deeper into saveAsHadoopDataset to see what might have caused the
effect you observed.
Cheers
On Tue, Oct 20, 201
Request to share if you come across any hint
-Original Message-
From: "Ted Yu"
Sent: 20-10-2015 21:30
To: "Amit Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
I need to dig deeper into saveAsHadoopDataset to see what mig
storehadoopdataset method?
-Original Message-
From: "Amit Hora"
Sent: 20-10-2015 20:38
To: "Ted Yu"
Cc: "user"
Subject: RE: Spark opening to many connection with zookeeper
I used that also but the number of connection goes on increasing started frm 10
and we
-Original Message-
From: "Ted Yu"
Sent: 20-10-2015 20:19
To: "Amit Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
Can you take a look at example 37 on page 225 of:
http://hbase.apache.org/apache_hbase_reference_guide.pdf
Yo
One region
-Original Message-
From: "Ted Yu"
Sent: 20-10-2015 15:01
To: "Amit Singh Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
How many regions do your table have ?
Which hbase release do you use ?
Cheers
On Tue, Oct 20, 2015 at 12:32 AM, Am
Hi,
Regresta for delayed resoonse
please find below full stack trace
ava.lang.ClassCastException: scala.runtime.BoxedUnit cannot be cast to
org.apache.hadoop.hbase.client.Mutation
at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:85)
at
