-
From: "Ted Yu"
Sent: 20-10-2015 21:30
To: "Amit Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
I need to dig deeper into saveAsHadoopDataset to see what might have caused the
effect you observed.
Cheers
On Tue, Oct 20, 201
Request to share if you come across any hint
-Original Message-
From: "Ted Yu"
Sent: 20-10-2015 21:30
To: "Amit Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
I need to dig deeper into saveAsHadoopDataset to see what mig
15 20:38
> To: Ted Yu
> Cc: user
> Subject: RE: Spark opening to many connection with zookeeper
>
> I used that also but the number of connection goes on increasing started
> frm 10 and went till 299
> Than I changed my zookeeper conf to set max client connection to just 30
> a
storehadoopdataset method?
-Original Message-
From: "Amit Hora"
Sent: 20-10-2015 20:38
To: "Ted Yu"
Cc: "user"
Subject: RE: Spark opening to many connection with zookeeper
I used that also but the number of connection goes on increasing started frm 10
and we
-Original Message-
From: "Ted Yu"
Sent: 20-10-2015 20:19
To: "Amit Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
Can you take a look at example 37 on page 225 of:
http://hbase.apache.org/apache_hbase_reference_guide.pdf
Yo
wrote:
> One region
> --
> From: Ted Yu
> Sent: 20-10-2015 15:01
> To: Amit Singh Hora
> Cc: user
> Subject: Re: Spark opening to many connection with zookeeper
>
> How many regions do your table have ?
>
> Which hbase release d
One region
-Original Message-
From: "Ted Yu"
Sent: 20-10-2015 15:01
To: "Amit Singh Hora"
Cc: "user"
Subject: Re: Spark opening to many connection with zookeeper
How many regions do your table have ?
Which hbase release do you use ?
Cheers
On
t converts the json to Put
> objects of HBase
>
> After i killed the application/driver the number of connection decreased
> drastically
>
> Kindly help in understanding and resolving the issue
>
>
>
> --
> View this message in context:
> http://apache-spark-
the json to Put
objects of HBase
After i killed the application/driver the number of connection decreased
drastically
Kindly help in understanding and resolving the issue
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-opening-to-many-connection-with-zooke
