I have run into this issue (
https://issues.apache.org/jira/browse/SPARK-10251) with kryo on Spark
version 1.4.1.
Just something to be aware of when setting config to 'true'.
Thanks.
--
Jagrut
On Thu, Jan 28, 2016 at 6:32 AM, Jim Lohse
wrote:
> You are only required to add classes to Kryo (com
Thanks. I'm using the REST API to get the status of all jobs run under an
application ID.
/applications/[app-id]/jobs
The other way to use the REST API is:
/applications/[app-id]/jobs/[job-id]
This should be more efficient since it would only return status of a
specific job. However, the job id is
Is there a way to get the Job Id for a query submitted via the Spark Thrift
Server? This would allow checking the status of that specific job via the
History Server.
Currently, I'm getting status of all jobs, and then filtering the results.
Looking for a more efficient approach.
Test environment
Is there a way to get the Job Id for a query submitted via the Spark Thrift
Server? This would allow checking the status of that specific job via the
History Server.
Currently, I'm getting status of all jobs, and then filtering the results.
Looking for a more efficient approach.
Test environment
Is there a way to get the Job Id for a query submitted via the Spark Thrift
Server? This would allow checking the status of that specific job via the
History Server.
Currently, I'm getting status of all jobs, and then filtering the results.
Looking for a more efficient approach.
Test environment
Since version 1.5.0, show(false) on a DataFrame prevents truncation of long
strings in the output. By default, strings more than 20 characters are
truncated.
Example usage:
scala> df.show(false)
--
Jagrut
On Sat, Nov 21, 2015 at 6:24 AM, Fengdong Yu
wrote:
> Hi,
>
> I found if the column valu
