Re: ORC Transaction Table - Spark

Are there any plans to include it in the future releases of Spark ? Regards, Aviral Agarwal On Thu, Aug 24, 2017 at 3:11 PM, Akhil Das wrote: > How are you reading the data? Its clearly saying > *java.lang.NumberFormatException: > For input string: "0645253_0001" * > >

Fwd: ORC Transaction Table - Spark

k.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo( OrcInputFormat.java:998) ... 118 more Any help would be appreciated. Thanks and Regards, Aviral Agarwal

Re: JDBC RDD Timestamp Parsing Issue

This woks. Thanks ! - Aviral Agarwal On Wed, Jun 21, 2017 at 6:07 PM, Eduardo Mello wrote: > You can add "?zeroDateTimeBehavior=convertToNull" to the connection > string. > > On Wed, Jun 21, 2017 at 9:04 AM, Aviral Agarwal > wrote: > >> The exception i

RE: JDBC RDD Timestamp Parsing Issue

The exception is happening in JDBC RDD code where getNext() is called to get the next row. I do not have access to the result set. I am operating on a DataFrame. Thanks and Regards, Aviral Agarwal On Jun 21, 2017 17:19, "Mahesh Sawaiker" wrote: > This has to do with how you are

JDBC RDD Timestamp Parsing Issue

g the rest. Any leads on how that can be done ? Thanks and Regards, Aviral Agarwal

[SparkSQL] Project using NamedExpression

d. Thanks and Regards, Aviral Agarwal

Spark SQL Skip and Log bad records

Hi guys, Is there a way to skip some bad records and log them when using DataFrame API ? Thanks and Regards, Aviral Agarwal

Mismatched datatype in Case statement

yes, which version ? Thanks and Regards, Aviral Agarwal