Re: Serde moved? version 2.3.0

thanks guys for the clarification. i'll work on perhaps finding the source code and re-implementing if i can. good to know. On Wed, Oct 25, 2017 at 6:32 PM, Owen O'Malley wrote: > I considered that, but it won't work. > > The Hive 2.2 code looks like: > > public interface SerDe { ... } > pub

Re: Serde moved? version 2.3.0

I considered that, but it won't work. The Hive 2.2 code looks like: public interface SerDe { ... } public abstract class AbstractSerDe implements SerDe { ... } ... a lot of code using SerDe ... The Hive 2.3 code looks like: public abstract class AbstractSerDe { } ... a lot of code using

Re: Serde moved? version 2.3.0

Perhaps a fourth option is a “bridge” JAR, to implement the original class by subclassing AbstractSerDe, unless the API has changed such that such a mapping cannot be done. Regards, Matt > On Oct 25, 2017, at 7:31 PM, Owen O'Malley wrote: > > >> On Wed, Oct 25, 2017 at 3:20 PM, Stephen Spra

Re: Serde moved? version 2.3.0

On Wed, Oct 25, 2017 at 3:20 PM, Stephen Sprague wrote: > i see. interesting. i think this breaks a ton of opensource Serde's we've > all downloaded off the internet and have been using for years. openx json > serde and ibm xml serde come to mind. does this change render all these > incompatibl

Fwd: Serde moved? version 2.3.0

i see. interesting. i think this breaks a ton of opensource Serde's we've all downloaded off the internet and have been using for years. openx json serde and ibm xml serde come to mind. does this change render all these incompatible now with 2.3.0? I mean all i done in the past is download the j

Re: Serde moved? version 2.3.0

SerDe was removed by https://issues.apache.org/jira/browse/HIVE-15167 You should use AbstractSerDe instead. .. Owen > On Oct 25, 2017, at 2:18 PM, Stephen Sprague wrote: > > hey guys, > > could be a dumb question but not being a java type of

Serde moved? version 2.3.0

hey guys, could be a dumb question but not being a java type of guy i'm not quite sure about it. I'm upgrading from 2.1.0 to 2.3.0 and encountering this error: class not found: org/apache/hadoop/hive/serde2/SerDe so in hive 2.1.0 i see it in this jar: * hive-serde-2.1.0.jar org/apache/hadoop/hi

Re: HIVE ORC table returns NULLs ( EMR 5.9 Hive 2.3.0 )

Thanks, Owen. I tried to run from hdfs (not from s3) the problem is the same. May you please share your hive-site.xml? What env variables, parameters should I check? I would use structor with pleasure, but I need to use EMR for this project. Thanks Oleg On Thu, Oct 26, 2017 at 12:22 AM, Owen O

Re: HIVE ORC table returns NULLs ( EMR 5.9 Hive 2.3.0 )

I'm not sure. Using a virtual environment with Hortonwork's version (2.6.1) and hdfs instead of s3 it works: hive> CREATE EXTERNAL TABLE Table1 (Id INT, Name STRING) STORED AS ORC > LOCATION 'hdfs://nn.example.com/user/vagrant/country/'; > OK > Time taken: 4.073 seconds > hive> Select * from Table

[ANNOUNCE] Apache Hive 2.3.1 Released

The Apache Hive team is proud to announce the release of Apache Hive version 2.3.1. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides, among others: * Tools to enable easy

Re: HIVE ORC table returns NULLs ( EMR 5.9 Hive 2.3.0 )

Yes, It is exactly my point. Since the file has the data (orc is valid), why hive returns NULLs? I tested it s3 , hdfs , hive , beeline. the behavior is the same: select count (*) returns 10. select * returns NULLs ... What is the way to debug this problem? Any configuration, logging. I