RE: LINES TERMINATED BY only supports newline '\n' right now

One quick way to solve this is setting textinputformat.record.delimiter=”US” before reading from that text table. But it has some limitations: 1,you cannot read multiple text tables with different line delimiters in the same query. 2,you cannot write to that text table with your own line delim

Re: LINES TERMINATED BY only supports newline '\n' right now

Hi, According to the documentation you should write and set your own Inputformat when creating the table. Mike Sukmanowsky solved a similar problem here, this might help you: http://stackoverflow.com/questions/7692994/custom-inputformat-with-hive Regards, Peter For some of the columns '\n' chara

Re: External partitoned table based on yyyy/mm/dd HDFS structure

/igor/date=20160602 create external table t (i int) partitioned by (mmdd int) location '/user/igor/data/'; Will it work? Also I will need to schedule msck repair table t; if I want partitions automatically picked up. Hive does not have this feature. Correct? What is the optimal directory

Re: Error while running Hive on Microsoft Azure HDInsight Hadoop Linux Cluster

> it gives me the following error "FAILED: ParseException line 24:0 >missing EOF at 'format' near')'". Sounds like a file line ending problem - are you sure the file isn't in a different line ending mode? > -- The following lines describe the format and location of the file You can try removing

Error while running Hive on Microsoft Azure HDInsight Hadoop Linux Cluster

When i try to run the hive command "hive -i flightdelays.hql" for the example "https:// https://azure.microsoft.com/en-in/documentation/articles/hdinsight-analyze-flight-delay-data-linux/ation/articles/hdin " it gives me the following error "FAILED: ParseException line 24:0 missing EOF at 'format'

Re: Spark support for update/delete operations on Hive ORC transactional tables

thanks for that. I will have a look Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 2 June 2016 at 10

Re: Spark support for update/delete operations on Hive ORC transactional tables

Related to this, there exists an API in Hive to simplify the integrations of other frameworks with Hive's ACID feature: See: https://cwiki.apache.org/confluence/display/Hive/HCatalog+Streaming+Mutation+API It contains code for maintaining heartbeats, handling locks and transactions, and submittin

LINES TERMINATED BY only supports newline '\n' right now

For some of the columns '\n' character is there as part of value, i want to create a hive table for this data i tried by creating the hive table with US as the line separator but it showing the below message Ex: CREATE EXTERNAL TABLE IF NOT EXISTS emp (name String,id int) ROW FORMAT DELIMITED FIEL

Spark support for update/delete operations on Hive ORC transactional tables

Hi, Spark does not support transactions because as I understand there is a piece in the execution side that needs to send heartbeats to Hive metastore saying a transaction is still alive". That has not been implemented in Spark yet to my knowledge." Any idea on the timelines when we are going to