Re: Using Hive table for twitter data

2016-06-09 Thread Gopal Vijayaraghavan
> Any reason why that table in Hive cannot read data in? No idea how you're loading data with flume, but it isn't doing it right. >> PARTITIONED BY (datehour INT) ... >> -rw-r--r-- 2 hduser supergroup 433868 2016-06-09 09:52 >>/twitter_data/FlumeData.1465462333430 No ideas on how to get

Re: Using Hive table for twitter data

2016-06-09 Thread Mich Talebzadeh
thanks Gopal that link 404 - OOPS! Looks like you wandered too far from the herd! LOL Any reason why that table in Hive cannot read data in? cheers Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Using Hive table for twitter data

2016-06-09 Thread Gopal Vijayaraghavan
> Has anyone done recent load of twitter data into Hive table. Not anytime recently, but the twitter corpus was heavily used to demo Hive. Here's the original post on auto-learning schemas from an arbitrary collection of JSON docs (like a MongoDB dump). http://hortonworks.com/blog/discovering-h