) - Error: Master must start with yarn, spark, mesos, or local please set
the spark.master to either local[*] or yarn-cluster
On Fri, Sep 25, 2015 at 10:45 PM, Xuefu Zhang wrote:
> What's the value of spark.master in your case? The error specifically says
> something wrong with it.
>
> --Xuefu
>
anybody here? can somebody guide me on this?
On Thu, Sep 10, 2015 at 2:36 PM, Jeetendra G
wrote:
> Hi All,
>
> I have JSON data Can I create table without schema? and query that data,
> since all my data os JSON data so I was thinking there should be some way.
>
> Currently I
Hi All,
I have JSON data Can I create table without schema? and query that data,
since all my data os JSON data so I was thinking there should be some way.
Currently I am doing something like below, but I want to remove Schema from
this, because I have i ma having thousand of event type and all o
HI All,
I am trying to rum hive on spark means from Hive terminal setting up
execution engine as spark.
I have copied the hive-default.xml to spark conf directory.
Hive is not able to find the table.giving me error "table_name" not found?
Can you help me with exact steps how to make spark as a e
TE VIEW combined as SELECT field_array FROM(SELECT
> split(inputline,',') as field_array from raw_staging UNION ALL select
> field_array from pared) subq_u;
>
>
>
> Even if possible to mix and match the schema on a per-partition, I
> wouldn't recommend doing so
conclusion.
>
> Thanks,
> Peyman
>
> On Mon, Aug 24, 2015 at 11:22 PM, Jeetendra G
> wrote:
>
>> Hi Peyman
>>
>> I created a new Hive external table with partition column name of 'yr'
>> instead of 'year' pointing to the same base di
r my misunderstanding .. you can though set fileformat at each
> partition level but then you need to entirely redesign your table to have
> staging partition and real data partition
>
> On Tue, Aug 25, 2015 at 11:46 AM, Jeetendra G
> wrote:
>
>> Thanks Nitin for reply.
>>
&
Hi Peyman
I created a new Hive external table with partition column name of 'yr'
instead of 'year' pointing to the same base directory.
if this is a case how come /user/hive/warehouse having the data? it should
not right?
On Tue, Aug 25, 2015 at 4:41 AM, Peyman Mohajerian
wrote:
> Hi Guys,
>
>
nd do the conversion or have the raw file
> in the format you want and load it directly into table
>
> On Tue, Aug 25, 2015 at 11:27 AM, Jeetendra G
> wrote:
>
>> I tried searching how to set multiple format with multiple partitions ,
>> could not find much detail.
&g
fferent file format per partition.
> You can't mix files in the same directory (You could theoretically write
> some kind of custom SerDe).
>
> Daniel.
>
>
>
> On Mon, Aug 24, 2015 at 6:15 PM, Jeetendra G
> wrote:
>
>> Can anyone put some light on this please
Can anyone put some light on this please?
On Mon, Aug 24, 2015 at 12:32 PM, Jeetendra G
wrote:
> HI All,
>
> I have a directory where I have json formatted and parquet files in same
> folder. can hive load these?
>
> I am getting Json data and storing in HDFS. later I
HI All,
I have a directory where I have json formatted and parquet files in same
folder. can hive load these?
I am getting Json data and storing in HDFS. later I am running job to
convert JSon to Parquet(every 15 mins). so we will habe 15 mins Json data.
Can i provide multiple serde in hive?
re
I all I have a folder structure like /housing/events/event1/date=20150820
stored in HDFS.
I wanted to create the partition based on year month and day how can I do
this during creating or loading data time?
Regards
Jeet
13 matches
Mail list logo
