would be good if you can share with him.
Any help really appreciated.
thanks much again
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jul 1, 2016 at 2:06 PM, Markovitz, Dudu
wrote:
> My pleasure.
>
>
>
> Just to make clear –
>
> The version with the non-consecuti
Thanks, really appreciate.
I will try this. will respond with results.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jul 1, 2016 at 6:50 AM, Markovitz, Dudu
wrote:
> 3.
>
> This is a working code for consecutive values.
>
> MyColumn should be a column (or list of col
ror while compiling statement: FAILED: SemanticException End of a
> WindowFrame cannot be UNBOUNDED PRECEDING (state=42000,code=40000)
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue, Jun 28, 2016 at 6:16 PM, @Sanjiv Singh
wrote:
> thanks a lot.
> let me give it a try.
>
&g
thanks a lot.
let me give it a try.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue, Jun 28, 2016 at 5:32 PM, Markovitz, Dudu
wrote:
> There’s a distributed algorithm for windows function that is based on the
> ORDER BY clause rather than the PARTITION BY clause.
>
> I
ETL_ROW_ID is to be consecutive number. I need to check if having unique
number would not break any logic.
Considering unique number for ETL_ROW_ID column, what are optimum options
available?
What id it has to be consecutive number only?
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue
Hi Dudu,
You are correct ...ROW_NUMBER() is main culprit.
ROW_NUMBER() OVER Not Fast Enough With Large Result Set, any good solution?
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue, Jun 28, 2016 at 3:42 PM, Markovitz, Dudu
wrote:
> The row_number operation seems to be ske
/hive/warehouse/PRD_DB.db/INTER_ETL/12_0 |
| -rwxrwxrwx 3 Z56034 hdfs 1970930771 2016-06-28 10:24
/apps/hive/warehouse/PRD_DB.db/INTER_ETL/13_0 |
| -rwxrwxrwx 3 Z56034 hdfs 192820628 2016-06-28 10:23
/apps/hive/warehouse/PRD_DB.db/INTER_ETL/14_0 |
++--+
'numFiles'='15',
'numRows'='108363614',
Regards
Sanjiv Singh
Mob : +091 9990-447-339
enabled with two workers. why compaction
not happened ? will check metastore logs.
I have too many ACID tables on hive and how many worker should be
configured ? currently it is 2.
Thanks a lot once again.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jun 24, 2016 at 9:14 PM, @Sanjiv Singh
Thanks Gopal for your inputs. Let me run compaction explicitly on table
then see how query works.
Let
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jun 24, 2016 at 7:53 PM, Gopal Vijayaraghavan
wrote:
>
> > Yes for this tables, ACID enabled. it has only 256 files
+
257 rows selected (0.065 seconds)
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jun 24, 2016 at 6:16 PM, Gopal Vijayaraghavan
wrote:
>
>
> > Please help me on thislet me know you need other info.
>
> Are the ORC tables fully compacted? Looks like you're running a v
Hi Vijay,
Please help me on thislet me know you need other info.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Thu, Jun 23, 2016 at 12:41 PM, @Sanjiv Singh
wrote:
> Hi Gopal,
>
> I am using Tez as execution engine
Hi Mich,
I tried the same without any luck. I don't see any improvement.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Thu, Jun 23, 2016 at 5:38 PM, @Sanjiv Singh
wrote:
> Thanks Mich. for your inputs.
>
> Let me try that as well. Will post response.
>
>
>
Thanks Mich. for your inputs.
Let me try that as well. Will post response.
420 1361
> 16 8497624 1361
> 16 8987980 1361
> 16 8234751 1361
> 16 8389490 1361
> 18 9975575 1361
> 16 8026536 1361
> 16 8790618 1361
> 16 9846791 1361
> 16 8363833 1361
> 16 9025525 1361
> 16 9241297 1361
> 16 8712487 1361
> 16 8692003 1361
> 16 9316523 1361
|
+---+---+---+--+
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Thu, Jun 23, 2016 at 12:47 PM, Mich Talebzadeh wrote:
> Do you also have the output from
>
> desc formatted tuning_dd_key
>
> and send the output please?
>
> Dr Mich Talebzadeh
>
&
|
|ACID table:true
|
|alias:tuning_dd_key
|
|Statistics:Num rows: 6357592675 Data size:
54076899328 Basic stats: COMPLETE Colum
t_ev_st_dt ) IS NULL OR a_z_key <> LAG( a_z_key , 1 , -999 )
> OVER ( PARTITION BY m_d_key , sb_gu_key ORDER BY t_ev_st_dt ) THEN 'S'
> ELSE NULL END AS ST_FLAG
> FROM `PRDDB`.tuning_dd_key ;
*More info :*
number of distinct value in column m_d_key : 29
> num
Thanks Marcin, I worked I uncompressed file and then loaded file in
hive table.
Now its been quick, few mins.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Jun 22, 2016 at 7:44 AM, Jörn Franke wrote:
>
>
> Marcin is correct : either split up the gzip files in smaller
ving ORC table load.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Hi All,
We are using for Spark SQL :
- Hive :1.2.1
- Spark : 1.3.1
- Hadoop :2.7.1
Let me know if needs other details to debug the issue.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Sun, Mar 13, 2016 at 1:07 AM, Mich Talebzadeh
wrote:
> Hi,
>
> Thanks for the inp
ive> insert into foo values(20);
scala> sqlContext.table("default.foo").count* // Gives 2 , no compaction
required.*
Regards
Sanjiv Singh
Mob : +091 9990-447-339
after compaction, Spark SQL
start recognizing delta files.
Let know me if needed other details to get root cause.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue, Feb 23, 2016 at 2:28 PM, Varadharajan Mukundan wrote:
> That's interesting. I'm not sure why first compaction is neede
e data is still in delta files
Now run major compaction:
hive> ALTER TABLE default.foo COMPACT 'MAJOR';
scala> sqlContext.table("default.foo").count // Gives 1
hive> insert into foo values(20);
scala> sqlContext.table("default.foo").count* // Gives 2
unt(*) from mytable ;
+--+
| _c0 |
+--+
| 44 |
+--+
1 row selected (1.196 seconds)
*HIVE JDBC :*
1: jdbc:hive2://myhost:1> select count(*) from mytable ;
+--+--+
| _c0 |
+--+--+
| 44 |
+--+--+
1 row selected (0.121 seconds)
Regards
Sanjiv Singh
Mob : +091 9
db.db/mytable/delta_086_086
drwxr-xr-x - root hdfs 0 2016-02-23 11:41
/apps/hive/warehouse/mydb.db/mytable/delta_087_087
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Feb 22, 2016 at 1:38 PM, Varadharajan Mukundan wrote:
> Actually the auto compaction if enabled is
Documentation is upset sometimes.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Feb 22, 2016 at 9:49 AM, Varadharajan Mukundan wrote:
> Yes, I was burned down by this issue couple of weeks back. This also means
> that after every insert job, compaction should be run to access ne
#x27;root',
'last_modified_time'='1455859079',
'numFiles'='37',
'numRows'='3',
'rawDataSize'='0',
'totalSize'='11383',
'transactional'='true',
'tran
is working on plain Apache setup.
Let me know if needs other details.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
My case is very opposite to below JIRAs as in my case , using subquery
giving correct result ...but using original table giving mismatched column
value.
https://issues.apache.org/jira/browse/HIVE-9613
https://issues.apache.org/jira/browse/HIVE-9327
Regards
Sanjiv Singh
Mob : +091 9990-447
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:720)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
at
org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:644)
at
org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genUniqueJoinObject(CommonJoinOperator.java:657)
at
org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genUniqueJoinObject(CommonJoinOperator.java:660)
at
org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:756)
at
org.apache.hadoop.hive.ql.exec.MapJoinOperator.process(MapJoinOperator.java:414)
... 13 more
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Adding to that
Surprisingly it is giving correct result if i use derived tables rather
than original tables;
changes query :
*select *from ( select * from T1 ) aLEFT OUTER JOIN ( select * from T2) bON
a.t1c2 = b.t2c1;*
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Jan 11
Any help on this ?
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Sat, Jan 9, 2016 at 3:42 PM, @Sanjiv Singh
wrote:
> Hi All,
>
> I am facing strange behaviour as explained below. I have tow hive table
> T1 and T2 , joined with LEFT OUTER JOIN ..I am getting strange val
t get same result
on hive.
Can you please help me on this to identify this issue and get query working
on hive with same result set.
Let me know you need other details.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
401435
4400466
4401425
4400416
5 51
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Nov 30, 2015 at 1:16 PM, Amrit Jangid
wrote:
> ??
>
> On Mon, Nov 30, 2015 at 11:56 AM, Roshini Johri
> wrote:
>
>> [image: Inline image 2]
>>
>> Roshini Johri
>>
>> [image: Inli
Congrats Ashutosh !!!
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Thu, Sep 17, 2015 at 1:09 AM, Carl Steinbach wrote:
> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hiv
ate_dim.d_current_year
*2452538KDMGFCAA2002-09-201232 5360412
20025920320024125360Friday N
2002Q3NY2452761245251924524472452173NN
NNN*
2431208IOIBFCAA 1944-04-27531 2313178
19444 427219441782313Thursday N
1944Q2NN2431272243118224311172430842NN
NNN
2456494OKLHFCAA 2013-07-2013625925455
2013 6720320134555925Saturday N
2013Q3NY2456655245647524564032456129NN
NNN
2481780EHONFCAA 2082-10-1221939537732
20821101242082732 9537Monday N
2082Q4NN2482041248176924816882481415NN
NNN
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Nitin,
Following setting already there at HIVE.
set hive.exec.mode.local.auto=false;
Surprisingly , when it did following setting , it started working
set hive.auto.convert.join=true;
can you please help me understand , what had happened ?
Regards
Sanjiv Singh
Mob : +091 9990-447-339
lect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Regards
Sanjiv Singh
Mob : +091 9990-447-339
What is the type of employee.id ? it is integer , then change insert
statement to :
insert overwrite table employee_incr select employee.id,employee.ename,if(
employee.id= 1 ,12,employee.id ) as employee.id from employee;
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jul 24, 2015 at 11
What about this :
create view foo_copy_partition AS select * from foo where id in (1,2,3);
export table foo_copy_partition to ‘path’;
drop view foo_copy_partition ;
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jun 26, 2015 at 7:40 AM, Xuefu Zhang wrote:
> Hi Brian,
>
&g
lid syntax, refer doc :
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Create/Drop/TruncateTable
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue, Jun 2, 2015 at 7:09 PM, Prem Yadav wrote:
> I believe there is support for primary key which is basic
Hi Buntu,
Hive config to provide zookeeper quorum for the HBase cluster
--hiveconf hbase.zookeeper.quorum=##
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Jun 12, 2015 at 10:04 PM, Buntu Dev wrote:
> Thanks Nick for the write up. It was quite helpful for a newbie like
Or
You can wrrite UDF to avail LEFT function in Hive.
Follow :
http://snowplowanalytics.com/blog/2013/02/08/writing-hive-udfs-and-serdes/
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Tue, Jun 16, 2015 at 3:13 PM, Nitin Pawar
wrote:
> try using substr function
>
> On Tue, Jun 16
+ Dev
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Jun 17, 2015 at 6:42 AM, wangzhenhua (G)
wrote:
> Hi all,
>
> I'm reading the source code of Hive cbo (CalcaitePlanner), but I find it
> hard to follow.
> Listed below are some of the questions:
> 1. What
+ Dev
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Jun 17, 2015 at 7:46 PM, Hemanth Meka
wrote:
> Hi,
>
>
> I can see that two new counters have been added for hive
> (RECORDS_IN/RECORDS_OUT) in hive 0.14.
>
>
> Prior to this release which counters
Hi Ibrar
What is the value given for
--hiveconf *hbase.master*=#
OR
--hiveconf *hbase.zookeeper.quorum*=
It seems from the error that HBase Server configuration are not correct.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Jun 17, 2015 at 4:31 PM, Ibrar Ahmed
ob Submission failed with exception 'java.lang.NullPointerException(null)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.mr.MapRedTask
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Also.
Refer section "*Allowed Implicit Conversions*" on
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types
It had given a try on joining tables on STRING and INT column , it should
work through implicit conversions.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
???
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Apr 27, 2015 at 11:30 AM, Fun <401299...@qq.com> wrote:
> Get HIVE INFO & FAQ
.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at
org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:120)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at
org.apache.hado
Congratulations !!!
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Apr 15, 2015 at 11:47 PM, Sergey Shelukhin
wrote:
> Congrats!
>
> From: , Cheng A
> Reply-To: "user@hive.apache.org"
> Date: Tuesday, April 14, 2015 at 18:03
> To: "user@hive.ap
ble in HIVE , but with different syntax
i.e. *fact_1_id, fact_2_id WITH CUBE *. but form documentation,
GROUPING() is not available in HIVE.
Please help me if GROUPING() function is available in HIVE.
or
How can I make query running on HIVE?
Regards
Sanjiv Singh
Mob : +091 9990-447-339
.
- SHOW LOCKS ;
Regards,
Sanjiv Singh
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Apr 8, 2015 at 2:39 AM, Mich Talebzadeh wrote:
> Hi,
>
>
>
> Today I have noticed the following issue.
>
>
>
> A simple insert into a table is sting there throwing the followin
Not sure ..It should work
Try adding below configuration and then check..
hive.in.test
true
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Apr 6, 2015 at 7:21 PM, Mich Talebzadeh wrote:
> Hi,
>
>
>
> I turned on concurrency for hive for DML with settings in h
things and
achieve the same in hive.
On Apr 5, 2015 3:55 PM, "@Sanjiv Singh" wrote:
> -- create table lhs
>
> create table lhs (
> subject_id int,
> date_time BIGINT
> );
>
> -- insert some records in table lhs , named insertion will not work
> in case o
time and subject_id = lhs.subject_id ) rhs1 ON true;
>
>—results:
>subject_id;date_time;val_sum;ecnt
>1;1000;1;1
>1;1100;6;3
>1;2000;10;4
>2;1002;60;3
>2;1998;60;3
>
>
>
--
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Available in build 1.1.0
<https://issues.apache.org/jira/browse/HIVE/fixforversion/12329363>
JIRA : https://issues.apache.org/jira/browse/HIVE-3405
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Apr 1, 2015 at 6:24 PM, vivek veeramani wrote:
> Hi,
>
> I'm a re
Singh
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Mar 27, 2015 at 9:31 PM, Dr Mich Talebzadeh
wrote:
>
> yep it can can happen in any server hosting a database or schema.
>
> I believe you will need to rename the database directory underr hive
> warehouse ditectory .db.
&
those things.
5.
You are not creating table based on existing table (AS SELECT). Use
INTERNAL tables when
Use INTERNAL tables when:
The data is temporary. You want Hive to completely manage the lifecycle
of the table and data.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri
Can I know why do you want to do so?
Currently There is no command or direct way to do that..then I can suggest
workaround for this.
Thanks,
Sanjiv Singh
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Wed, Mar 25, 2015 at 10:01 AM, Shushant Arora
wrote:
> Hi
>
> Is there a
UILDING' == 'BUILDING ', Here is a link
<http://support.microsoft.com/en-us/kb/316626> for an article about it.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Fri, Mar 27, 2015 at 1:41 PM, Nitin Pawar
wrote:
> Hive does not manipulate data by its own, if your processing logic needs
> t
IT 2;
***<>***
It seems that teradata is doing trimming short of thing before actually
comparing stating values. But Hive is matching strings as it is.
Not sure, It is expected behaviour or bug or can be raised as enhancement.
I see below possible solution:
- Convert into like operator expression with wildcard character before
and after
Looking forward for your response on this. How can it be handled/achieved
in hive.
Regards
Sanjiv Singh
Mob : +091 9990-447-339
Congratulations !!!
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Mar 23, 2015 at 11:38 PM, Carl Steinbach wrote:
> The Apache Hive PMC has voted to make Jimmy Xiang, Matt McCline, and
> Sergio Pena committers on the Apache Hive Project.
>
> Please join me in congratulating
('transactional'='true')
Regards
Sanjiv Singh
Mob : +091 9990-447-339
On Mon, Nov 24, 2014 at 1:58 PM, Nitin Pawar
wrote:
> whats your create table DDL?
> On 24 Nov 2014 13:43, "unmesha sreeveni" wrote:
>
>> Hi
>>
>> I am using hive -0.14.0 which
alues in expression, I can't use same approach for
generating multiple LIKE expression separated with OR / AND operator.
Initially I thought to write HIVE UDF for it ? Can you please help me
supporting such expression and finding HIVE equivalent ?
Regards
Sanjiv Singh
Impetus Infotech
Mob : +091 9990-447-339
66 matches
Mail list logo
