Congrats Zhihai!!
On Friday, May 5, 2017 9:52 AM, Xuefu Zhang wrote:
Hi all,
I'm very please to announce that Hive PMC has recently voted to offer
Zhihai a committership which he accepted. Please join me in congratulating
on this recognition and thanking him for his contributions to Hiv
Hi,Looks like Hive supports special character (unicode) with "`" in first level
column names since Hive 0.13 (HIVE-6013).Similarly does hive supports special
characters in nested column names? For example, struct create table test1_mislam(a int, `$b_` int);OKTime taken: 0.036
secondshive> create
wrote:
Hi Mohammad,
Currently, Hive + Parquet does not support auto casting for wider types.
That is be a very good idea to implement in Hive.
I'll investigate the hive + parquet code, and see if it is something we can
add in a future release.
- Sergio
On Tue, Oct 6, 2015 at 7:23 PM, Mohammad
Any hive+parquet user/dev to address this?
Regards,
Mohammad
On Monday, October 5, 2015 3:41 PM, Mohammad Islam wrote:
Hi,
Does the parquet table support auto casting to wider data types? For example,
If I have a parquet table where some parquet data files which have "int" as
Hi,Does the parquet table support auto casting to wider data types? For
example, If I have a parquet table where some parquet data files which have
"int" as data type and other files have "long" data type for the same field.
The table schema has type "bigint" for the same field.Does hive can rea
Congratulations Asutosh!
On Wednesday, September 16, 2015 4:51 PM, Bright Ling
wrote:
#yiv7221259285 #yiv7221259285 -- _filtered #yiv7221259285
{font-family:SimSun;panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7221259285
{font-family:PMingLiU;panose-1:2 2 5 0 0 0 0 0 0 0;} _filtere
+1.
On Tuesday, October 7, 2014 6:02 PM, Edward Capriolo
wrote:
+1
On Tue, Oct 7, 2014 at 7:51 PM, Vikram Dixit wrote:
> +1
>
> On Tue, Oct 7, 2014 at 4:44 PM, Bill Busch
> wrote:
> > +1
> >
> > Follow me on @BigData73
> >
> > -Original Message-
> > From: Gunther Hagleit
/avro/TestTypeInfoToSchema.java
PRE-CREATION
Diff: https://reviews.apache.org/r/11925/diff/
Testing
---
Wrote a new java Test class for a new Java class. Added a new test case into
existing java test class. In addition, there are 4 .q file for testing multiple
use-cases.
Thanks,
Mohammad Islam
/TestAvroDeserializer.java
198bd24
serde/src/test/org/apache/hadoop/hive/serde2/avro/TestAvroObjectInspectorGenerator.java
76c1940
Diff: https://reviews.apache.org/r/21353/diff/
Testing
---
Thanks,
Mohammad Islam
test case into
existing java test class. In addition, there are 4 .q file for testing multiple
use-cases.
Thanks,
Mohammad Islam
<https://reviews.apache.org/r/21026/#comment75826>
Just a proposal: in place of throwing exception, you could LOG info/debug
something telling what type of FS is utilized. This might help to debug if
someone used (intentionally or mistakenly) unsupported FS .
- Mohammad Isla
Hi ,
Does Hive 0.12 + Hadoop 2.3 work fine?
We recently experienced the protobuf issue. Looks like hive includes protobuf
2.4.1 whereas Hadoop 2.3 needs protobuf 2.5.0.
Should I rebuild Hive 0.12 code with protobuf 2.5.0? I found some discussion in
JIRA but not sure if it is safe (
https://iss
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19212/#review37540
---
Ship it!
+1
- Mohammad Islam
On March 14, 2014, 9:23 p.m
tamp.java
<https://reviews.apache.org/r/19212/#comment68594>
what about test cases where 1st arg is not null but the second arg is null?
- Mohammad Islam
On March 14, 2014, 2:40 a.m., Jason Dere wrote:
>
> ---
> This
/hive/ql/exec/DDLTask.java
<https://reviews.apache.org/r/19181/#comment68426>
Since you are adding a lot of Null checks, adding one more something like
this privSubjectDesc == null || -- will be complete.
I know it is unlikely this REF could be null.
- Mohammad Islam
On
/hadoop/hive/ql/exec/mr/HadoopJobExecHelper.java
<https://reviews.apache.org/r/18992/#comment68074>
It will be better to include a more informative error message including job
id and exception.
- Mohammad Islam
On March 10, 2014, 11:39 p.m., Ashutosh Chauhan
rc/test/results/clientpositive/stats3.q.out a14e449
Diff: https://reviews.apache.org/r/18065/diff/
Testing
---
Ran some existing q tests with "LOAD DATA LOCAL INPATH".
Thanks,
Mohammad Islam
rc/test/results/clientpositive/stats3.q.out a14e449
Diff: https://reviews.apache.org/r/18065/diff/
Testing
---
Ran some existing q tests with "LOAD DATA LOCAL INPATH".
Thanks,
Mohammad Islam
/clientpositive/load_local_dir_test.q.out PRE-CREATION
ql/src/test/results/clientpositive/stats11.q.out ce1197e
ql/src/test/results/clientpositive/stats3.q.out a14e449
Diff: https://reviews.apache.org/r/18065/diff/
Testing
---
Ran some existing q tests with "LOAD DATA LOCAL INPATH".
Thanks,
Mohammad Islam
ail. To reply, visit:
https://reviews.apache.org/r/18065/#review35771
-------
On Feb. 28, 2014, 8:03 a.m., Mohammad Islam wrote:
>
> ---
> This is an automat
/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
<https://reviews.apache.org/r/18592/#comment66655>
nit: pls remove space.
- Mohammad Islam
On Feb. 28, 2014, 7:37 p.m., Hari Sankar Sivarama Subramaniyan
ests with "LOAD DATA LOCAL INPATH".
Thanks,
Mohammad Islam
w35637
---
On Feb. 26, 2014, 8:20 a.m., Mohammad Islam wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/18065/
>
/apache/hadoop/hive/metastore/HiveMetaStore.java
<https://reviews.apache.org/r/18592/#comment66447>
Can some more info be added in the exception message. such as : table
name/path/URI?
- Mohammad Islam
On Feb. 27, 2014, 11:38 p.m., Hari Sankar Sivarama Subramaniyan
Congratulations Remus!
On Wednesday, February 26, 2014 11:38 AM, Prasanth Jayachandran
wrote:
Congratulations Remus!
Thanks
Prasanth Jayachandran
On Feb 26, 2014, at 11:36 AM, Brock Noland wrote:
> Congrats!!
>
> On Wed, Feb 26, 2014 at 1:10 PM, Lefty Leverenz
> wrote:
>> Congratulat
e
Diff: https://reviews.apache.org/r/18065/diff/
Testing
---
Ran some existing q tests with "LOAD DATA LOCAL INPATH".
Thanks,
Mohammad Islam
ive Authenticat(..) call
4. These are similar to LDAPAuth...Impl.java
- Mohammad Islam
On Feb. 19, 2014, 11:44 p.m., Vaibhav Gumashta wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18254/#review34937
---
Ship it!
- Mohammad Islam
On Feb. 19, 2014, 9:56 p.m., Szehon Ho
/apache/hadoop/hive/ql/parse/StorageFormat.java
<https://reviews.apache.org/r/18224/#comment65026>
Looks like this would be a very generic method useful for other places in
future. Therefore, moving the method to some util class in common module would
be beneficial for others.
- Mohammad
some existing q tests with "LOAD DATA LOCAL INPATH".
Thanks,
Mohammad Islam
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17959/#review34237
---
+1
- Mohammad Islam
On Feb. 11, 2014, 8:13 p.m., Prasad
rization/plugin/sqlstd/SQLStdHiveAccessController.java
<https://reviews.apache.org/r/17939/#comment64190>
Ditto
trunk/ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/SQLStdHiveAccessController.java
<https://reviews.apache.org/r/17939/#comment64191>
equalsIgnoreCase could
Is it possible none of the data deletion succeeds? If that is possible,
the message doesn't seem correct.
- Mohammad Islam
On Feb. 11, 2014, 1:33 a.m., Szehon Ho wrote:
>
> ---
> This is an automatically ge
/org/apache/hadoop/hive/ql/udf/UDFSin.java
<https://reviews.apache.org/r/17661/#comment62922>
same here
- Mohammad Islam
On Feb. 3, 2014, 2:26 p.m., Xuefu Zhang wrote:
>
> ---
> This is an automatical
che/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java
<https://reviews.apache.org/r/13383/#comment62698>
No usage/meaning in this MDFormatter . right?
- Mohammad Islam
On Jan. 31, 2014, 1:29 a.m., Thejas Nair wrote:
>
> ---
erde2/avro/TestTypeInfoToSchema.java
PRE-CREATION
Diff: https://reviews.apache.org/r/11925/diff/
Testing
---
Wrote a new java Test class for a new Java class. Added a new test case into
existing java test class. In addition, there are 4 .q file for testing multiple
use-cases.
Thanks,
n-avro table
> > with record and array columns containing NULL elements is streamed into an
> > Avro table using CTAS?
Added test case.
- Mohammad
---
This is an automatically generated e-mail. To reply
> On Jan. 23, 2014, 10:57 p.m., Mohammad Islam wrote:
> > Overall looks good.
> > Is it possible to add a .q test or append to an existing .q test?
>
> Xuefu Zhang wrote:
> Actually unit test such as that provided is preferrable. Additional .q
> test only prelo
better if you can add a .q test something like decimal_udf.q?
Basically the same q file after setting new config to backward compat mode. the
result could be different.
- Mohammad Islam
On Jan. 24, 2014, 2:54 a.m., Jason Dere wrote
existing .q test?
ql/src/test/org/apache/hadoop/hive/ql/udf/TestUDFSign.java
<https://reviews.apache.org/r/17262/#comment61610>
Minor issue: does testByte() is a good name?
- Mohammad Islam
On Jan. 23, 2014, 8:57 p.m., Xuefu Zhang
/DDLTask.java
<https://reviews.apache.org/r/17217/#comment61558>
Do we need to cleanup anything for 'db' as well that might have partially
changed in line '1841' before the exception?
- Mohammad Islam
On Jan. 23, 2014, 6:58 p.
oop/hive/ql/exec/DDLTask.java
<https://reviews.apache.org/r/17217/#comment61496>
Is it the same 'db' object that might be populated in the caller method?
- Mohammad Islam
On Jan. 23, 2014, 12:49 a.m., Sergey Shelukhin wrote:
>
>
tps://reviews.apache.org/r/16938/#comment61105>
Can you please add a test case (.q file ) around these condition? This is
in an important execution code path.
- Mohammad Islam
On Jan. 16, 2014, 1:45 a.m., Szehon Ho wrote:
>
> -
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/16807/#review31593
---
Ship it!
Ship It!
- Mohammad Islam
On Jan. 12, 2014, 1:58 a.m
use-cases.
Thanks,
Mohammad Islam
/GenericUDFBaseTrim.java
<https://reviews.apache.org/r/15654/#comment58828>
Even if I implement it this way won't I still have to cast arguments[0] to
a PrimitiveObjectInspector in order to call getPrimitiveCategory()? If so then
I don't see the advantage of doing it your way you suggest.
che.org/r/16329/#comment58770>
same here.
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFRound.java
<https://reviews.apache.org/r/16329/#comment58771>
Same. more informative message could be helpful.
- Mohammad Islam
On Dec. 17, 2013, 9:26 p.m.,
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15654/#review30610
---
On Dec. 18, 2013, 3:16 a.m., Mohammad Islam wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
>
; <https://reviews.apache.org/r/15654/diff/4/?file=399238#file399238line48>
> >
> > Msg doesn't match the if condition.
will correct.
- Mohammad
---
This is an automatically generated e-mail. To reply, visit:
/GenericUDFBaseTrim.java
<https://reviews.apache.org/r/15654/#comment58764>
Would you please further explain on this? preferably with an example.
- Mohammad Islam
On Dec. 18, 2013, 3:16 a.m., Mohammad Islam wrote:
>
> ---
ATION
ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFRpad.java
PRE-CREATION
ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFTrim.java
PRE-CREATION
Diff: https://reviews.apache.org/r/15654/diff/
Testing
---
Thanks,
Mohammad Islam
-CREATION
ql/src/test/org/apache/hadoop/hive/ql/udf/TestGenericUDFTrim.java
PRE-CREATION
Diff: https://reviews.apache.org/r/15654/diff/
Testing
---
Thanks,
Mohammad Islam
tps://reviews.apache.org/r/15649/#comment56209>
Same as above: Create a new variable and use it.
hcatalog/bin/hcat.py
<https://reviews.apache.org/r/15649/#comment56208>
If possible, creating a variable and use the variable would make it much
better.|
- Mohammad Islam
On Nov. 18, 20
-CREATION
Diff: https://reviews.apache.org/r/15654/diff/
Testing
---
Thanks,
Mohammad Islam
> On July 29, 2013, 5:41 p.m., Jakob Homan wrote:
> > There is still no text covering a map-reduce job on an already existing,
> > non-Avro table into an avro table. ie, create a text table, populate it,
> > run a CTAS to manipulate the data into an Avro table.
>
t; first argument should be ((PrimitiveObjectInspector) arguments[0])
Done
> On Nov. 9, 2013, 6:44 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFDateSub.java,
> > line 137
> > <https://reviews.apache.org/r/15213/dif
adoop/hive/ql/udf/TestUDFDateDiff.java 8a6dbc3
ql/src/test/org/apache/hadoop/hive/ql/udf/TestUDFDateSub.java fa722a9
ql/src/test/results/clientpositive/udf_to_date.q.out 6ff5ee8
Diff: https://reviews.apache.org/r/15213/diff/
Testing
---
Thanks,
Mohammad Islam
/TestUDFDateDiff.java 8a6dbc3
ql/src/test/org/apache/hadoop/hive/ql/udf/TestUDFDateSub.java fa722a9
Diff: https://reviews.apache.org/r/15213/diff/
Testing
---
Thanks,
Mohammad Islam
,
Mohammad Islam
Congrats Xuefu!
--Mohammad
On Sunday, November 3, 2013 9:07 PM, "hsubramani...@hortonworks.com"
wrote:
Congrats Xuefu!
Thanks,
Hari
On Nov 3, 2013, at 8:28 PM, Gunther Hagleitner
wrote:
Congrats Xuefu!
>
>Gunther.
>
>
>On Sun, Nov 3, 2013 at 8:23 PM, Lefty Leverenz wrote:
>
>
>Bravo X
Thanks Carl for the reply.
Yes these were my own .q files.
Since there are no such current files, we can skip it for the time being. Need
to make sure no future q filenames would contain multiple dots.
Regards,
Mohammad
On Sunday, November 3, 2013 4:59 PM, Carl Steinbach
wrote:
Hi Moham
Hi,
I ran "mvn clean install -DskipTests; cd itests; mvn clean install
-DskipTests" and got the following error.
Error
===
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project hive-it-qfile: Compilation failure:
Comp
on writing new test cases.
Thanks,
Mohammad Islam
lazy/objectinspector/primitive/LazyBinaryObjectInspector.java
dbd60f7
serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyPrimitiveObjectInspectorFactory.java
afbf454
Diff: https://reviews.apache.org/r/14121/diff/
Testing
---
WIP:
working on writing new test cases.
Thanks,
Mohammad Islam
--
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/12480/#review25537
---
On Aug. 30, 2013, 6:49 p.m., Mohammad Islam wrote:
>
> ---
2/avro/Utils.java 2b948eb
Diff: https://reviews.apache.org/r/12480/diff/
Testing
---
Thanks,
Mohammad Islam
sting multiple
use-cases.
Thanks,
Mohammad Islam
Hi,
I found the last Jenkins build failed for hadoop2.
The console output link and error message are pasted below.
I also experienced the same issue yesterday. Running "ant very-clean" fixed
my issue (Thanks to Ashutosh!).
If someone can run the same on build machine, the problem might go aw
che/hadoop/hive/serde2/avro/Utils.java 2b948eb
Diff: https://reviews.apache.org/r/12480/diff/
Testing
---
Thanks,
Mohammad Islam
/r/11925/#review24149
---
On July 23, 2013, 9:51 a.m., Mohammad Islam wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apach
Yes hive build and test cases got convoluted as the project scope gradually
increased. This is the time to take action!
Based on my other Apache experiences, I prefer the option #3 "Breakup the
projects within our own source tree". Make multiple modules or sub-projects. By
default, only key m
Please join us at LinkedIn (2025 Stierlin Court, Mountain View, CA) tomorrow at
6 PM for this month's Hive user meet up.We have a packed agenda :
* Hive at LinkedIn, Mohammad Islam, Mark Wagner, and Karthik Ramasamy
* Hive Server 2 at Yahoo!, Chris Drome
* Hive o
hanks,
Mohammad Islam
0909line26>
> >
> > I don't see a test that exercises the generated schema through whole
> > mapreduce query, just ones that exercise the metadata store...
This test has the "group by".
> On July 12, 2013, 10:32 p.m., Jakob Homan wrote:
> > ql/src/test/queries/clientpositive/avro_create_as_select.q, line 3
&
e/serde2/avro/Utils.java 2b948eb
Diff: https://reviews.apache.org/r/12480/diff/
Testing
---
Thanks,
Mohammad Islam
-----
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/12480/#review23113
---
On July 11, 2013, 10:31 p.m., Mohammad Islam wrote:
>
> ---
.
Thanks,
Mohammad Islam
Schema.java,
> > line 110
> > <https://reviews.apache.org/r/11925/diff/2/?file=307413#file307413line110>
> >
> > Lets take care of this TODO. Should be straight fwd.
Done
- Mohammad
---
g/apache/hadoop/hive/serde2/avro/TestSchemaReEncoder.java
9af751b
serde/src/test/org/apache/hadoop/hive/serde2/avro/Utils.java 2b948eb
Diff: https://reviews.apache.org/r/12480/diff/
Testing
---
Thanks,
Mohammad Islam
/diff/
Testing
---
Wrote a new java Test class for a new Java class. Added a new test case into
existing java test class. In addition, there are 4 .q file for testing multiple
use-cases.
Thanks,
Mohammad Islam
80 matches
Mail list logo
