> On Nov. 24, 2014, 10:44 p.m., Sergio Pena wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java,
> >  line 107
> > <https://reviews.apache.org/r/28372/diff/1/?file=773792#file773792line107>
> >
> >     Avro uses avro.schema.url to specify the file that will be used for the 
> > schema. What if we use the same Avro synatix to specify the parquet schema?
> >     
> >     Something like: parquet.schema.url

The reason I did not call it "parquet.schema.url", as unlike avro schema file 
which contains only avro schema, parquet file will contain data as well. It 
might be misleading for users as there is no concept of parquet schema file. 
However, advantage of using "parquet.schema.url" will be that usage becomes 
uniform between avro and parquet. Let me know what you think based on the 
discussion above.


- Ashish


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28372/#review62889
-----------------------------------------------------------


On Nov. 27, 2014, 1:08 a.m., Ashish Singh wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/28372/
> -----------------------------------------------------------
> 
> (Updated Nov. 27, 2014, 1:08 a.m.)
> 
> 
> Review request for hive.
> 
> 
> Bugs: HIVE-8950
>     https://issues.apache.org/jira/browse/HIVE-8950
> 
> 
> Repository: hive-git
> 
> 
> Description
> -------
> 
> HIVE-8950: Add support in ParquetHiveSerde to create table schema from a 
> parquet file
> 
> 
> Diffs
> -----
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
> fafd78e63e9b41c9fdb0e017b567dc719d151784 
>   
> ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ColInfoFromParquetFile.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java 
> 4effe736fcf9d3715f03eed9885c299a7aa040dd 
>   
> ql/src/test/queries/clientpositive/parquet_array_of_multi_field_struct_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_array_of_optional_elements_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_array_of_required_elements_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_array_of_single_field_struct_gen_schema.q
>  PRE-CREATION 
>   ql/src/test/queries/clientpositive/parquet_array_of_structs_gen_schema.q 
> PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_array_of_unannotated_groups_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_array_of_unannotated_primitives_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_avro_array_of_primitives_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_avro_array_of_single_field_struct_gen_schema.q
>  PRE-CREATION 
>   ql/src/test/queries/clientpositive/parquet_decimal_gen_schema.q 
> PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_thrift_array_of_primitives_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/queries/clientpositive/parquet_thrift_array_of_single_field_struct_gen_schema.q
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_array_of_multi_field_struct_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_array_of_optional_elements_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_array_of_required_elements_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_array_of_single_field_struct_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_array_of_structs_gen_schema.q.out 
> PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_array_of_unannotated_groups_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_array_of_unannotated_primitives_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_avro_array_of_primitives_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_avro_array_of_single_field_struct_gen_schema.q.out
>  PRE-CREATION 
>   ql/src/test/results/clientpositive/parquet_decimal_gen_schema.q.out 
> PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_thrift_array_of_primitives_gen_schema.q.out
>  PRE-CREATION 
>   
> ql/src/test/results/clientpositive/parquet_thrift_array_of_single_field_struct_gen_schema.q.out
>  PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/28372/diff/
> 
> 
> Testing
> -------
> 
> Tested by adding appropriate qTests.
> 
> 
> Thanks,
> 
> Ashish Singh
> 
>

Reply via email to