Re: [SQL] Reading from hive table is listing all files in S3

Thanks > > - Mail Original - > De: "Mich Talebzadeh" > À: "Mehdi Meziane" > Cc: "user @spark" > Envoyé: Mercredi 3 Août 2016 16h47:46 GMT +01:00 Amsterdam / Berlin / > Berne / Rome / Stockholm / Vienne > Objet: Re: [SQL] Reading fr

Re: [SQL] Reading from hive table is listing all files in S3

uot;user @spark" > Envoyé: Mercredi 3 Août 2016 16h47:46 GMT +01:00 Amsterdam / Berlin / > Berne / Rome / Stockholm / Vienne > Objet: Re: [SQL] Reading from hive table is listing all files in S3 > > > Hi, > > Do you have a schema definition for this Hive table? > > W

Re: [SQL] Reading from hive table is listing all files in S3

01:00 Amsterdam / Berlin / Berne / Rome / Stockholm / Vienne Objet: Re: [SQL] Reading from hive table is listing all files in S3 Hi, Do you have a schema definition for this Hive table? What format is this table stored HTH Dr Mich Talebzadeh LinkedIn

Re: [SQL] Reading from hive table is listing all files in S3

Hi, Do you have a schema definition for this Hive table? What format is this table stored HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

[SQL] Reading from hive table is listing all files in S3

Hi all, We have a hive table stored in S3 and registered in a hive metastore. This table is partitionned with a key "day". So we access this table through the spark dataframe API as : sqlContext.read() .table("tablename) .where(col("day").between("2016-08-01","2016-08-02")) When the