e and rebuilding the spark binaries again but now it shows new error
> NoSuchMethodError. As per my preliminary investigation it seems that Spark
> is build with Hive 1.2.1 which is causing this issues. Can you please let
> me know if i am missing anything?
>
>
> Regards,
> Sac
; need to custom build spark without hive dependencies but after trying
> all this it shows some compatibility issues.
>
>
> Regards,
> Sachin Janani
>
> On Tue, Jun 19, 2018 at 5:02 PM, Sahil Takiar
> wrote:
> > Yes, Hive 3.0.0 works with Spark 2.3.0 - this section of
ion etc. So just need to know if it works and whether
> someone tried it out,
>
>
> Thanks and Regards,
> --
> Sachin Janani
>
--
Sahil Takiar
Software Engineer
takiar.sa...@gmail.com | (510) 673-0309
/gwX3KpHa2j0
- Hive-on-Spark at Uber: Efficiency & Scale - Xuefu Zhang -
https://www.slideshare.net/sahiltakiar/hive-on-spark-at-uber-scale
- Hive-on-S3 Performance: Past, Present, and Future - Sahil Takiar -
https://www.slideshare.net/sahiltakiar/hive-ons3-performance-past-present-and-fu
hive.apache.org
> *Subject:* Re: May 2018 Hive User Group Meeting
>
>
>
> Hey everyone,
>
>
>
> Was the meeting recorded by any chance?
>
> Luis
>
>
> On May 8, 2018, at 5:31 PM, Sahil Takiar wrote:
>
> Hey Everyone,
>
>
>
> Almost time for t
tarts.
For those attending in person, there will be guest wifi:
Login: HiveMeetup
Password: ClouderaHive
On Mon, May 7, 2018 at 12:48 PM, Sahil Takiar
wrote:
> Hey Everyone,
>
> The meetup is only a day away! Here
> <https://docs.google.com/document/d/1v8iERias-LOq8-q4BrCNSUsOarCw
https://www.meetup.com/Hive-User-Group-Meeting/events/249641278/
On Wed, May 2, 2018 at 7:48 AM, Sahil Takiar wrote:
> Hey Everyone,
>
> The agenda for the meetup has been set and I'm excited to say we have lots
> of interesting talks scheduled! Below is final agenda, the full list
s explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
--
Sahil Takiar
Software Engineer
takiar.sa...@gmail.com | (510) 673-0309
t;
>> +1 for streaming or a recording. Content looks excellent.
>>
>> On 2 May 2018 at 15:51, dan young wrote:
>>
>>> Looks like great talks, will this be streamed anywhere?
>>>
>>> On Wed, May 2, 2018, 8:48 AM Sahil Takiar
>>> wrote:
>
- Xuefu Zhang
- Hive-on-S3 Performance: Past, Present, and Future - Sahil Takiar
- Dali: Data Access Layer at LinkedIn - Adwait Tumbde
- Parquet Vectorization in Hive - Vihang Karajgaonkar
- ORC Column Level Encryption - Owen O’Malley
- Running Hive at Scale @ Lyft - Sharanya Santhana
et an accurate headcount for food.
Thanks!
--Sahil
On Wed, Apr 11, 2018 at 5:08 PM, Sahil Takiar
wrote:
> Hi all,
>
> I'm happy to announce that the Hive community is organizing a Hive user
> group meeting in the Bay Area next month. The details can be found at
> https:/
Hi all,
I'm happy to announce that the Hive community is organizing a Hive user
group meeting in the Bay Area next month. The details can be found at
https://www.meetup.com/Hive-User-Group-Meeting/events/249641278/
The format of this meetup will be slightly different from previous ones.
There wil
ference those files in order to read them in the executors?
>
>
>
> Thanks much for your help,
>
> Ray
>
--
Sahil Takiar
Software Engineer
takiar.sa...@gmail.com | (510) 673-0309
7;expediteur et le detruire ainsi que les pieces jointes. Les messages
> electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou
> falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged
> information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete
> this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been
> modified, changed or falsified.
> Thank you.
>
>
--
Sahil Takiar
Software Engineer
takiar.sa...@gmail.com | (510) 673-0309
The Apache Hive team is proud to announce the release of Apache Hive
version 2.3.2.
The Apache Hive (TM) data warehouse software facilitates querying and
managing large datasets residing in distributed storage. Built on top
of Apache Hadoop (TM), it provides, among others:
* Tools to enable easy
>
>>> Build Hive first, use that version to build Spark, use that Spark
>>> version to rebuild Hive.
>>>
>>> I have to do this to make it work because Spark contains Hive jars and
>>> Hive contains Spark jars in the class-path.
>>>
>>> And specifically I have to edit the pom.xml files, instead of passing in
>>> params with -Dspark.version, because the installed pom files don't get
>>> replacements from the build args.
>>>
>>> Cheers,
>>> Gopal
>>>
>>>
>>>
>>
>
--
Sahil Takiar
Software Engineer at Cloudera
takiar.sa...@gmail.com | (510) 673-0309
MethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:483)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
>
> I bugs me that that class is in spark-core_2.11-2.2.0.ja
gt; hive.spark.client.rpc.max.size=52428800 --conf
> hive.spark.client.rpc.threads=8 --conf hive.spark.client.secret.bits=256
> --conf hive.spark.client.rpc.server.address=null
>
> * i even print out CLASSPATH in this script: /usr/lib/spark-2.2.0-bin-
> hadoop2.6/bin/spark-submi
18 matches
Mail list logo
