Spark DataFrame Creation

2020-07-22 Thread Mark Bidewell
7;m confused by the behavior. my understanding was that load() was lazily executed on the Spark worker. Why would some elements be executing on the driver? Thanks for your help -- Mark Bidewell http://www.linkedin.com/in/markbidewell

Re: RE - Apache Spark compatibility with Hadoop 2.9.2

2019-06-23 Thread Mark Bidewell
; Respectfully, > Bipul > PUBLIC KEY <http://ix.io/1nWf> > 97F0 2E08 7DE7 D538 BDFA B708 86D8 BE27 8196 D466 > ** Please excuse brevity and typos. ** > > > On Sun, Jun 23, 2019 at 8:06 PM Mark Bidewell wrote: > >> I have done a set

Re: RE - Apache Spark compatibility with Hadoop 2.9.2

2019-06-23 Thread Mark Bidewell
I have done a setup with Hadoop 2.9.2 and Spark 2.2.2. Apache Zeppelin is fine but some our internally developed apps need work on dependencies On Sun, Jun 23, 2019, 07:50 Bipul kumar wrote: > Hello People ! > > I am new to Apache Spark , and just started learning it. > Few questions i have in

Spark and Zookeeper HA failures

2018-11-29 Thread Mark Bidewell
sting timeouts but that doesn't work either. Any ideas how to resolve this? Thanks! -- Mark Bidewell http://www.linkedin.com/in/markbidewell