Re: [Announcement] Cloud data lake conference with heavy focus on open source

2020-07-08 Thread Lucio Daza
Hi, yes. The keynotes and sessions will be available on-demand after the event. On Tue, Jul 7, 2020, 8:16 PM Ashley Hoff wrote: > Interesting You've piqued my interest. Will the sessons be available > after the conference? (I'm in the wrong timezone to see this during > daylight hours) >

Implementing TableProvider in Spark 3.0

2020-07-08 Thread Sricheta Ruj
Hello Spark Team I am trying to use the DataSourceV2 API from Spark 3.0. I wanted to ask in case of write- how do I get the user specified schema? This is what I am trying to achieve- val data = Seq( Row("one", 1, true, 12.34,6L, date, Decimal(999.00), timestamp, 2f, byteVal, shortVal),

Re: Implementing TableProvider in Spark 3.0

2020-07-08 Thread Richard Xin
 Saw Sent from Yahoo Mail for iPhone On Wednesday, July 8, 2020, 9:26 PM, Sricheta Ruj wrote: Hello Spark Team   I am trying to use the DataSourceV2 API from Spark 3.0. I wanted to ask in case of write- how do I get the user specified schema?   This is what I am trying to achiev