Re: Writing Custom Spark Readers and Writers

2022-04-06 Thread daniel queiroz
https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/connector/read/index.html https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/connector/write/index.html https://developer.here.com/documentation/java-scala-dev/dev_guide/spark-connector/index.html Grato, Daniel

Re: Spark salesforce connector

2021-11-25 Thread daniel queiroz
< timeout) done } /* * wait until the job is completed */ def awaitJobCompleted(jobId: String, token: String): Boolean = { val timeoutDuration = FiniteDuration(60L, MILLISECONDS) val initSleepIntervalDuration = FiniteDuration(200L, MILLISECONDS) val maxSleepInte

Re: Optimizing SQL Query

2015-03-06 Thread daniel queiroz
Dude, please, attach the execution plan of the query and details about the indexes. 2015-03-06 9:07 GMT-03:00 anu : > I have a query that's like: > > Could you help in providing me pointers as to how to start to optimize it > w.r.t. spark sql: > > > sqlContext.sql(" > > SELECT dw.DAY_OF_WEEK,

Re: Announcing Spark SQL

2014-03-26 Thread daniel queiroz
Well done guys!! Thanks! 2014-03-26 19:10 GMT-03:00 Nicholas Chammas : > This is so, so COOL. YES. I'm excited about using this once I'm a bit more > comfortable with Spark. > > Nice work, people! > > > On Wed, Mar 26, 2014 at 5:58 PM, Michael Armbrust > wrote: > >> Hey Everyone, >> >> This al