Re: Problem with implementing the Datasource V2 API for Salesforce

2022-05-24 Thread Gourav Sengupta
Hi, in the spirit of not fitting the solution to the problem, would it not be better to first create a producer for your job and use a broker like Kafka or Kinesis or Pulsar? Regards, Gourav Sengupta On Sat, May 21, 2022 at 3:46 PM Rohit Pant wrote: > Hi all, > > I am trying to implement a cu

Problem with implementing the Datasource V2 API for Salesforce

2022-05-21 Thread Rohit Pant
Hi all, I am trying to implement a custom Spark Datasource for Salesforce by implementing the Spark Datasource V2 interfaces. For querying Salesforce data parallelly I am planning to use the Salesforce Bulk V1 API https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/api_asy