aditiwari01 opened a new pull request #31: URL: https://github.com/apache/pulsar-adapters/pull/31
Fixes #29 ### Motivation Current pulsar-spark adapter uses spark_streaming_2.10 while scala dependency is 2.11. Apart from this current receiver does not take care about reliability, rate limit and. backpressure. Added a new receiver with all these considerations. ### Modifications Includes: 1. Updating spark_streaming_2.10 to spark_streaming_2.11. 2. Includes rate limit/ backpressure logic in receiver. 3. Batch read from pulsar instead of record by record. 4. Making receiver reliable using batch store call. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org