aditiwari01 opened a new pull request #31:
URL: https://github.com/apache/pulsar-adapters/pull/31


   Fixes #29
   
   ### Motivation
   
   Current pulsar-spark adapter uses spark_streaming_2.10 while scala 
dependency is 2.11. Apart from this current receiver does not take care about 
reliability, rate limit and. backpressure. Added a new receiver with all these 
considerations.
   
   ### Modifications
   
   Includes:
   1. Updating spark_streaming_2.10 to spark_streaming_2.11.
   2. Includes rate limit/ backpressure logic in receiver.
   3. Batch read from pulsar instead of record by record.
   4. Making receiver reliable using batch store call.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to