Hi guys, We[1] are doing a bit of work on Spark Streaming, to help it face situations where the throughput of data on an InputStream is (momentarily) susceptible to overwhelm the Receiver(s) memory.
The JIRA & design doc is here: https://issues.apache.org/jira/browse/SPARK-7398 We'd sure appreciate your comments ! -- François Garillot [1]: Typesafe & some helpful collaborators on benchmarking 'at scale'
