Re: Is Structured streaming ready for production usage

Please take a look at http://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html On Thu, Jun 8, 2017 at 4:46 PM, swetha kasireddy wrote: > OK. Can we use Spark Kafka Direct with Structured Streaming? > > On Thu, Jun 8, 2017 at 4:46 PM, swetha kasireddy < > swethakasire...@g

Re: Is Structured streaming ready for production usage

OK. Can we use Spark Kafka Direct with Structured Streaming? On Thu, Jun 8, 2017 at 4:46 PM, swetha kasireddy wrote: > OK. Can we use Spark Kafka Direct as part of Structured Streaming? > > On Thu, Jun 8, 2017 at 3:35 PM, Tathagata Das > wrote: > >> YES. At Databricks, our customers have alrea

Re: Is Structured streaming ready for production usage

OK. Can we use Spark Kafka Direct as part of Structured Streaming? On Thu, Jun 8, 2017 at 3:35 PM, Tathagata Das wrote: > YES. At Databricks, our customers have already been using Structured > Streaming and in the last month alone processed over 3 trillion records. > > https://databricks.com/blo

Re: Is Structured streaming ready for production usage

YES. At Databricks, our customers have already been using Structured Streaming and in the last month alone processed over 3 trillion records. https://databricks.com/blog/2017/06/06/simple-super-fast-streaming-engine-apache-spark.html On Thu, Jun 8, 2017 at 3:03 PM, SRK wrote: > Hi, > > Is struc