[
https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16285791#comment-16285791
]
Stavros Kontopoulos edited comment on SPARK-16738 at 12/11/17 11:26 AM:
------------------------------------------------------------------------
I have opened recently the
[https://mail-archives.apache.org/mod_mbox/spark-dev/201712.mbox/%3CCACTd3c8%3DAOmrD%2By7y4n5Tm_Kz_scyULsPXbNRGLa0dD2o4A2Fg%40mail.gmail.com%3E]on
the dev list. There are several uses cases that should be covered:
- real-time dashboards and real-time reporting, the faster the better
- monitoring of state for operational reasons, app health etc...
- integrating with external services via an API eg. making accessible
aggregations over time windows to some third party service within your system
It would be good to expose the same capabilities as they are in Kafka streams
and Flink.
was (Author: skonto):
I have opened recently the
[https://mail-archives.apache.org/mod_mbox/spark-dev/201712.mbox/%3CCACTd3c8%3DAOmrD%2By7y4n5Tm_Kz_scyULsPXbNRGLa0dD2o4A2Fg%40mail.gmail.com%3E]on
the dev list. There are several uses cases that should be covered:
- real-time dashboards and real-time reporting, the faster the better
- monitoring of state for operational reasons, app health etc...
- integrating with external services via an API eg. making accessible
aggregations over time windows to some third party service within your system
> Queryable state for Spark State Store
> -------------------------------------
>
> Key: SPARK-16738
> URL: https://issues.apache.org/jira/browse/SPARK-16738
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Affects Versions: 2.0.0
> Reporter: Mark Sumner
> Labels: features
>
> Spark 2.0 will introduce the new State Store to allow state managment outside
> the RDD model (see: SPARK-13809)
> This proposal seeks to include a mechanism (in a future release) to expose
> this internal store to external applications for querying.
> This would then make it possible to interact with aggregated state without
> needing to synchronously write (and read) to/from an external store.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
