Hi Team, Any plans to make the StateStoreProvider/StateStore in structured streaming pluggable ? Currently StateStore#loadedProviders has only one HDFSBackedStateStoreProvider and it's not configurable. If we make this configurable, users can bring in their own implementation of StateStore.
Please refer to this ticket - https://issues.apache.org/jira/browse/SPARK-20376 Thanks, http://www.snappydata.io/blog <http://snappydata.io>