Adam Budde created SPARK-19911:
----------------------------------
Summary: Add builder interface for Kinesis DStreams
Key: SPARK-19911
URL: https://issues.apache.org/jira/browse/SPARK-19911
Project: Spark
Issue Type: New Feature
Components: DStreams
Affects Versions: 2.1.0
Reporter: Adam Budde
Priority: Minor
The ```KinesisUtils.createStream()``` interface for creating Kinesis-based
DStreams is quite brittle and requires adding a combinatorial number of
overrides whenever another optional configuration parameter is added. This
makes incorporating a lot of additional features supported by the Kinesis
Client Library such as per-service authorization unfeasible. This interface
should be replaced by a builder pattern class
(https://en.wikipedia.org/wiki/Builder_pattern) to allow for greater
extensibility.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
