Re: Removing Kinesis in Spark 4

2024-01-20 Thread Nicholas Chammas
e not continuously executed in any GitHub Actions >>> pipeline, so I think they significantly lack quality assurance. On top of >>> that, I am not certain if the test cases, which require AWS credentials in >>> these modules, get verified during each Spark version release. &g

Re: Removing Kinesis in Spark 4

2024-01-20 Thread Sean Owen
, get verified during each Spark version release. > > > Did we ever reach a decision about removing Kinesis in Spark 4? > > I was cleaning up some docs related to Kinesis and came across a reference > to some Java API docs that I could not find > <https://github.com/apache/spa

Removing Kinesis in Spark 4

2024-01-20 Thread Nicholas Chammas
t; these modules, get verified during each Spark version release. Did we ever reach a decision about removing Kinesis in Spark 4? I was cleaning up some docs related to Kinesis and came across a reference to some Java API docs that I could not find <https://github.com/apache/spark/pull/4