> At the mean time, some of the syntax sugars >> may be a good learning lessons for AK streams test-utils to improve further >> indeed.
I agree with this. In retrospective, the current API has some issues because it can lead to ambiguity. For example `ConsumerRecordFactory#create(K key, V value)` with String key and value types, give the same signature as `#create(String topic, String value)` IMHO, it would be valuable to improve the current API based on fluent-kafka-streams-tests library. Would you like to do a KIP (https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals) to contribute? -Matthias On 3/5/19 11:53 AM, Guozhang Wang wrote: > Hello Arvid, > > Thanks for sharing! I've read your two blog posts and also the code repo > and they are really interesting. > > Your observation is right that since schema registry is under Confluent > schema registry the integration may not be contributed to AK. On the other > hand, I think having this as part of the eco-systems and maintained > independently is good as well. At the mean time, some of the syntax sugars > may be a good learning lessons for AK streams test-utils to improve further > indeed. > > I've added the repo to the eco-system's wiki page: > https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem > > Guozhang > > > On Tue, Mar 5, 2019 at 8:34 AM Arvid Heise <arvid.he...@bakdata.com> wrote: > >> Dear Kafka devs, >> >> we recently published a fluent kafka streams test library. >> https://github.com/bakdata/fluent-kafka-streams-tests >> https://medium.com/bakdata/fluent-kafka-streams-tests-e641785171ec >> >> We wanted to ask if there is any interest in us contributing the rather >> small wrapper around the TestDriver to Kafka. >> >> Our main motivation was to reduce to the boilerplate of a “traditional” >> Kafka Streams test by a small Fluent API. More information can be found in >> the medium article and repo README. >> >> >> >> During the development, we also noticed that using the >> MockSchemaRegistryClient is rather intrusive in our application code. So we >> added a small wiremock of the Schema registry (limited to the two endpoints >> used by the Kafka Serde). >> >> https://github.com/bakdata/fluent-kafka-streams-tests/tree/master/schema-registry-mock >> >> https://medium.com/bakdata/transparent-schema-registry-for-kafka-streams-6b43a3e7a15c >> >> We could also contribute that to the schema registry, but that would be in >> the confluent SR repo. Since I assume that there is quite an overlap >> between this mailing list and the schema registry maintainers, I’m still >> asking here if there is also an interest in having that contributed. If >> there is a better place, please give me a pointer. >> >> Best, >> >> Arvid >> >> -- >> >> Dr. Arvid Heise >> Senior Data Engineer >> >> bakdata | bespoke data engineering >> www.bakdata.com >> >> T +49 (0)30 3406068-45 >> F +49 (0)30 3406068-44 >> >> bakdata GmbH >> Falckensteinstraße 24 >> D-10997 Berlin >> >> Geschäftsführer: Alexander Albrecht, Christoph Böhm >> Sitz Berlin, Amtsgericht Berlin HRB 174303 B >> >> >
signature.asc
Description: OpenPGP digital signature