[Announce] Release of Apache Avro 1.9.0

Since the last release of Apache Avro 1.8.2 on May 31, 2017. Two years later, I'm thrilled to announce the release of Avro 1.9.0! Changes are listed at https://s.apache.org/avro190 A list of highlights of the new version: https://blog.godatadriven.com/apache-avro-1-9-release This release can be d

Re: [ANNOUNCE] Please welcome Ismaël Mejía to the Apache Avro PMC

Congrats, welcome Ismaël! Op di 11 jun. 2019 om 07:02 schreef Niels Basjes > Welcome! > > On Tue, 11 Jun 2019, 00:01 Brian Lachniet, wrote: > >> Congratulations, Ismaël! >> >> On Mon, Jun 10, 2019 at 5:48 PM Jesse Anderson >> wrote: >> >>> Congrats! >>> >>> On Mon, Jun 10, 2019, 4:41 PM Sean B

Re: Should a Schema be serializable in Java?

Correct me if I'm wrong here. But as far as I understood the way of serializing the schema is using Avro, as it is part of the file. To avoid confusion there should be one way of serializing. However, I'm not sure if this is worth the hassle of not simply implementing serializable. Also Flink ther

Re: Should a Schema be serializable in Java?

t; >> so this is less critical, but this still can happen specially now with >> >> all the different versions of Java and OpenJDK based flavors). >> >> >> >> 2. This is not cross language compatible, the String based >> >> representation (or even an Avro bas

Re: Should a Schema be serializable in Java?

Thanks again Ryan, I've merged to master and the 1.9 branch, so it should be in Avro 1.9.1. Cheers, Fokko Driesprong Op do 18 jul. 2019 om 15:18 schreef Zoltan Farkas : > LGTM > > On Jul 18, 2019, at 8:24 AM, Driesprong, Fokko > wrote: > > Thank you Ryan, I have a

Re: union schema evolution

Hi Kishore, The easiest way to find out is compile it against Avro 1.8.2. This is a regression bug which will be fixed in 1.9.1 which will be released in the upcoming weeks. Cheers, Fokko Op ma 22 jul. 2019 om 22:38 schreef KV 59 > Hi, > > I'm trying to define a union schema which is backward

Re: [Announce] Please welcome Nándor Kollár to the Apache Avro PMC

Welcome Nándor, great to have you on the PMC! 👍 Op za 31 aug. 2019 om 09:20 schreef Niels Basjes : > Welcome! > > On Fri, Aug 30, 2019, 23:39 Brian Lachniet wrote: > > > Congratulations, Nándor! > > > > On Fri, Aug 30, 2019, 5:37 PM Sean Busbey wrote: > > > >> Hi folks! > >> > >> On behalf of t

Re: Release notes for Avro 1.9.1

Thank you for the question Javier, The 1.9.1 release patches some regression issues that we're discovered in 1.9.0. The release notes are here: https://github.com/apache/avro/releases/tag/release-1.9.1 Cheers, Fokko Driesprong Op wo 11 sep. 2019 om 17:46 schreef Javier Holguera < javier.holgu..

Re: Announcement: Avro Schema Viewer

Awesome work Robin, thanks for sharing! Cheers, Fokko Op za 21 sep. 2019 om 19:57 schreef Robin Trietsch : > Hey Brian, > > Thanks! At the moment it only supports one top level schema with different > versions. But feel free to implement it :) > > Regards, > Robin > > On 21 Sep 2019, at 18:39, B

New Committer: Ryan Skraba

Folks, The Project Management Committee (PMC) for Apache Avro has invited Ryan Skraba to become a committer and we are pleased to announce that he has accepted. Ryan is actively fixing bugs by providing patches and reviewing pull requests by others. We're very happy to have him on board. Being a

Re: More idiomatic JSON encoding for unions

I would be a great fan of this as well. This also bothered me. The tricky part here is to see when to release this because it will break the existing JSON structure. We could make this configurable as well. Cheers, Fokko Op ma 6 jan. 2020 om 22:36 schreef roger peppe : > That's great, thanks! I

Re: More idiomatic JSON encoding for unions

r binary, we could have for json: >> application/avro+json for the current format, application/avro.2+json for >> the new format…. >> >> At some point in the future we could deprecate the old one… >> >> —Z >> >> >> On Jan 7, 2020, at 2:41 AM, Drie

Re: avro-tools illegal reflective access warnings

Hi Rog, This is actually a warning produced by the Hadoop library, that we're using. Please note that htis isn't part of the stdout: $ find /tmp/tmp /tmp/tmp /tmp/tmp/._SUCCESS.crc /tmp/tmp/part-0-9300fba6-ccdd-4ecc-97cb-0c3ae3631be5-c000.avro /tmp/tmp/.part-0-9300fba6-ccdd-4ecc-97cb-0c3a

Re: avro-tools illegal reflective access warnings

Hi Roger, We also have Java11 in our CI, but it might be that there are still some issues with it. I haven't battletested Avro with Java 11 at least. For skipping the tests, you can provide a flag to Maven: # Make sure that you're in the Java project cd lang/java/ mvn clean install -DskipTests L

Re: avro-tools illegal reflective access warnings

gt;> >> >>> > Hi Fokko, >> >> >>> > >> >> >>> > Thanks for your swift response! >> >> >>> > >> >> >>> > Stdout and stderr definitely seem to be merged on this platform >> at least.

Re: [ANNOUNCE] Apache Avro 1.9.2 released

Awesome, thanks Ryan for running the release! Cheers, Fokko Op do 13 feb. 2020 om 16:27 schreef Ryan Skraba : > The Apache Avro community is pleased to announce the release of Avro 1.9.2! > > The link to all fixed JIRA issues and a brief summary can be found at: > https://github.com/apache/avro/

Re: Best-practice for integrating Jackson DTO's and Avro DTO's?

Hi Marko, You can easily convert Avro to JSON: https://github.com/apache/avro/blob/master/lang/java/avro/src/main/java/org/apache/avro/io/JsonDecoder.java https://github.com/apache/avro/blob/master/lang/java/avro/src/main/java/org/apache/avro/io/JsonEncoder.java However, if you use union values,

Re: Avro Spec: encoding unions

Hi Anh, It looks like that you've found an inconsistency in the docs there. I think we need to update the docs, and state that an int is being written. Stay strong! Cheers, Fokko Op vr 20 mrt. 2020 om 07:58 schreef Anh Le : > Hi guys, > > I'm reading the current Avro Spec. It states that: > >

Re: 1.10.0 Release?

Thanks Covey, Please give the 1.10-SNAPSHOT a try, and if you see any issues, let me know. This will make sure that we capture bugs on forehand. Cheers, Fokko Op di 14 apr. 2020 om 23:59 schreef Corey Fritz : > Thanks! Will keep an eye out... > > *Corey Fritz | Architect* > corey.fr...@snagajob

Re: does anyone use IDL ?

Hi Rog, I know a few companies that use IDL, but it isn't as popular as just AVSC. It depends on your use case, if you have a very hierarchical schema, then it might be nice to use. If you have a simple message that you want to pass around, then only a avsc might do the trick. Cheers, Fokko Op v

Re: Schema Evolution Removing fields

Hi Kishore, This isn't possible. The fields should be optional in the first place. I always use the table from Confluence: https://docs.confluent.io/current/schema-registry/avro.html The way to do this is to only add, or delete optional fields. Hope this helps. Kind regards, Fokko Op di 7 jul.

Re: [Announce] Please welcome Ryan Skraba to the Apache Avro PMC

Awesome, well deserved Ryan! Cheers, Fokko Op do 17 sep. 2020 om 18:06 schreef Micah Kornfield : > Congratulations! > > On Mon, Sep 14, 2020 at 10:07 AM Sean Busbey wrote: > > > Hi folks! > > > > On behalf of the Apache Avro PMC I am pleased to announce that Ryan > > Skraba has accepted our inv

Re: [ANNOUNCE] Apache Avro 1.10.1 released

Awesome! Thanks for running the release. Great to see some continuity in the Avro releases. Cheers, Fokko Op vr 4 dec. 2020 om 21:19 schreef Ryan Skraba > Please note: I mistakenly sent this same message earlier today with the > wrong subject! It is, in fact, 1.10.1 that was released. My apol