Revive Avro?

2018-09-24 Thread Driesprong, Fokko
Hi all, Let me cut right to the chase, the lack of activity on the Apache Avro master makes me a bit sad. I believe Avro is a format that many people happly use, and will be used in the future (at least I hope). Therefore we need: - *Continue the development of features:* For example, I'd lik

Re: Revive Avro?

2018-09-25 Thread Driesprong, Fokko
the build dependencies tested with each PR > should help us keep them up to date so that we can release more easily and > often. > > Thanks, > > Doug > > On Mon, Sep 24, 2018 at 10:14 AM Driesprong, Fokko > wrote: > > > Hi all, > > > > Let me cut right

Re: Revive Avro?

2018-09-28 Thread Driesprong, Fokko
leads to project responsibilities (i.e. > committer or pmc status) please ping the pmc at > priv...@avro.apache.org. If for whatever reason folks feel > uncomfortable emailing a closed list, you can also ping me directly. > > > > On 2018/09/25 07:14:54, "Driespron

Jenkins

2018-10-11 Thread Driesprong, Fokko
Hi all, I'd like to revive the Jenkins build on Avro. The last runs are a bit over a year old: https://builds.apache.org/view/A/view/Avro/ I've opened a PR based on Apache Yetus to configure the precommit task to run CI jobs, as Sean Busbey initially sugg

Re: Jenkins

2018-10-11 Thread Driesprong, Fokko
o a specific service. Cheers, Fokko Op do 11 okt. 2018 om 21:53 schreef Niels Basjes : > I fully agree with automated builds. > > I'm just curious what makes Jenkins more appropriate? > > Niels > On Thu, Oct 11, 2018 at 6:09 PM Driesprong, Fokko > wrote: > > >

Re: Jenkins

2018-10-14 Thread Driesprong, Fokko
ean Busbey : > On Thu, Oct 11, 2018 at 11:09 AM Driesprong, Fokko > wrote: > > > > Hi all, > > > > I'd like to revive the Jenkins build on Avro. The last runs are a bit > over > > a year old: https://builds.apache.org/view/A/view/Avro/ > > > &

Re: Avro Big Data Question from a developer

2022-05-11 Thread Driesprong, Fokko
Hi Gokay, That's some CSV file. That will probably be much smaller in Avro. An Avro file is a so-called Object Container File. This was implemented in the MapReduce era to make sure that the workload for each of the workers is roughly the same. Which makes it easier to tune the memory requirement

Re: [ANNOUNCE] New PMC member: Martin Grigorov

2022-09-14 Thread Driesprong, Fokko
Congratulations Martin, thanks for all the hard work and well deserved! Cheers, Fokko Op wo 14 sep. 2022 om 03:39 schreef Oscar Westra van Holthe - Kind < os...@westravanholthe.nl>: > Congratulations Martin! This is wel deserved. > > > > > Oscar Westra van Holthe - Kind > > Op di 13 sep. 2022

Re: [VOTE] Release Apache Avro 1.10.0 RC1

2020-06-13 Thread Driesprong, Fokko
Thanks Ismaël for running the release. I've just tested an all looks good. +1 (binding) Cheers, Fokko Op za 13 jun. 2020 om 13:23 schreef Ryan Skraba : > The only change necessary to compile Parquet with the 1.10.0 RC1 > artifacts was to add `public` to > the parquet-avro pom.xml so that field

Re: [VOTE] Release Apache Avro 1.10.0 RC2

2020-06-26 Thread Driesprong, Fokko
+1 (binding) Checked against Iceberg, and it looks good! Thanks for running the release Ismaël! Cheers, Fokko Op vr 26 jun. 2020 om 08:09 schreef Sean Busbey : > +1 binding > > I think the nexus link was wrong. It was just the avro:avro jar for > 1.10. looking at nexus I believe the staged rep

Re: [REPORT] Board report for Apache Avro June 2020

2020-07-08 Thread Driesprong, Fokko
Looks good! Also a valid point on the Community Health. Cheers, Fokko Op wo 8 jul. 2020 om 08:54 schreef Sean Busbey : > Hi folks! > > Here's the report for the quarter I submitted. Let me know if there are any > last minute changes y'all would like to see. > > > > ## Description: > Apache

Re: [VOTE] Drop Python 2 support

2020-08-20 Thread Driesprong, Fokko
Thanks Michael, Also, Spark is dropping support of 3.5 and below :) Cheers, Fokko Op vr 14 aug. 2020 om 17:04 schreef Michael A. Smith : > Based on these votes and plenty of time passing I will feel > comfortable making changes that are only compatible with python 3.5 > and up. > > Thank you al

Re: Type Hints for Python!

2020-08-20 Thread Driesprong, Fokko
Cool stuff Michael, I'll pick up some files and start adding type-hints :) Cheers, Fokko Op ma 17 aug. 2020 om 14:40 schreef Michael A. Smith : > We've had mypy, the Python type checker, running in Travis-CI on > lang/py for a little while. However, mypy doesn't actually check code > unless it

Re: [Announce] Please welcome Ryan Skraba to the Apache Avro PMC

2020-09-17 Thread Driesprong, Fokko
Awesome, well deserved Ryan! Cheers, Fokko Op do 17 sep. 2020 om 18:06 schreef Micah Kornfield : > Congratulations! > > On Mon, Sep 14, 2020 at 10:07 AM Sean Busbey wrote: > > > Hi folks! > > > > On behalf of the Apache Avro PMC I am pleased to announce that Ryan > > Skraba has accepted our inv

Re: [ANNOUNCE] Apache Avro 1.10.1 released

2020-12-04 Thread Driesprong, Fokko
Awesome! Thanks for running the release. Great to see some continuity in the Avro releases. Cheers, Fokko Op vr 4 dec. 2020 om 21:19 schreef Ryan Skraba > Please note: I mistakenly sent this same message earlier today with the > wrong subject! It is, in fact, 1.10.1 that was released. My apol

Re: GitHub Actions

2020-12-20 Thread Driesprong, Fokko
Hi Michael, Thanks for bringing this up. I think it would be a great idea. I don't have anything against Travis, but I like GA a lot. For example, their container support is much better, and the syntax is cleaner. It also integrates extremely well with Github itself. This can be nice if we want to

Re: [Vote] to Use GitHub Actions and Disable TravisCI [Was Re: GitHub Actions]

2020-12-28 Thread Driesprong, Fokko
rd Time. > > > > (If a PMC member or committer does want to veto this because of some > > perceived flaw in the PR implementation, please don't leave us hanging > > with a non-working Travis implementation. Propose a path forward.) > > > > Thanks, > > Mic

Re: GitHub Actions

2020-12-28 Thread Driesprong, Fokko
I prefer to do this in separate PR's, to avoid huge changes. Also, with GA the CI will be more stable :) Cheers, Fokko Op zo 20 dec. 2020 om 20:58 schreef Michael A. Smith : > On Sun, Dec 20, 2020 at 6:13 AM Driesprong, Fokko > wrote: > > > > Hi Michael, > > >

Re: [DISCUSS] Automatically Merge Dependency Updates

2021-01-31 Thread Driesprong, Fokko
Hi Ismaël, Thanks for working on this! I haven't seen many projects doing this, but I like the idea! I'm all in favor of this! Cheers, Fokko Op zo 31 jan. 2021 om 14:06 schreef Ismaël Mejía : > Since I opened this discussion ~1 month ago I had the time to revisit > the process and my 'new' conc

Re: [VOTE] Accept donation of Avro Rust implementation

2021-05-24 Thread Driesprong, Fokko
Cool stuff! Checked the repo, and it looks very good! +1 (binding) from my side! Cheers, Fokko Op ma 24 mei 2021 om 11:34 schreef Ismaël Mejía : > Dear all, > > The developers of > https://github.com/flavray/avro-rs/ > > have been in touch with some members of the Apache Avro Project Management

Merge strategy

2018-10-23 Thread Driesprong, Fokko
Hi all, Allow me to start the great debate. [image: image.png] I would like to get the Avro's dev-community's opinion on the merge strategy of pull requests. By default Github supports three options: - Create a merge commit - Squash and merge - Rebase and merge https://help.github.com/articles/a

Re: Python 3 support

2018-11-05 Thread Driesprong, Fokko
Hi Michael, Thanks for pointing out the Python versions. I'm fine with the suggestion of supporting 3.4 up to 3.7. I would also consider supporting from 3.5 onwards. Right now I've done some tests against 3.4 and that seems to run fine. I'm fine with adding the classifiers. Cheers, Fokko Op wo 3

Re: Static Analysis

2018-11-07 Thread Driesprong, Fokko
Hi Michael, Thanks for suggesting this. Also with Apache Yetus we can enable plugins like Spotbugs for Java, pylint for Python, hadolint for Docker, shellcheck for shellscripts and many more. Is this what you're looking for? I'm in favor of static analysis, but with so many languages in the reposi

Re: Tagging PRs in github

2018-12-04 Thread Driesprong, Fokko
Definitely, thanks a lot Ismaël! Op za 1 dec. 2018 om 00:21 schreef Michael A. Smith : > Thanks for doing that. It was very needed. > > Can we automate doing this somehow. > > On Thu, Nov 29, 2018 at 17:52 Ismaël Mejía wrote: > > > Hello, > > > > I tagged all open PRs in github using the Label f

Re: Overtesting Java Avro?

2018-12-12 Thread Driesprong, Fokko
Good point Ismaël, I also noticed it. I don't know why we run the tests twice. The main question is if the custom_ encoder hits other branches of the code. Maybe check this using the code coverage? I'm all in for making the tests simpler. Cheers, Fokko Op wo 12 dec. 2018 om 11:30 schreef Ismaël

Re: Modern PHP support

2018-12-20 Thread Driesprong, Fokko
Hi Gildas, This would be very welcome. Currently, I'm working on getting the CI to work with a newer base image . But the tests only pass against a specific version of PHP 5.6. Let me know if there is anything that I can do. You could use git blame

Re: Status of 1.9....

2019-01-21 Thread Driesprong, Fokko
Brian, I recently added you as a contributor to the Jira. Could you try again to assign the ticket? I'm happy to help with the 1.9 release. Cheers, Fokko Op vr 18 jan. 2019 om 00:10 schreef Brian Lachniet : > It appears that I don't have permissions to edit or assign issues to > myself. Is that

Re: Status of 1.9....

2019-02-04 Thread Driesprong, Fokko
me proper testing and verification of the 1.9. Cheers, Fokko Op di 22 jan. 2019 om 00:53 schreef Brian Lachniet : > That resolved my issue. I'm now able to assign issues to myself. Thank you! > > On Mon, Jan 21, 2019 at 3:15 PM Driesprong, Fokko > wrote: > > > Brian, I

Re: Tagging PRs in github

2019-02-08 Thread Driesprong, Fokko
ated a ticket in INFRA, let's hope it can be easily setup. > > https://issues.apache.org/jira/browse/INFRA-17367 > > I will keep you updated when ready. > > > > On Tue, Dec 4, 2018 at 10:12 PM Driesprong, Fokko > wrote: > > > > > > Definitely, th

Re: Status of 1.9....

2019-03-06 Thread Driesprong, Fokko
an MG : > Hi Fokko, > Thank you for your effort. I can work with you to the release done. > Let's plan the tasks and execute them between us. > Thank you, > Thiru > On Monday, 4 February, 2019, 2:20:38 PM IST, Driesprong, Fokko > wrote: > > I'll go through

Feature freeze Apache Avro 1.9

2019-03-26 Thread Driesprong, Fokko
Hi all, I'd like to cut the branch for Apache Avro 1.9 release this Friday, and start moving to a release candidate so we can test. If there are any features that you would like to get in, please let me know. Cheers, Fokko

Re: Automatic formatting of Java code

2019-03-29 Thread Driesprong, Fokko
Thanks Ismaël for taking the effort to get this in. This will add some additional work now, but it will make it easier in the long run because we will have less merge conflicts. Op di 26 mrt. 2019 om 15:57 schreef Ismaël Mejía : > Hello, > > As part of the changes for the upcoming 1.9.0 version.

Re: Feature freeze Apache Avro 1.9

2019-03-29 Thread Driesprong, Fokko
for the > > default, I believe private is what we want. > > > > While those will increase the effort to migrate from 1.8 to 1.9, I think > > it’s better to do that now than waiting any longer. > > > > Thoughts? > > Dan > > > > > > > On

Re: Feature freeze Apache Avro 1.9

2019-04-09 Thread Driesprong, Fokko
Hi Ivan, Thanks for the input. Personally, I'm not using the UUID at all. Any comments on it Ryan? Since it isn't introduced in any release, we could remove it if there is a consensus if it doesn't add any value to the Avro format. Apart from that, I did some testing last week on some internal pr

[VOTE] Release Apache Avro 1.9.0 RC1

2019-04-26 Thread Driesprong, Fokko
Hi everyone, Since the last release of Apache Avro 1.8.2 on May 31, 2017. Two years later, I'm thrilled to propose the following RC to be released as official Apache Avro 1.9.0 release. The commit id is 4607730012293fe1e58957760e8f7b5474abd408 * This corresponds to the tag: release-1.9.0-rc1 * ht

Re: [VOTE] Release Apache Avro 1.9.0 RC1

2019-04-28 Thread Driesprong, Fokko
ker-test", and not sure why. If I just run maven outside > of > > docker it runs fine. Also not something to block a release, but a bit > > strange. > > > > Anyway, +1 as I don’t see either of them as a blocker. > > > > Dan > > > > > >

[VOTE] Release Apache Avro 1.9.0 RC2

2019-04-29 Thread Driesprong, Fokko
Hi everyone, Since the last release of Apache Avro 1.8.2 on May 31, 2017. Two years later, I'm thrilled to propose the following RC to be released as official Apache Avro 1.9.0 release. The commit id is 8dbe05a17363a1281482e8611cfead4c04645f47 * This corresponds to the tag: release-1.9.0-rc2 * ht

Re: [VOTE] Release Apache Avro 1.9.0 RC2

2019-04-29 Thread Driesprong, Fokko
> This is a change that happened probably like 1y ago but since it has > been long > > since Avro's latest release we need to upgrade the scripts to produce the > > suggested checksums. > > > > On Mon, Apr 29, 2019 at 12:57 PM Driesprong, Fokko > wrote: > &

Re: [VOTE] Release Apache Avro 1.9.0 RC2

2019-04-30 Thread Driesprong, Fokko
Thanks Daniel for updating the build scripts. Canceling the vote due to SHA1/MD5 checksums. Cheers, Fokko Op ma 29 apr. 2019 om 20:14 schreef Driesprong, Fokko : > Thanks for bringing this up Ismaël. Let me update the checksums. > > Cheers, Fokko > > Op ma 29 apr. 2019 om 19:49

[VOTE] Release Apache Avro 1.9.0 RC3

2019-04-30 Thread Driesprong, Fokko
Hi everyone, Since the last release of Apache Avro 1.8.2 on May 31, 2017. Two years later, I'm thrilled to propose the following RC to be released as official Apache Avro 1.9.0 release. The commit id is 24ff48c32d8d13433a1e31e485ef2af187d1eb62 * This corresponds to the tag: release-1.9.0-rc3 * ht

Re: [VOTE] Release Apache Avro 1.9.0 RC3

2019-05-01 Thread Driesprong, Fokko
gt; > On Tue, Apr 30, 2019 at 4:50 PM Ismaël Mejía wrote: > > > > Sorry, playing the killjoy again. > > > > It seems the files (and more critical the poms) still have the -SNAPSHOT > suffix. > > Also the comment of Dan Kulp about the extra directory structure in &g

Re: [VOTE] Release Apache Avro 1.9.0 RC3

2019-05-06 Thread Driesprong, Fokko
gt; > > wrote: > > > > > > > Hi all, > > > > > > > > I just managed to test the new RC, specifically the Java code > > > generation, > > > > with one of the libraries we use. I

Re: Python 3 support

2019-05-06 Thread Driesprong, Fokko
+1 from my side Thanks Michael for reviving this thread again. Since 3.4 isn't officially supported anymore, I think it is save to drop support for Avro 1.9 as well to speed up the deprecation process. In practice it will still work against 3.4 until we start using breaking features such as type a

[VOTE] Release Apache Avro 1.9.0 RC4

2019-05-08 Thread Driesprong, Fokko
Hi everyone, Since the last release of Apache Avro 1.8.2 on May 31, 2017. Two years later, I'm thrilled to propose the following RC to be released as official Apache Avro 1.9.0 release. The commit id is 3c76495e9524ef322726d03d7ee406be89e8fde0 * This corresponds to the tag: release-1.9.0-rc4 * ht

Re: Python 3 support

2019-05-08 Thread Driesprong, Fokko
Michael, after some careful thoughts I think it is too late to remove 3.4 support in Avro 1.9 since we're passed RC3. I've updated the tickets to target this for 1.10. Cheers, Fokko Op ma 6 mei 2019 om 10:32 schreef Driesprong, Fokko : > +1 from my side > > Thanks Michae

Re: [VOTE] Release Apache Avro 1.9.0 RC4

2019-05-14 Thread Driesprong, Fokko
26 > > > Total source compatibility problems: 160, warnings: 4 > > > Report: compat_reports/apache > avro/1.8.2_to_1.9.0-rc4/compat_report.html > > > > The report is here: > > > > > > > http://people.apache.org/~busbey/avro/1.9.0-RC4/1.8.2_to_

Re: [VOTE] Release Apache Avro 1.9.0 RC4

2019-05-15 Thread Driesprong, Fokko
n earlier RC? > > https://repo1.maven.org/maven2/org/apache/avro/avro/1.9.0/ > > Would it be helpful to have maven include the git sha somewhere in > MANIFEST.MF? > > jacob > > On Tue, May 14, 2019 at 1:04 PM Driesprong, Fokko > wrote: > > > Thank you

Re: [VOTE] Release Apache Avro 1.9.0 RC4

2019-05-15 Thread Driesprong, Fokko
https://issues.apache.org/jira/browse/SPARK-27733 for the moment. > > I am tackling the upgrade on Beam (the other project I work mostly on too. > https://issues.apache.org/jira/browse/BEAM-7328 > > Any other project worth the sync/work? > > > On Wed, May 15, 2019 at 8:54

Re: [VOTE] Release Apache Avro 1.9.0 RC4

2019-05-16 Thread Driesprong, Fokko
do to help there > > or that we can sync work? > > I filled https://issues.apache.org/jira/browse/SPARK-27733 for the > moment. > > > > I am tackling the upgrade on Beam (the other project I work mostly on > too. > > https://issues.apache.org/jira/browse/BEAM-7328 > &g

Re: Getting Avro 1.9 into downstream Apache projects

2019-05-16 Thread Driesprong, Fokko
Thanks Doug, My username for both PyPi and Rubygems is Fokko. Also, feel free to push yourself :-) Cheers, Fokko Op do 16 mei 2019 om 19:50 schreef Doug Cutting : > I'm happy to push these myself, or better yet, permit others. > > Please send me PyPi and rubygems.org usernames to add. > > Thank

Re: [VOTE] Release Apache Avro 1.9.0 RC4

2019-05-19 Thread Driesprong, Fokko
https://issues.apache.org/jira/browse/AVRO-2383 which should all have > > > been fixed. > > > > > > Looking at the avro-compiler.jar, all the class files are dated Apr 26 > > > 9:32 EDT, which is before some of those issues were even reported. > > > > &g

Re: [VOTE] Release Apache Avro 1.9.0 RC4

2019-05-21 Thread Driesprong, Fokko
ttps://www.apache.org/dyn/closer.cgi/avro/ > > On Sun, May 19, 2019 at 6:59 PM Driesprong, Fokko > wrote: > > > > Can you elaborate Raman? How did you confirm that it isn't the latest > > version? > > > > Thanks for the heads-up Rumeshkrishnan, I'll chec

Re: [VOTE] Release Apache Avro 1.9.0 RC4

2019-05-24 Thread Driesprong, Fokko
nounce. > > > > > > [1] > https://search.maven.org/artifact/org.apache.avro/avro/1.9.0/bundle > > > > > > On Tue, May 21, 2019 at 2:47 PM Driesprong, Fokko > > > wrote: > > > > > > > > My mistake. I've removed the 1.8.2 ver

[Announce] Release of Apache Avro 1.9.0

2019-05-24 Thread Driesprong, Fokko
Since the last release of Apache Avro 1.8.2 on May 31, 2017. Two years later, I'm thrilled to announce the release of Avro 1.9.0! Changes are listed at https://s.apache.org/avro190 A list of highlights of the new version: https://blog.godatadriven.com/apache-avro-1-9-release This release can be d

Re: Automate python formatting

2019-05-28 Thread Driesprong, Fokko
Thanks, Michael for working on this. I think having an auto formatter for Python is valuable since it will decrease the conflicts in the future. For now, we need to do a big PR to get all the files in the correct format. We need to add to the CI: black --check --diff . This will throw a non-zero e

Re: Automate python formatting

2019-05-28 Thread Driesprong, Fokko
f technically is possible, there could be an > authorship issue to be discussed. Can bots sign an ICLA :D living in > the future mates! > > On Tue, May 28, 2019 at 10:01 AM Driesprong, Fokko > wrote: > > > > Thanks, Michael for working on this. I think having an auto formatter

Re: Automate python formatting

2019-05-29 Thread Driesprong, Fokko
uld use pycodestyle > instead of black. I'll change course to work on that. > > On Tue, May 28, 2019 at 5:24 AM Driesprong, Fokko > wrote: > > > Fully agree with you Ismaël. > > > > > > The issue is that it CAN write directly. For example here: >

Re: [ANNOUNCE] Please welcome Ismaël Mejía to the Apache Avro PMC

2019-06-10 Thread Driesprong, Fokko
Congrats, welcome Ismaël! Op di 11 jun. 2019 om 07:02 schreef Niels Basjes > Welcome! > > On Tue, 11 Jun 2019, 00:01 Brian Lachniet, wrote: > >> Congratulations, Ismaël! >> >> On Mon, Jun 10, 2019 at 5:48 PM Jesse Anderson >> wrote: >> >>> Congrats! >>> >>> On Mon, Jun 10, 2019, 4:41 PM Sean B

Re: Avro C#: Target .NET Standard Only

2019-06-14 Thread Driesprong, Fokko
Hi Brian, Do we have something like the number of downloads? To measure how much this is still being used. I haven't touched a Windows machine in a couple of years, so for me, it isn't super relevant. There are some different opinions on if this is breaking or not. At the Parquet project, we had

Re: Consider Python < 2.7 obsolete

2019-06-25 Thread Driesprong, Fokko
I'm not sure how much effort we should put into Python2.7 in general, since this version is EOL after this year. Cheers, Fokko Op ma 24 jun. 2019 om 03:20 schreef Michael A. Smith : > There's some not-insignificant complexity in the lang/py codebase to > support derelict versions of Python. Ther

Re: sharp edges on moving to 1.9.0

2019-06-25 Thread Driesprong, Fokko
Hi Sean, Thanks for picking this up right away. I think we should see if we can fix the snappy issue. What kind of throwable are you seeing? A few things have been updated. *Deprecate Joda-Time in favor of Java8 JSR310* Right now Avro uses JSR310 (Java8) Time by default and replaces the Joda ti

Re: Should a Schema be serializable in Java?

2019-07-15 Thread Driesprong, Fokko
Correct me if I'm wrong here. But as far as I understood the way of serializing the schema is using Avro, as it is part of the file. To avoid confusion there should be one way of serializing. However, I'm not sure if this is worth the hassle of not simply implementing serializable. Also Flink ther

Release 1.9.1

2019-07-18 Thread Driesprong, Fokko
Hi all, I would like to start on the release of Apache Avro 1.9.1. With the 1.9.0 we've released regression which blocks some projects from upgrading to the new 1.9 branch. Where AVRO-2400 is the major issue. This same issue also appears while updat

Re: Run C# Tests on Windows in Travis

2019-07-22 Thread Driesprong, Fokko
Thanks for contributing Brian, I have very little knowledge of Windows, but as far as I can tell it looks good. I do see a lot of warnings in the output, but this can be fixed in another PR. Cheers, Fokko Op za 20 jul. 2019 om 17:17 schreef Brian Lachniet : > There have been a few recent "close

[VOTE] Release Apache Avro 1.9.1 RC1

2019-08-20 Thread Driesprong, Fokko
Hi everyone, I'm delighted to propose the following RC to be released as official Apache Avro 1.9.1 release. The commit id is aad028bf84d43cc3481ac8b527f30debbdf213d2 * This corresponds to the tag: release-1.9.1-rc1 * https://github.com/apache/avro/releases/tag/release-1.9.1-rc1 The release tarb

Re: [VOTE] Release Apache Avro 1.9.1 RC1

2019-08-20 Thread Driesprong, Fokko
est/resources/org/apache/avro/mapreduce/mapreduce-test-input.avro/SUCCESS.crc > > In the tar that doesn’t seem to be in the git repo. It’s causing a > problem with RAT since there isn’t a license header or anything. I’m not > sure where that file came from. > > > Dan > > >

Re: [VOTE] Release Apache Avro 1.9.1 RC1

2019-08-21 Thread Driesprong, Fokko
ools/1.9.1-rc1> to > nuget.org. > > On Tue, Aug 20, 2019 at 3:44 PM Driesprong, Fokko > wrote: > > > Thanks, Dan for giving it a try. My mistake, this file comes from the > > test-suite. I'll clean up the repo and publish a new package. > > > > Cheers

Re: [VOTE] Release Apache Avro 1.9.1 RC1

2019-08-22 Thread Driesprong, Fokko
pache.org/jira/browse/AVRO-2517 > > On Wed, Aug 21, 2019 at 11:22 AM Driesprong, Fokko > wrote: > > > > Thank you Brian, > > > > I'm canceling the RC1 and I'm doing some checks on the 1.9 branch. Seeing > > some funky stuff with the RAT checker. I

Re: [ANNOUNCE] Please welcome Brian Lachniet to the Apache Avro PMC

2019-08-24 Thread Driesprong, Fokko
Congrats Brian! Well deserved! Cheers, Fokko Op za 24 aug. 2019 om 18:57 schreef Niels Basjes > Welcome aboard > > On Sat, Aug 24, 2019, 17:40 Sean Busbey wrote: > > > Hi folks! > > > > On behalf of the Apache Avro PMC I am pleased to announce that Brian > > Lachniet has accepted our invitatio

[VOTE] Release Apache Avro 1.9.1 RC2

2019-08-26 Thread Driesprong, Fokko
Hi everyone, I'm delighted to propose the following RC to be released as official Apache Avro 1.9.1 release. The commit id is aa9abbabd0efca5d86d33a1db74dcbb36203f607 * This corresponds to the tag: release-1.9.1-rc2 * https://github.com/apache/avro/releases/tag/release-1.9.1-rc2 The release tarb

Re: [VOTE] Release Apache Avro 1.9.1 RC2

2019-08-28 Thread Driesprong, Fokko
rote: > > > > > +1 > > > > > > Did a bunch of testing with the java stuff on my Mac and some minor > > > testing with the other languages in Docker. Looks OK. > > > > > > Dan > > > > > > > > > > > > &g

[VOTE] Release Apache Avro RC3

2019-08-28 Thread Driesprong, Fokko
Hi everyone, I'm delighted to propose the following RC to be released as official Apache Avro 1.9.1 release. The commit id is 89218262cde62e98fcb3778b86cd3f03056c54f3 * This corresponds to the tag: release-1.9.1-rc3 * https://github.com/apache/avro/releases/tag/release-1.9.1-rc3 The release tarb

Re: [Announce] Please welcome Nándor Kollár to the Apache Avro PMC

2019-08-31 Thread Driesprong, Fokko
Welcome Nándor, great to have you on the PMC! 👍 Op za 31 aug. 2019 om 09:20 schreef Niels Basjes : > Welcome! > > On Fri, Aug 30, 2019, 23:39 Brian Lachniet wrote: > > > Congratulations, Nándor! > > > > On Fri, Aug 30, 2019, 5:37 PM Sean Busbey wrote: > > > >> Hi folks! > >> > >> On behalf of t

Re: [VOTE] Release Apache Avro RC3

2019-09-02 Thread Driesprong, Fokko
> > > On Aug 28, 2019, at 6:05 AM, Driesprong, Fokko > wrote: > > > > Hi everyone, > > > > I'm delighted to propose the following RC to be released as official > Apache > > Avro 1.9.1 release. > > > > The commit id is 89218262cde6

Re: [VOTE] Release Apache Avro RC3

2019-09-02 Thread Driesprong, Fokko
I've released the artifacts for Python2, Python3, Ruby, Javascript and Java. I'm not experienced with Perl or C(++) anyone who's comfortable doing this? Brian, could you publish the C# artifacts? Thanks all! Cheers, Fokko Op ma 2 sep. 2019 om 09:27 schreef Driesprong, Fokko :

Re: [DISCUSS] version numbers and where changes should land

2019-09-13 Thread Driesprong, Fokko
Thanks Sean for bringing this up. For the 1.9 branch there were some incompatible changes in the API with respect to 1.8.2. We've removed Jackson and Netty from the public API. This is actually breaking some of the builds

Re: DRAFT ASF Board Report - Apache Avro October 2019

2019-10-09 Thread Driesprong, Fokko
Looks great Sean, thanks for taking care of this. Great to see that Avro is getting more traction again. Cheers, Fokko Op wo 9 okt. 2019 om 17:07 schreef Niels Basjes : > LGTM. > +1 > > On Wed, 9 Oct 2019, 16:06 Sean Busbey, wrote: > > > I went ahead and posted the report, with one minor chang

Re: [ANNOUNCE] new committer Michael Smith

2019-10-20 Thread Driesprong, Fokko
Welcome Michael, great to have you as a committer. You've done some awesome work on the Python part of Avro! Cheers, Fokko Op zo 20 okt. 2019 om 10:17 schreef Nándor Kollár : > Congrats, welcome Michael on board! > > On 2019/10/20 03:20:14, Sean Busbey wrote: > > Hi folks! > > > > I'm very plea

Re: Autolink to JIRA from GitHub

2019-10-22 Thread Driesprong, Fokko
Hi Michael, Thanks for pointing that out. Looks great to have this on the project. After looking in the INFRA Jira, I found the following: https://jira.apache.org/jira/browse/INFRA-19271 It looks like they are trying to configure the autolink. My suggestion would be to follow that ticket, and see

Re: Preserving defaults in canonical form schema record fields

2019-11-04 Thread Driesprong, Fokko
Thanks for bringing this up Michael, At my current project, I've bumped into this one as well. We're trying to build a schema registry and take the fingerprint from the canonical schema in order to check if something changed. The issue here is that the canonical schema takes the minimal schema tha

Re: Consider Python < 2.7 obsolete

2019-12-01 Thread Driesprong, Fokko
or our latest > >>>>> release of this year so probably 1.9.x or eventually 1.10.x. > >>>> > >>>> > >>>> i agree wholeheartedly, but only python 2.7. > >>>> > >>>> I am not at all familiar with our pyth

New Committer: Ryan Skraba

2019-12-17 Thread Driesprong, Fokko
Folks, The Project Management Committee (PMC) for Apache Avro has invited Ryan Skraba to become a committer and we are pleased to announce that he has accepted. Ryan is actively fixing bugs by providing patches and reviewing pull requests by others. We're very happy to have him on board. Being a

Re: Unified Python Support

2020-01-05 Thread Driesprong, Fokko
Thanks for bringing this up Michael and an awesome job on the Python part. I'd suggest stopping releasing the avro-python3, and continue only releasing the avro package itself: https://pypi.org/project/avro/ This will stop the releases of avro-python3, and in time we can also remove it from the g

Re: Unified Python Support

2020-01-06 Thread Driesprong, Fokko
y. > > After that we should officially close out support for python 2. > > Please let me know how I can help with the release process. Should we have > a release soon? > > On Sun, Jan 5, 2020 at 13:31 Driesprong, Fokko > wrote: > > > Thanks for bringing this up

Avro 1.9.2

2020-01-09 Thread Driesprong, Fokko
Hi all, I'm working on bumping Apache Avro on the Apache Iceberg project: https://github.com/apache/incubator-iceberg/pull/297, I've discovered a regression bug. I've managed to create a unit test that catches the issue: https://github.com/apache/avro/pull/752. The current fix isn't the correct on

Re: Avro 1.9.2

2020-01-11 Thread Driesprong, Fokko
nd-holding for this first time, but the doc looks > pretty complete. Alternatively, if it's easier, I could shadow > whoever is doing this one and be ready for the next. It's pretty > exciting to see the cadence pick up for Avro! > > All my best, Ryan > > On Thu, Jan

Re: Avro 1.9.2

2020-01-13 Thread Driesprong, Fokko
rently just in master. It would be great if someone could cherry pick > them. I'm away this weekend, but happy to help via phone or more directly > next week if it turns complex. > > Best regards, > Mike > > On Sat, Jan 11, 2020 at 07:39 Driesprong, Fokko > wrote: >

Re: Avro 1.9.2

2020-01-26 Thread Driesprong, Fokko
lity directly, but if I skip them I don't think the > > tests > > > > can pass. > > > > > > > > Does anyone with a better understanding of the 1.9 chronology want to > > give > > > > it a shot? > > > > > > > &g

Re: Including "fastavro" in release 1.9.2

2020-02-02 Thread Driesprong, Fokko
Sounds like a plan to me. I don't have any objections. In the far future, I'd like to merge these readers, otherwise, you'll end up with many configuration permutations. This makes it challenging to test each permutation. But first having it as an option in 1.9 is a good idea, so we can battle tes

Re: [VOTE] Release Apache Avro 1.9.2 RC1

2020-02-06 Thread Driesprong, Fokko
Thanks Ryan for taking care of this. Unfortunately, I have to give a -1 (binding) to the RC. It turns out that AVRO-2663 wasn't properly cherry-picked. I've tried to run Avro against Iceberg, and the tests failed. It turned out that only the first commit of the PR was being cherry-picked onto the

Re: [VOTE] Release Apache Avro 1.9.2 RC2

2020-02-10 Thread Driesprong, Fokko
Thanks again Ryan for running the release. +1 (binding) Did the following: - Verified the keys - Verified the hashes - Ran the tests - Ran the testsuite of Iceberg against Avro 1.9.2 Cheers, Fokko Op vr 7 feb. 2020 om 11:47 schreef Ryan Skraba : > Hi everyone, > > I'd like to pr

Re: [ANNOUNCE] Apache Avro 1.9.2 released

2020-02-17 Thread Driesprong, Fokko
Awesome, thanks Ryan for running the release! Cheers, Fokko Op do 13 feb. 2020 om 16:27 schreef Ryan Skraba : > The Apache Avro community is pleased to announce the release of Avro 1.9.2! > > The link to all fixed JIRA issues and a brief summary can be found at: > https://github.com/apache/avro/

Re: Viewing Test Results

2020-02-17 Thread Driesprong, Fokko
Thanks for brining this up Michael, This was on my plate if I'm not mistaken. I've just commented on the INFRA ticket. I'll monitor the ticket, and see what comes out of it. Cheers, Fokko Op zo 16 feb. 2020 om 20:06 schreef Michael A. Smith : > A while back I opened > https://issues.apache.org/

Re: Upgrade Avro dependency in Spark to 1.9.2

2020-02-17 Thread Driesprong, Fokko
Awesome work Ismaël, let me know if I can help somewhere. Chees, Fokko Op ma 17 feb. 2020 om 16:00 schreef Ismaël Mejía : > I had not tried to do the upgrade Spark since I assumed it will fail > because of the transitive dependencies of Hive. > > But I decided to give it a shot today. Luckily th

Re: Documenting optional, noncompliant behavior for compatibility

2020-02-24 Thread Driesprong, Fokko
Hi Michael, A logical place for me would be the docs. In this case, I would document the options in the PythonDoc and then use a tool to generate the docs. We can then make this part of the website: https://avro.apache.org/docs/1.9.2/ This is similar to what we've done in the past for Java/C/C# e

Re: [DISCUSS] version numbers and where changes should land

2020-03-02 Thread Driesprong, Fokko
ng the prefix for the "specification version" and > > > calling it Avro 10.x > > > > > > 2) committing to semantic versioning for future releases > > > > > > I can see this being a hugely positive move for aligning with the > > > expectations of develo

Re: Append to existing file in C#

2020-04-04 Thread Driesprong, Fokko
Hi Vladimir, Please feel free to open a ticket (https://jira.apache.org/jira) and a PR if you want feedback on the implementation. Try to make the PR's small to make the reviewing easier :) Cheers, Fokko Op zo 29 mrt. 2020 om 14:51 schreef Volodymyr Aleksandrov : > Hello, > > Want to propose to

Re: Proposal: RFCs for Avro 2.x

2020-04-26 Thread Driesprong, Fokko
Hi Andy, Thanks for reaching out. Sorry for not being so active in the community lately. Since Avro 1.8.2 there has been some activity on the repository again, fixing stuff like security issues and migrating to later versions of Java. Avro has been around for 10 years now, and I would like to kee

Re: Proposal: RFCs for Avro 2.x

2020-05-03 Thread Driesprong, Fokko
s to a separate repo brings many of the same > > > problems as versioning artifacts separately (nobody wants to deal with > > > a compatibility matrix). I'm definitely not against it, but I'm not > > > sure how it would improve the situation. > > > > &

Re: When and how should we remove lang/py3?

2020-05-03 Thread Driesprong, Fokko
Hi Mchael, Thank you for bringing this up. I agree, but I'm not sure how we're going to migrate the users to the avro package. Rijprojectnum_downloads 1 avro 885838 2 avro-python3 147313 A quick query on bigquery, that contains all the pypi downloads shows that the python3 package is more popula

  1   2   >