Hi,
I noticed that *-sources.jar also have *.{so,dylib,dll}.
e.g.:
https://nightlies.apache.org/arrow/java/org/apache/arrow/arrow-gandiva/12.0.0-SNAPSHOT/arrow-gandiva-12.0.0-SNAPSHOT-sources.jar
We can remove them from *-sources.jar. We can reduce 150MB
by removing them.
Thanks,
--
kou
In <canva0dizufet53fwgvknu9p2q0tujzmxytzj3e9tiw-2wzj...@mail.gmail.com>
"Re: Reason behind using Apache Nightlies directory instead of Apache Nexus
Snapshot Repository" on Wed, 8 Feb 2023 19:21:40 +0100,
Jacob Wujciak <ja...@voltrondata.com.INVALID> wrote:
> Yes the java nightlies alone are 450mb.
>
> Without checking this could be due to JNI bundling the c++ binary multiple
> times? Also there are quite a large number of java artifacts but I have no
> deeper knowledge about that outside of the CI involved :D
>
> Matthew Benedict de Detrich <matthew.dedetr...@aiven.io.invalid> schrieb am
> Mi., 8. Feb. 2023, 17:51:
>
>> > If we use the snapshot repository, can we simplify this?
>>
>> https://arrow.apache.org/docs/dev/developers/java/building.html#installing-nightly-packages
>>
>> Yes, in fact you can just defer the documentation to
>> https://infra.apache.org/repository-faq.html#basic
>>
>> On Wed, Jan 25, 2023 at 9:28 PM Sutou Kouhei <k...@clear-code.com> wrote:
>>
>> > Hi,
>> >
>> > Wow! I didn't know the snapshot repository!
>> >
>> > If we use the snapshot repository, can we simplify this?
>> >
>> >
>> https://arrow.apache.org/docs/dev/developers/java/building.html#installing-nightly-packages
>> >
>> > Then, let's use the snapshot repository instead of
>> > https://nightlies.apache.org/ .
>> >
>> >
>> > Thanks,
>> > --
>> > kou
>> >
>> > In <calj5v6o7zho_b+sc5pto250xb+8gewrl0hsyc_woev-zt+j...@mail.gmail.com>
>> > "Reason behind using Apache Nightlies directory instead of Apache Nexus
>> > Snapshot Repository" on Wed, 25 Jan 2023 10:37:35 +0100,
>> > Matthew Benedict de Detrich <matthew.dedetr...@aiven.io.INVALID>
>> wrote:
>> >
>> > > Hello Arrow community!
>> > >
>> > > I am coming from the Apache Pekko community where we are trying to
>> > > bootstrap the newly approved incubator project. Currently we are
>> working
>> > on
>> > > snapshots/nightlies, specifically where to upload them and also the
>> > process
>> > > of generating the snapshots (i.e. nightly, after merge into main etc
>> > etc).
>> > >
>> > > As of now we are uploading into Apache nightlies (i.e.
>> > > https://nightlies.apache.org/ with PR
>> > > https://github.com/apache/incubator-pekko/pull/60) and the method of
>> > > uploading was actually derived from Apache Arrow. However after further
>> > > cursory investigation I found out that Apache Arrow seems to be the
>> > > only Apache project that seems to upload snapshots into
>> > > https://nightlies.apache.org/. Every other project uploads snapshots
>> > into
>> > > Apache's Nexus snapshot repository (i.e.
>> > > https://repository.apache.org/content/groups/snapshots/) and after
>> > > discussion with Apache's #askinfra slack channel, they also recommend
>> > that
>> > > any JVM library snapshot artifacts be published to this Nexus Snapshot
>> > > Repository.
>> > >
>> > > So the question is, is there a reason why this project is uploading
>> > > snapshot jars into the nightlies? The only technical reason I can come
>> up
>> > > with is that with nightlies you have control over the expiry (i.e.
>> > setting
>> > > it to 30 days), whereas with Apache's Snapshot Repo there is a default
>> > > global job that cleans snapshots. Pekko is currently considering
>> > uploading
>> > > to Apache's Nexus Snapshot Repo instead of nightlies but I want to make
>> > > sure we haven't missed anything, for context of the discussion in pekko
>> > see
>> > > https://lists.apache.org/thread/p5s8ysypyd2l2slb3o9f2v5vrf8dgsx8.
>> > >
>> > > Many thanks
>> > >
>> > > --
>> > >
>> > > Matthew de Detrich
>> > >
>> > > *Aiven Deutschland GmbH*
>> > >
>> > > Immanuelkirchstraße 26, 10405 Berlin
>> > >
>> > > Amtsgericht Charlottenburg, HRB 209739 B
>> > >
>> > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>> > >
>> > > *m:* +491603708037
>> > >
>> > > *w:* aiven.io *e:* matthew.dedetr...@aiven.io
>> >
>>
>>
>> --
>>
>> Matthew de Detrich
>>
>> *Aiven Deutschland GmbH*
>>
>> Immanuelkirchstraße 26, 10405 Berlin
>>
>> Amtsgericht Charlottenburg, HRB 209739 B
>>
>> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>>
>> *m:* +491603708037
>>
>> *w:* aiven.io *e:* matthew.dedetr...@aiven.io
>>
