Admittedly this is potentially self-serving, but I feel there could be
mutual benefit.

I have a similar situation where I want to use pre-release version of
beam-sdks-java-io-google-cloud-platform. Though I’ve been having trouble
doing so, a possible alternative solution to using the nightly snapshots
might be building beam-sdks-java-io-google-cloud-platform from source and
including the resulting jar as part of the pipeline deployment. I’ve
successfully done this for direct runner, but not Dataflow runner.

Perhaps some others on the thread might be able to shed light on this
technique (only if applicable to solving the original problem, as I don’t
intend to thread-hijack).

- Evan

On Thu, Jul 21, 2022 at 19:45 Byron Ellis via dev <dev@beam.apache.org>
wrote:

> I think you could change the TTL on the Jenkins side (That sound right to
> you Danny?) but I'm not sure we could preserve a specific snapshot without
> keeping all of them...
>
> On Thu, Jul 21, 2022 at 4:16 PM Ahmet Altay <al...@google.com> wrote:
>
>> Thank you for the email Daniel.
>>
>> Adding people who could help: @Kenneth Knowles <k...@google.com> @Danny
>> McCormick <dannymccorm...@google.com> @Chamikara Jayalath
>> <chamik...@google.com> @John Casey <johnjca...@google.com> @Byron Ellis
>> <byronel...@google.com>
>>
>> On Thu, Jul 21, 2022, 4:14 PM Daniel Thevessen via dev <
>> dev@beam.apache.org> wrote:
>>
>>> Hi all,
>>>
>>> The Java Firestore connector had a bug
>>> <https://github.com/apache/beam/issues/22089> recently that needed to
>>> be fixed. Until the fix can be released as part of 2.41.0, we need one of
>>> the daily snapshot builds
>>> <https://repository.apache.org/content/groups/snapshots/org/apache/beam/beam-sdks-java-io-google-cloud-platform/2.41.0-SNAPSHOT/>
>>> as a safe version to use. This is the one from Jul 15
>>> (2.41.0-20220715.201105-31), which we have checked to be working correctly
>>> and some have already switched to.
>>> Unfortunately it looks like these builds get cleared out after a while
>>> for storage reasons. Would it be possible to extend the TTL on just that
>>> build, at least until 2.41.0 is released? I'm guessing this would just be a
>>> settings change for whoever owns the Snapshots repository.
>>> The change is in beam-sdks-java-io-google-cloud-platform, but I'm
>>> fairly certain the other Java packages need to be kept as well for
>>> compatibility.
>>>
>>> This is relatively urgent, it looks like the TTL might be weekly so that
>>> build will be deleted on Saturday.
>>>
>>> Thanks,
>>> Daniel Thevessen
>>>
>>>
>>>

Reply via email to