Getting logs when remote logging is enabled

2025-03-08 Thread Akash Sharma
Hello everyone, Whenever remote logging is enabled, logs are only uploaded to the target path once the tasks have been completed. This makes it harder to monitor tasks that are long-running since there is no means to getting the logs. I was working on a Handler that saves the chunked logs where c

Re: Getting logs when remote logging is enabled

2025-03-08 Thread Jens Scheffler
Hi Akash, so for remote logging logs still can be sourced from the worker via the web server if the endpoint hosted for this is reachable. Web server attempts to source the logs from worker or local file system if not found on remote. This is the standard for Celery for example. Alternatively a s

Re: Getting logs when remote logging is enabled

2025-03-08 Thread Akash Sharma
Hi Jens, The point here is that the solution should be setup agnostic i.e whether the tasks are being run in CeleryExecutor, K8sExecutor, or CeleryK8sOperator etc.. or whether the executors are reachable by the web server or not. Best regards, Akash On Sat, Mar 8, 2025 at 11:14 PM Jens Scheffler

Re: [DISCUSS] New Provider for Gremlin

2025-03-08 Thread Paul King
Nice to see the Apache TinkerPop/Gremlin support. As well as using Gremlin with TinkerPop's TinkerGraph, I have also used it with OrientDB, ArcadeDB, and Apache HugeGraph. If anyone is interested, I did a blog post here: https://groovy.apache.org/blog/groovy-graph-databases (Sorry but it's Gro

Re: [DISCUSS] New Provider for Gremlin

2025-03-08 Thread Ahmad Farhan
Hi! I managed to do the last cleanup on the PR, and is ready for thorough review. I will create a `[LAZY CONSENSUS]` thread on Monday/Tuesday. Feel free to review and comment on the PR in the meantime. Farhan On Thu, Mar 6, 2025 at 1:40 PM Stephen Mallette wrote: > Hi Ahmad, thanks for the upd