Hey Jurek, Just a question about the future development, is the XComm backend replaceable now? The real power of Airflow is the 'defacto' the glue between different ways of mangling data, such as Python is the glue when you need to implement things a lower level, ie. Altair Simulation software is written for critical parts in C++ and binded at upper level in Python. Same we can state for Tensorflow, numpy. About my question: it would be nice to have as XComm backend a queue like redis or a non structured database for allowing scaling but i am not sure it it makes sense since XComm is just for short messages. Best Regards, Giorgio
- Re: [DISCUSSION] Specify tasks to skip wh... Daniel Standish
- Re: [DISCUSSION] Specify tasks to skip wh... Daniel Standish
- Re: [DISCUSSION] Specify tasks to skip wh... Daniel Standish
- Re: [DISCUSSION] Specify tasks to skip wh... James Coder
- Re: [DISCUSSION] Specify tasks to skip wh... Jarek Potiuk
- Re: [DISCUSSION] Specify tasks to skip wh... James Coder
- Re: [DISCUSSION] Specify tasks to skip wh... Hongyi Wang
- Re: [DISCUSSION] Specify tasks to skip wh... Jarek Potiuk
- Re: [DISCUSSION] Specify tasks to skip wh... Xiaodong Deng
- Re: [DISCUSSION] Specify tasks to skip wh... Daniel Standish
- Re: [DISCUSSION] Specify tasks to skip wh... Giorgio Zoppi
- Re: [DISCUSSION] Specify tasks to skip wh... Jarek Potiuk
- Re: [DISCUSSION] Specify tasks to skip wh... Hongyi Wang
- Re: [DISCUSSION] Specify tasks to skip wh... Jarek Potiuk
- Re: [DISCUSSION] Specify tasks to skip wh... Daniel Standish
- Re: [DISCUSSION] Specify tasks to skip wh... Daniel Standish
- Re: [DISCUSSION] Specify tasks to skip wh... Jarek Potiuk
- Re: [DISCUSSION] Specify tasks to skip when triggering DAG Hongyi Wang