We also use both Zeppelin and Airflow. I'm interested in hearing what others are doing here too.
Although honestly there might be some challenges - Airflow expects a DAG structure, while a notebook has pretty linear structure; - Airflow is Python-based; Zeppelin is all Java (REST API might be of help?). Jupyter+Airflow might be a more natural fit to integrate? On top of that, the way we use Zeppelin is a lot of ad-hoc queries, while Airflow is for more finalized workflows I guess? Thanks for bringing this up. -- Ruslan Dautkhanov On Fri, May 19, 2017 at 2:20 PM, Ben Vogan <b...@shopkick.com> wrote: > Hi all, > > We are really enjoying the workflow of interacting with our data via > Zeppelin, but are not sold on using the built in cron scheduling > capability. We would like to be able to create more complex DAGs that are > better suited for something like Airflow. I was curious as to whether > anyone has done an integration of Zeppelin with Airflow. > > Either directly from within Zeppelin, or from the Airflow side. > > Thanks, > -- > *BENJAMIN VOGAN* | Data Platform Team Lead > > <http://www.shopkick.com/> > <https://www.facebook.com/shopkick> <https://www.instagram.com/shopkick/> > <https://www.pinterest.com/shopkick/> <https://twitter.com/shopkickbiz> > <https://www.linkedin.com/company-beta/831240/?pathWildcard=831240> >
