Re: Spark on the cloud deployments

2021-02-24 Thread Mich Talebzadeh
Hi Stephane, If you are currently using on-premisses then you should also consider Google Cloud platform (GCP). As a practitioner I see a number of customers migrating from others to GCP. Databricks on GCP will be available (if I am correct) in April this year. GCP already offers Google Compute

Re: Spark on the cloud deployments

2021-02-24 Thread Lalwani, Jayesh
AWS has 2 offerings built on top of Spark: EMR and Glue. You can, of course, spin up your EC2 instances and deploy Spark on it. The 3 offerings allows you to tradeoff between flexibility and infrastructure management. EC2 gives you the most flexibility, because it's basically a bunch of nodes,

Spark on the cloud deployments

2021-02-24 Thread Stephane Verlet
Hello, We have been using Spark on a on-premise cluster for several years and looking at moving to a cloud deployment. I was wondering what is your current favorite cloud setup.  Just simple AWR / Azure, or something on top like Databricks ? This would support a on demand report application