Re: Deploying Spark on Google Kubernetes (GKE) autopilot, preliminary findings

2022-02-14 Thread Mich Talebzadeh
Good question. However, we ought to look at what options we have so to speak. Let us consider Spark on Dataproc, Spark on Kubernetes and Spark on Dataflow Spark on DataProc is proven and it is in use at many organizations, I have deployed it extensively. It is

Deploying Spark on Google Kubernetes (GKE) autopilot, preliminary findings

2022-02-11 Thread Mich Talebzadeh
The equivalent of Google GKE autopilot in AWS is AWS Fargate I have not used the AWS Fargate so I can only mension Google's GKE Autopilot. This is developed from the concept of contai