Frederic Hemery created SPARK-51523:
---------------------------------------

             Summary: Make Kubernetes driver service domain configurable
                 Key: SPARK-51523
                 URL: https://issues.apache.org/jira/browse/SPARK-51523
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 3.5.5
            Reporter: Frederic Hemery


Currently, the DNS record used by Spark worker pods for the driver is `<driver 
name>.<driver namespace>.svc`. This is set 
[here|[https://github.com/apache/spark/blob/master/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverServiceFeatureStep.scala#L55].]

 

This requires that the pods are configured with specific search domains for 
this DNS to properly resolve. It would be convenient to be able to configure 
the domain to use. This would default to `svc` for backward compatibility.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to