[no subject]

unsubscribe

Unsubscribe

Unsubscribe

RE: Conda Python Env in K8S

RK-33615 Best, Meikel From: Mich Talebzadeh Sent: Samstag, 4. Dezember 2021 18:36 To: Bode, Meikel, NMA-CFD Cc: dev ; u...@spark.apache.org Subject: Re: Conda Python Env in K8S Hi Meikel In the past I tried with --py-files hdfs://$HDFS_HOST:$HDFS_PORT/minikube/codes/

RE: Conda Python Env in K8S

these options exist and I want to understand what the issue is... Any hints on that? Best, Meikel From: Mich Talebzadeh Sent: Freitag, 3. Dezember 2021 13:27 To: Bode, Meikel, NMA-CFD Cc: dev ; u...@spark.apache.org Subject: Re: Conda Python Env in K8S Build python packages into the docker

Conda Python Env in K8S

Hello, I am trying to run spark jobs using Spark Kubernetes Operator. But when I try to bundle a conda python environment using the following resource description the python interpreter is only unpack to the driver and not to the executors. apiVersion: "sparkoperator.k8s.io/v1beta2" kind: Spark

RE: HiveThrift2 ACID Transactions?

27;true') Any help on these issues would be very appreciated! Many thanks, Meikel Bode From: Bode, Meikel, NMA-CFD Sent: Mittwoch, 10. November 2021 08:23 To: user ; dev Subject: HiveThrift2 ACID Transactions? Hi all, We want to use apply INSERTS, UPDATE, and DELETE operations on table

HiveThrift2 ACID Transactions?

Hi all, We want to use apply INSERTS, UPDATE, and DELETE operations on tables based on parquet or ORC files served by thrift2. Actually its unclear whether we can enable them and where. At the moment, when executing UPDATE or DELETE operations those are getting blocked. Anyone out who uses ACI

RE: [ANNOUNCE] Apache Spark 3.2.0

Many thanks! 😊 From: Gengliang Wang Sent: Dienstag, 19. Oktober 2021 16:16 To: dev ; user Subject: [ANNOUNCE] Apache Spark 3.2.0 Hi all, Apache Spark 3.2.0 is the third release of the 3.x line. With tremendous contribution from the open-source community, this release managed to resolve in ex

RE: [VOTE][RESULT] Release Spark 3.2.0 (RC7)

Yes. Genliang. Many thanks. From: Mich Talebzadeh Sent: Dienstag, 12. Oktober 2021 09:25 To: Gengliang Wang Cc: dev Subject: Re: [VOTE][RESULT] Release Spark 3.2.0 (RC7) great work Gengliang. Thanks for your tremendous contribution! [https://docs.google.com/uc?export=download&id=1-q7RFG

RE: Time to start publishing Spark Docker Images?

Hi all, I am Meikel Bode and only an interested reader of dev and user list. Anyway, I would appreciate to have official docker images available. Maybe one could get inspiration from the Jupyter docker stacks and provide an hierarchy of different images like this: https://jupyter-docker-stacks.

RE: Recursive Queries or Recursive UDF?

e root by indicating: child, lvl-0-parent inquiry1, null inquiry2, null order3, null Actually that’s what I realized with my recursive UDF I put into the initial post. Thank you for any hints on that issue! Any hints on the UDF solution are also very welcome: Thx and best, Meikel From: Bod

AW: [ANNOUNCE] Announcing Apache Spark 3.1.1

Congrats! Von: Hyukjin Kwon Gesendet: Mittwoch, 3. März 2021 02:41 An: user @spark ; dev Betreff: [ANNOUNCE] Announcing Apache Spark 3.1.1 We are excited to announce Spark 3.1.1 today. Apache Spark 3.1.1 is the second release of the 3.x line. This release adds Python type annotations and Pytho