Hi everyone,
We published an article on the performance and correctness of Trino, Spark,
and Hive-MR3, and thought that it could be of interest to Spark users.
https://www.datamonad.com/post/2023-05-31-trino-spark-hive-performance-1.7/
Omitted in the article is the performance of Spark 2.3.1 vs
Hi Nikhil
Spark operator supports ingress for exposing all UIs of running spark
applications.
reference:
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/quick-start-guide.md#driver-ui-access-and-ingress
On Thu, Jun 1, 2023 at 6:19 AM Nikhil Goyal wrote:
> Hi folks
Hi Mich,
I have been using ChatGPT free version, Bing AI, Google Bard and other AI
chatbots.
My use cases so far include writing, debugging code, generating documentation
and explanation on Spark key terminologies for beginners to quickly pick up new
concepts, summarizing pros and cons or uses
Hi folks,
Is there an equivalent of the Yarn RM page for Spark on Kubernetes. We can
port-forward the UI from the driver pod for each but this process is
tedious given we have multiple jobs running. Is there a clever solution to
exposing all Driver UIs in a centralized place?
Thanks
Nikhil
I have started looking into ChatGPT as a consumer. The one I have tried is
the free not plus version.
I asked a question entitled "what is the future for spark" and asked for a
concise response
This was the answer
"Spark has a promising future due to its capabilities in data processing,
scalabi
Hi,
I have a question related to this picture
https://spark.apache.org/docs/latest/img/structured-streaming-watermark-append-mode.png
in structured streaming programming guide web page.
At 12:20, the wm is 12:11, so the window 12:00 ~ 12:10 will be flushed out.
But in this pic, it seems the window
