Spark on Oracle available as an Apache licensed open source repo

2022-01-13 Thread Harish Butani
Spark on Oracle is now available as an open source Apache licensed github repo . Build and deploy it as an extension jar in your Spark clusters. Use it to combine Apache Spark programs with data in your existing Oracle databases without expensive data copyin

Re: Spark on Oracle available as an Apache licensed open source repo

2022-01-13 Thread Sean Owen
-user Thank you for this, but just a small but important point about the use of the Spark name. Please take a look at https://spark.apache.org/trademarks.html Specifically, this should reference "Apache Spark" at least once prominently with a link to the project. It's also advisable to avoid using

Re: Spark on Oracle available as an Apache licensed open source repo

2022-01-13 Thread Harish Butani
- happy to link to Apache Spark. Will add the link to the README - Sorry didn’t know about the trademark rules. Let me think about a name, though ‘Oracle Translator for Apache Spark’ sounds pretty good. regards, Harish. > On Jan 13, 2022, at 5:00 PM, Sean Owen wrote: > > -user > Thank you for

Seems like a bug in Spark dynamic allocation, numberMaxNeededExecutors value is negative in JMX exporter, which is unreasonable

2022-01-13 Thread 徐涛
Hi Experts: Seems like a bug in ExecutorAllocationManager, because numberMaxNeededExecutors value is negative in JMX exporter, which is unreasonable Spark Version is 3.1.1 And the following is the debug log, the numRunningOrPendingTasks get a negative value: 22/01/13 09:32:21

Re: [VOTE] Release Spark 3.2.1 (RC1)

2022-01-13 Thread huaxin gao
The two regressions have been fixed. I will cut RC2 tomorrow late afternoon. Thanks, Huaxin On Wed, Jan 12, 2022 at 9:11 AM huaxin gao wrote: > Thank you all for testing and voting! > > I will -1 this RC because > https://issues.apache.org/jira/browse/SPARK-37855 and > https://issues.apache.org