Support subdirectories when accessing partitioned Parquet Hive table

2019-12-03 Thread Lotkowski, Michael
Originally https://issues.apache.org/jira/browse/SPARK-30024 Hi all, We have ran in to issues when trying to read parquet partitioned table created by Hive. I think I have narrowed down the cause to how InMemoryFileIndex created a pare

[spark-30111] k8s builds broken for sparkR

2019-12-03 Thread Shane Knapp
FYI, i just filed https://issues.apache.org/jira/browse/SPARK-30111 shane -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu - To unsubscribe e-mail: dev-unsubscr...@spark.apache

Auto-linking Jira tickets to their PRs

2019-12-03 Thread Nicholas Chammas
We used to have a bot or something that automatically linked Jira tickets to PRs that mentioned them in their title. I don't see that happening anymore. Did we intentionally remove this functionality, or is it temporarily broken for some reason?

Re: Auto-linking Jira tickets to their PRs

2019-12-03 Thread Hyukjin Kwon
I think it's broken .. cc Josh Rosen 2019년 12월 4일 (수) 오전 10:25, Nicholas Chammas 님이 작성: > We used to have a bot or something that automatically linked Jira tickets > to PRs that mentioned them in their title. I don't see that happening > anymore.

Re: Auto-linking Jira tickets to their PRs

2019-12-03 Thread Nicholas Chammas
Hmm, looks like something weird is going on, since it seems to be working here and here . Perhaps it was temporarily broken and is now working again. On Tue, Dec 3, 2019 at 8:35 PM Hyukjin Kwon

Re: Slower than usual on PRs

2019-12-03 Thread Hyukjin Kwon
Yeah, please take care of your heath first! 2019년 12월 3일 (화) 오후 1:32, Wenchen Fan 님이 작성: > Sorry to hear that. Hope you get better soon! > > On Tue, Dec 3, 2019 at 1:28 AM Holden Karau wrote: > >> Hi Spark dev folks, >> >> Just an FYI I'm out dealing with recovering from a motorcycle accident so

Re: [spark-30111] k8s builds broken for sparkR

2019-12-03 Thread Shane Knapp
https://github.com/apache/spark/pull/26753 ilan, thanks for taking care of this! the k8s prb and master test are green now, and the jdk11 build failed for an unrelated reason. https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-k8s-jdk11/ On Tue, Dec 3, 2019 at 10:21 AM Shane Knapp w