Re: Ask for ARM CI for spark

2019-11-17 Thread Tianhua huang
We can talk about this later, but I have to update some things:) - It (largely) worked previously --- But no one sure about this before the arm testing, and it can't be found anywhere, specify officially will make it more clear - I think you're also saying you don't have 100% tests passing anywa

Re: Adding JIRA ID as the prefix for the test case name

2019-11-17 Thread Hyukjin Kwon
Actually there are not so many Java test cases in Spark (because Scala runs on JVM as everybody knows)[1]. Given that, I think we can avoid to put some efforts on this for now .. I don't mind if somebody wants to give a shot since it looks good anyway but to me I wouldn't spend so much time on thi

Re: Ask for ARM CI for spark

2019-11-17 Thread Sean Owen
Same response as before: - It is in the list of resolved JIRAs, of course - It (largely) worked previously - I think you're also saying you don't have 100% tests passing anyway, though probably just small issues - It does not seem to merit a special announcement from the PMC among the 2000+ change

Re: Ask for ARM CI for spark

2019-11-17 Thread Tianhua huang
@Sean Owen , I'm afraid I don't agree with you this time, I still remember no one can tell me whether Spark supports ARM or how much Spark can support ARM when I asked this first time on Dev@, you're very kind and told me to build and test on ARM locally and so sorry I think you were not sure much

Re: Ask for ARM CI for spark

2019-11-17 Thread Steve Loughran
The ASF PR team would like something like that "Spark now supports ARM" in press releases. And don't forget: they do you like to be involved in the launch of the final release. On Fri, Nov 15, 2019 at 9:46 AM bo zhaobo wrote: > Hi @Sean Owen , > > Thanks for your idea. > > We may use the bad wo

Re: Adding JIRA ID as the prefix for the test case name

2019-11-17 Thread Steve Loughran
Test reporters do often contain some assumptions about the characters in the test methods. Historically JUnit XML reporters have never sanitised the method names so XML injection attacks have been fairly trivial. Haven't tried this for a while. That whole JUnit XML report "standard" was actually p

Re: Use Hadoop-3.2 as a default Hadoop profile in 3.0.0?

2019-11-17 Thread Steve Loughran
Can I take this moment to remind everyone that the version of hive which spark has historically bundled (the org.spark-project one) is an orphan project put together to deal with Hive's shading issues and a source of unhappiness in the Hive project. What ever get shipped should do its best to avoid