Re: On Java 9+ support, Cleaners, modules and the death of reflection

2018-11-12 Thread Sean Owen
For those following, I have a PR up at https://github.com/apache/spark/pull/22993 The implication is that ignoring MaxDirectMemorySize doesn't work out of the box in Java 9+ now. However, you can make it work by setting JVM flags to allow access to the new Cleaner class. O

On Java 9+ support, Cleaners, modules and the death of reflection

2018-11-08 Thread Sean Owen
I think this is a key thread, perhaps one of the only big problems, for Java 9+ support: https://issues.apache.org/jira/browse/SPARK-24421?focusedCommentId=16680169&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16680169 We basically can't access a certa

Re: Java 9

2017-02-09 Thread Rory O'Donnell
On Tue, Feb 7, 2017 at 4:03 AM, Timur Shenkao <mailto:t...@timshenkao.su>> wrote: If I'm not wrong, they got fid of *sun.misc.Unsafe *in Java 9.* * This class is till used by several libraries & frameworks. http://mishadoff.com/blog/java-magic-part-4-su

Re: Java 9

2017-02-09 Thread Reynold Xin
Quality Outreach: https://wiki.openjdk.java.net/display/quality/Quality+ > Outreach > Thanks, > Felix > > On 2017/2/8 13:09, kant kodali wrote: > > Well and the module system! > > On Tue, Feb 7, 2017 at 4:03 AM, Timur Shenkao wrote: > >> If I'm not wrong,

Re: Java 9

2017-02-09 Thread Felix Yang
If I'm not wrong, they got fid of *sun.misc.Unsafe *in Java 9.* * This class is till used by several libraries & frameworks. http://mishadoff.com/blog/java-magic-part-4-sun-dot-misc-dot-unsafe/ <http://mishadoff.com/blog/java-magic-part-4-sun-dot-misc-dot-unsafe

Re: Java 9

2017-02-07 Thread kant kodali
Well and the module system! On Tue, Feb 7, 2017 at 4:03 AM, Timur Shenkao wrote: > If I'm not wrong, they got fid of *sun.misc.Unsafe *in Java 9. > > This class is till used by several libraries & frameworks. > > http://mishadoff.com/blog/java-magic-part-4-sun-dot

Re: Java 9

2017-02-07 Thread Timur Shenkao
If I'm not wrong, they got fid of *sun.misc.Unsafe *in Java 9. This class is till used by several libraries & frameworks. http://mishadoff.com/blog/java-magic-part-4-sun-dot-misc-dot-unsafe/ On Tue, Feb 7, 2017 at 12:51 PM, Pete Robbins wrote: > Yes, I agree but it may b

Re: Java 9

2017-02-07 Thread Pete Robbins
wrote: > > Is anyone working on support for running Spark on Java 9? Is this in a > roadmap anywhere? > > > Cheers, > >

Re: Java 9

2017-02-07 Thread Sean Owen
I don't think anyone's tried it. I think we'd first have to agree to drop Java 7 support before that could be seriously considered. The 8-9 difference is a bit more of a breaking change. On Tue, Feb 7, 2017 at 11:44 AM Pete Robbins wrote: > Is anyone working on support for run

Java 9

2017-02-07 Thread Pete Robbins
Is anyone working on support for running Spark on Java 9? Is this in a roadmap anywhere? Cheers,