Re: BytesToBytes and unaligned memory

2016-04-18 Thread Ted Yu
Ted Yu > To: Adam Roberts/UK/IBM@IBMGB > Cc:"dev@spark.apache.org" > Date:15/04/2016 17:35 > Subject:Re: BytesToBytes and unaligned memory > -- > > > > I am curious if all Spark unit tests pass with the

Re: BytesToBytes and unaligned memory

2016-04-18 Thread Adam Roberts
initely not supported for shorts/ints/longs. if these tests continue to pass then I think the Spark tests don't exercise unaligned memory access, cheers From: Ted Yu To: Adam Roberts/UK/IBM@IBMGB Cc: "dev@spark.apache.org" Date: 15/04/2016 17:35 Subject:

Re: BytesToBytes and unaligned memory

2016-04-15 Thread Ted Yu
added > > Cheers, > > > > > From:Ted Yu > To:Adam Roberts/UK/IBM@IBMGB > Cc:"dev@spark.apache.org" > Date: 15/04/2016 16:43 > Subject:Re: BytesToBytes and unaligned memory > -- > &g

Re: BytesToBytes and unaligned memory

2016-04-15 Thread Adam Roberts
imenting", and the tests pass. No other problems on the platform (pending a different pull request). Cheers, From: Ted Yu To: Adam Roberts/UK/IBM@IBMGB Cc:"dev@spark.apache.org" Date:15/04/2016 15:32 Subject:Re: BytesToBytes and

Re: BytesToBytes and unaligned memory

2016-04-15 Thread Ted Yu
unaligned);* > } > } > > Output is, as you'd expect, "used reflection and _unaligned is false, > setting to true anyway for experimenting", and the tests pass. > > No other problems on the platform (pending a different pull request). > > Cheers, > >

Re: BytesToBytes and unaligned memory

2016-04-15 Thread Adam Roberts
anyway for experimenting", and the tests pass. No other problems on the platform (pending a different pull request). Cheers, From: Ted Yu To: Adam Roberts/UK/IBM@IBMGB Cc: "dev@spark.apache.org" Date: 15/04/2016 15:32 Subject:Re: BytesToBytes and un

Re: BytesToBytes and unaligned memory

2016-04-15 Thread Ted Yu
I assume you tested 2.0 with SPARK-12181 . Related code from Platform.java if java.nio.Bits#unaligned() throws exception: // We at least know x86 and x64 support unaligned access. String arch = System.getProperty("os.arch", ""); //noinspection DynamicRegexReplaceableByCompiledPa