Re: Deep Equals support on Maptype

2016-09-26 Thread Lakshmi Rajagopalan
Sep 26, 2016 at 9:04 PM, Lakshmi Rajagopalan > wrote: > >> If optimization is the problem, can we use precomputed hashes? >> >> >> On Mon, Sep 26, 2016 at 4:50 PM, Lakshmi Rajagopalan >> wrote: >> >>> Can you please help me understand why the Ma

Re: Deep Equals support on Maptype

2016-09-26 Thread Lakshmi Rajagopalan
If optimization is the problem, can we use precomputed hashes? On Mon, Sep 26, 2016 at 4:50 PM, Lakshmi Rajagopalan wrote: > Can you please help me understand why the MapType shouldn't be part of > equality tests? Practically, if we are using json line formats, the ideal > equal

Re: Deep Equals support on Maptype

2016-09-26 Thread Lakshmi Rajagopalan
as a function (Extensional definition). On Mon, Sep 26, 2016 at 3:43 PM, Takeshi Yamamuro wrote: > Hi, > > Have you check this jira? > https://issues.apache.org/jira/browse/SPARK-9415 > > // maropu > > On Mon, Sep 26, 2016 at 7:09 PM, Lakshmi Rajagopalan > wrote: >

Deep Equals support on Maptype

2016-09-26 Thread Lakshmi Rajagopalan
a#L420 Is there any possible work around for this? I have a patch in my mind to fix Equals for MapType also. Any thoughts? Thanks, Lakshmi Rajagopalan