Re: [Spark 2.0.0] error when unioning to an empty dataset

2016-10-21 Thread Agraj Mangal
/so I can union it to the actual Dataset I have elsewhere > > On Thu, Oct 20, 2016 at 8:34 PM Agraj Mangal wrote: > > I believe this normally comes when Spark is unable to perform union due to > "difference" in schema of the operands. Can you check if the schema of both

Re: [Spark 2.0.0] error when unioning to an empty dataset

2016-10-20 Thread Agraj Mangal
m new at Spark so this might be an anti-pattern, so I'm open >> to suggestions. However it doesn't seem like I'm doing anything incorrect >> here, the types are correct. Searching for this error online returns >> results seemingly about working in dataframes and having mismatching >> schemas or a different order of fields, and it seems like bugfixes have >> gone into place for those cases. >> >> Thanks in advance. >> Efe >> >> -- Thanks & Regards, Agraj Mangal