Re: Union of 2 streaming data frames

2017-07-10 Thread Michael Armbrust
is > going to be out soon? Do you have some sort of ETA? > > > > *From: *"Lalwani, Jayesh" > *Date: *Friday, July 7, 2017 at 5:46 PM > *To: *Michael Armbrust > > *Cc: *"user@spark.apache.org" , #MM - Heartbeat < > mm-heartb...@capitalone.c

Re: Union of 2 streaming data frames

2017-07-10 Thread Lalwani, Jayesh
ot; Cc: "user@spark.apache.org" , #MM - Heartbeat Subject: Re: Union of 2 streaming data frames Ah, looks like you are hitting SPARK-20441<https://issues.apache.org/jira/browse/SPARK-20441>. Should be fixed in 2.2. On Fri, Jul 7, 2017 at 2:37 PM, Lalwani, Jayesh mailto:jayes

Re: Union of 2 streaming data frames

2017-07-07 Thread Lalwani, Jayesh
>> Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Subject: Re: Union of 2 streaming data frames df.union(df2) should be supported when both DataFrames are created from a streaming source. What error are you seeing? On Fri, Jul 7

Re: Union of 2 streaming data frames

2017-07-07 Thread Michael Armbrust
pache.spark.sql.execution.streaming. > StreamExecution$$anonfun$org$apache$spark$sql$execution$ > streaming$StreamExecution$$runBatches$1.apply$mcZ$sp( > StreamExecution.scala:244) > > at org.apache.spark.sql.execution.streaming. > ProcessingTimeExecutor.execute(TriggerExe

Re: Union of 2 streaming data frames

2017-07-07 Thread Lalwani, Jayesh
rust Date: Friday, July 7, 2017 at 2:30 PM To: "Lalwani, Jayesh" Cc: "user@spark.apache.org" Subject: Re: Union of 2 streaming data frames df.union(df2) should be supported when both DataFrames are created from a streaming source. What error are you seeing? On Fri, Jul 7, 201

Re: Union of 2 streaming data frames

2017-07-07 Thread Michael Armbrust
df.union(df2) should be supported when both DataFrames are created from a streaming source. What error are you seeing? On Fri, Jul 7, 2017 at 11:27 AM, Lalwani, Jayesh < jayesh.lalw...@capitalone.com> wrote: > In structured streaming, Is there a way to Union 2 streaming data frames? > Are there