Re: Update Batch DF with Streaming

2016-06-20 Thread Jacek Laskowski
Hi, How would you do that without/outside streaming? Jacek On 17 Jun 2016 12:12 a.m., "Amit Assudani" wrote: > Hi All, > > > Can I update batch data frames loaded in memory with Streaming data, > > > For eg, > > > I have employee DF is registered as temporary table, it has EmployeeID, > Name, A

Re: Update Batch DF with Streaming

2016-06-19 Thread Amit Assudani
Please help From: amit assudani Date: Thursday, June 16, 2016 at 6:11 PM To: "user@spark.apache.org" Subject: Update Batch DF with Streaming Hi All, Can I update batch data frames loaded in memory with Streaming data, For eg, I have employee DF is registered as temporary

Update Batch DF with Streaming

2016-06-16 Thread Amit Assudani
Hi All, Can I update batch data frames loaded in memory with Streaming data, For eg, I have employee DF is registered as temporary table, it has EmployeeID, Name, Address, etc. fields, and assuming it is very big and takes time to load in memory, I've two types of employee events (both h