Re: [STRUCTURED STREAM] Join static dataset in state function (flatMapGroupsWithState)

2018-07-19 Thread Christiaan Ras
Chris From: Gerard Maas Date: Thursday, 19 July 2018 at 15:20 To: Christiaan Ras , spark users Subject: Re: [STRUCTURED STREAM] Join static dataset in state function (flatMapGroupsWithState) Hi Chris, Could you show the code you are using? When you mention "I like to use a static datasou

Re: [STRUCTURED STREAM] Join static dataset in state function (flatMapGroupsWithState)

2018-07-19 Thread Gerard Maas
Hi Chris, Could you show the code you are using? When you mention "I like to use a static datasource (JDBC) in the state function" do you refer to a DataFrame from a JDBC source or an independent JDBC connection? The key point to consider is that the flatMapGroupsWithState function must be serial