Thank you for your response Anurag.
I am not sure if I get your point. Are you suggesting that UDF somehow
serializes not only reference to Dataset, but also all the data?
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
--
Mail for Windows 10
From: knowsnothing
Sent: Sunday, November 5, 2017 8:12 AM
To: dev@spark.apache.org
Subject: Accessing DataFrame inside UserDefinedFunction.
Hi Everyone,
I've been told, that accessing DataFrame object from UserDefinedFunction is
not possible, but turns out that the code
Hi Everyone,
I've been told, that accessing DataFrame object from UserDefinedFunction is
not possible, but turns out that the code shown below works fine (taken from
StackOverflow). Why is it so? Is it a bug, or is it expected?
Thanks in advance.
case class Target(wordListOne: Seq[String], WordL
