Nicolas, are you referring to printing the model params in that example
with "print(model1.extractParamMap())"? There was a problem with pyspark
models not having params after being fit, which causes this example to show
nothing for model paramMaps. This was fixed in
https://issues.apache.org/jir
Hi Spark Experts:
I am trying to use a stateful udf with spark structured streaming that needs to
update the state periodically.
Here is the scenario:
1. I have a udf with a variable with default value (eg: 1) This value is
applied to a column (eg: subtract the variable from the column value )2.
Free access to Index Conf for Apache Spark session attendees. For info go to:
https://www.meetup.com/SF-Big-Analytic
IBM is hosting a developer conference - Essentially the conference is ‘By
Developers, for Developers’ based on Open technologies.
This will be held Feb 20 - 22nd in Moscone West.
ht
Hi Jacek
https://cwiki.apache.org/confluence/display/Hive/StorageHandlers
The motivation is to make it possible to allow Hive to access data stored
and managed by other systems in a modular, extensible fashion.
I have hive script which have custom storage handler , something like this
create
Hi,
Since I'm new to Hive, what does `stored by` do? I might help a bit in
Spark if I only knew a bit about Hive :)
Pozdrawiam,
Jacek Laskowski
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-st
Hello,
I am facing an issue with Spark Conf while reading the Cassandra host property
from the default spark configuration file.
I use Kafka 2.11.0.10 and Spark 2.2.1, Cassandra 3.11. I have a Docker
container where spark master, worker and my app running as standalone cluster
mode. I have a sp
