Hi everybody, I'm trying to automatically register a few custom-developed UDFs into spark's sqlContext at spark interpreter initialization. I've used the "args" spark interpreter setting to pass the option "-i /path/to/init.scala". This mechanism works and the init script is properly executed at interpreter's startup. The problem is that in the init scala script I'm unable to access Spark's ( sql) context. ¿Is this even possible?
I've tried with 'sqlc', 'sqlContext', 'sc' and 'z' but without success. Any suggestion? Thanks, Luca