I've been looking recently on possible avenues to load new functions into the Thriftserver and SqlShell at launch time. I basically want to preload a set of functions in addition to those already present in the Spark Code. I'm not sure there is at present a way to do this and I was wondering if anyone had any ideas.
I would basically want to make it so that any user launching either of these tools would automatically have access to some custom functions. In the SparkShell I can do this by adding additional lines to the init section but I think It would be nice if we could pass in a parameter which would point to a class with a list of additional functions to add to all new session states. An interface like Spark Sessions Extensions but instead of running during Session Init, it would run after session init has completed. Thanks for your time and I would be glad to hear any opinions or ideas on this,
