Extending Spark Connector versus Providing utility library

2023-03-13 Thread Jarus Local
Hi team, Had a design question around wether it’s a good idea to write wrappers over all existing spark connectors for adding some functionality/improving usability in terms of options passed to the connector. In contrast to providing utility libraries that takes parameters and calls the underlyin

Extending spark connectors versus providing utility libraries

2023-03-13 Thread Jarus Local
Hi team, Had a design question around wether it’s a good idea to write wrappers over all existing spark connectors for adding some functionality/improving usability in terms of options passed to the connector. In contrast to providing utility libraries that takes parameters and calls the underlyin