schlichtanders commented on issue #6808: URL: https://github.com/apache/hudi/issues/6808#issuecomment-1310552112
thank you for the remarks. It is good to know that a derby client setup works for local testing, while being more lightweight than postgres. We usually have one spark hudi job which creates/updates also hive tables and this we want to test locally. Question: is it really not possible to use the derby `memory` subprotocol (it is our preferred option for local tests)? - If it is not possible, then Hudi should throw a descriptive error message. Instead it pretends to have worked correctly, while no hive sync was done at all - if it is possible that would be really awesome (databricks delta e.g. supports it), as the test is then automatically fully independent of others (with a client setup you cannot run the tests in parallel easily, you need to be super careful about the ports, and filesystem) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
