> I wish the Hive team to keep things more backward-compatible as well. Hive is > such an enormous system with a wide-spread impact so any > backward-incompatible change could cause an uproar in the community.
The incompatibilities were not avoidable in a set of situations - a lot of those were in Hive2, but hidden away or deliberately disabled to make Hive 3 into what it is. Here's a quick run-down of how the incompatibilities at the table level allow a final user to run more SQL https://www.slideshare.net/dbist/hive-3-a-new-horizon/10 The incompatibilities form the foundation for something like "How do I have Kafka streams offloaded to S3 cold data stores, but still query down to the last second without the small file problem?". Cheers, Gopal