Hi, I don't think so. I can't think of an interface (trait) that would give that information to the Catalyst optimizer.
Pozdrawiam, Jacek Laskowski ---- https://about.me/JacekLaskowski Mastering Spark SQL https://bit.ly/mastering-spark-sql Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Kafka Streams https://bit.ly/mastering-kafka-streams Follow me at https://twitter.com/jaceklaskowski On Tue, Apr 16, 2019 at 6:31 PM Long, Andrew <loand...@amazon.com.invalid> wrote: > Hey Friends, > > > > Is it possible to specify the sort order or bucketing in a way that can be > used by the optimizer in spark? > > > > Cheers Andrew >