Re: Extracting Input and Output Partitions in Spark

nity, would a SPIP proposal be ideal here? On Wed, Jan 31, 2024 at 11:45 AM Aditya Sohoni wrote: > Hello Spark Devs! > > > We are from Uber's Spark team. > > > Our ETL jobs use Spark to read and write from Hive datasets stored in > HDFS. The freshness of the partition writt

Extracting Input and Output Partitions in Spark

o the community. Regards, Aditya Sohoni