On Wed, May 24, 2023, 10:41 AM Gaurav Agarwal <gaurav130...@gmail.com> wrote:
> I have one more query we are trying to compact files currently it is > taking time as have never compacted till now this is the first time we are > trying to perform compaction after 5 months of continuously loading data > We change the format of the table from 1 to 2 also in bwtween > The issue is we are sparkrewriteaction Java API to perform the collate but > it is taking 24 hours for us to complete the job will there be a way in > that api that i can pass date range options are there but what parameters > should i pass there to make it date range > > Thanks >