Hello, Is there a way spark streaming application will get to know during the start and end of the data read from a dataset partition? I want to create partition specific cache during the start and delete during the partition is read completely.
Thanks for you help in advance. regards, Robin Kuttaiah
