Hi All, I'm doing a groupBy and reduce on a kstream which results in a state store being created.
This state store is growing to be massive, its filled up a 20gb drive. This feels very unexpected. Is there some cleanup or flushing process for the state stores that I'm missing or is such a large size expected? The topic in question has 96 partitions and the state is about ~200mb average for each one. 175M 1_0 266M 1_1 164M 1_10 177M 1_11 142M 1_12 271M 1_13 158M 1_14 280M 1_15 286M 1_16 181M 1_17 185M 1_18 187M 1_19 281M 1_2 278M 1_20 188M 1_21 262M 1_22 166M 1_23 177M 1_24 268M 1_25 264M 1_26 147M 1_27 179M 1_28 276M 1_29 177M 1_3 157M 1_30 137M 1_31 247M 1_32 275M 1_33 169M 1_34 267M 1_35 283M 1_36 171M 1_37 166M 1_38 277M 1_39 160M 1_4 273M 1_40 278M 1_41 279M 1_42 170M 1_43 139M 1_44 272M 1_45 179M 1_46 283M 1_47 263M 1_48 267M 1_49 181M 1_5 282M 1_50 166M 1_51 161M 1_52 176M 1_53 152M 1_54 172M 1_55 148M 1_56 268M 1_57 144M 1_58 177M 1_59 271M 1_6 279M 1_60 266M 1_61 194M 1_62 177M 1_63 267M 1_64 177M 1_65 271M 1_66 175M 1_67 168M 1_68 140M 1_69 175M 1_7 173M 1_70 179M 1_71 178M 1_72 166M 1_73 180M 1_74 177M 1_75 276M 1_76 177M 1_77 162M 1_78 266M 1_79 194M 1_8 158M 1_80 187M 1_81 162M 1_82 163M 1_83 177M 1_84 286M 1_85 165M 1_86 171M 1_87 162M 1_88 179M 1_89 145M 1_9 166M 1_90 190M 1_91 159M 1_92 284M 1_93 172M 1_94 149M 1_95