Are you asking about a Kafka python driver? Or are referring to pyspark? On Aug 1, 2016 10:03, "Andy Davidson" <a...@santacruzintegration.com> wrote:
> I am new to python. > > I find my self working with several data frames at the same time. I have > run > into some driver memory problems and want to make sure I release all > resource as soon as possible. > > 1. should I be calling del and gc.collect() ? > 2. If a dataframe was cached do I need to explicitly call unpersist() or > will del,gc.collect() do this for me? > > Thanks > > Andy > > > > >
