Recently there has been an increase in requests from Beam users highlighting the inconvenience of Beam's dependency on an old version of dill.
Some time ago we started a project to support cloudpickle as an alternative pickler, aiming to switch to cloudpickle completely. I put together a tentative plan with concrete steps so that we can finish this sooner than later: https://s.apache.org/beam-cloudpickle-next-steps Feel free to provide feedback or offer help on AIs that might be of interest to you in the comments. Thanks, Valentyn