Hi all,
I'm interested in getting involved the Python API development. The first
use-case I've encountered in my work is that of zipWithIndex, so I
started looking into how to go about implementing that. It looks like
the core of it involves being able to uniquely identify what worker
you're currently in between distributed calls; the Scala end has
getRuntimeContext().getIndexOfThisSubtask(), but Python's runtime
context is more or less limited to the broadcast variables.
Happy to hear any hints as to how I should get started with this. Thanks.
Regards,
Shannon