Le 25/08/2021 à 17:17, Keith Kraus a écrit :
If I remember correctly the reason cuDF interacts with the Cython code for IPC stuff is that in the past the existing IPC machinery in Arrow didn't work correctly with GPU memory. If that is fixed I think there's a case to remove this code entirely from cuDF and instruct users to use the higher level PyArrow IPC APIs instead.
They definitely should work nowadays, though that's something to be confirmed by GPU-using people (we only have a couple rudimentary unit tests for that).
Regards Antoine.