Hi, > I know Plasma today is not supported on Windows, but I think support could be > added since Windows supports memory mapped files (through a different API > than mmap) and it now supports Unix Domain Sockets [1]. > ... > [1] https://devblogs.microsoft.com/commandline/af_unix-comes-to-windows/
Thanks for the information. I read the document. It seems that Unix domain socket on Windows doesn't support file descriptor passing: > Ancillary data: Linux‘s unix socket implementation supports passing ancillary > data such as passing file descriptors Plasma uses this feature: https://github.com/apache/arrow/blob/master/cpp/src/plasma/fling.cc#L33 https://github.com/apache/arrow/blob/master/cpp/src/plasma/client.cc#L940 Thanks, -- kou In <bl0pr2101mb112267080f408ce3694c379d8e...@bl0pr2101mb1122.namprd21.prod.outlook.com> "Plasma scenarios" on Fri, 6 Sep 2019 22:09:38 +0000, Eric Erhardt <eric.erha...@microsoft.com.INVALID> wrote: > I was looking for the high level scenarios for the Plasma In-Memory Object > Store. A colleague of mine suggested we could use it to pass data between a > C# process and a Python process. > > I've read the intro blog [0] on Plasma, which describes using the same data > set from multiple processes - which sounds like the same scenario as above. > > I am trying to prioritize creating C# bindings for the Plasma client. So I'd > like to know all the scenarios that would could be enabled with Plasma. > > For example: > - could using Plasma speed up Pandas UDFs in PySpark? Because the data > wouldn't have to go across the socket between Java and Python, but instead > would be memory-mapped. We have similar functionality in .NET for Apache > Spark. > - Is Plasma being used by Nvidia RAPIDS? > > I know Plasma today is not supported on Windows, but I think support could be > added since Windows supports memory mapped files (through a different API > than mmap) and it now supports Unix Domain Sockets [1]. > > Also - side question about the c_glib bindings. I assume those will only ever > work on Windows with something like Cygwin or MSYS2, right? Would people be > opposed to adding pure "C" exports to the plasma library so the C# bindings > could use it? (similar to the JNI support today). > > Eric > > [0] > https://ray-project.github.io/2017/08/08/plasma-in-memory-object-store.html > [1] https://devblogs.microsoft.com/commandline/af_unix-comes-to-windows/
