Re: Follow up on Jira Issue 39549

No, programs can't read information out of other processes's memory - this is true of all software. A cached DataFrame is tied to a Spark application, but many things could be running inside that app. You may be thinking of something like, exposing some kind of service on the driver that responds t

Re: Follow up on Jira Issue 39549

Thanks for response. I want to figure out is there a way to share data without writing it to disk because of performance issues. Chenyang Zhang Software Engineering Intern, Platform Redwood City, California [cid:EnterpriseAI_Banner_1200_e6f8b810-93f3-44f1-b795-bb502b7a52ae.png]

Re: Follow up on Jira Issue 39549

Spark is decoupled from storage. You can write data to any storage you like. Anything that can read that data, can read that data - Spark or not, different session or not. Temp views are specific to a session and do not store data. I think this is trivial and no problem at all, or else I'm not clea