Re: GraphX Support
Right, GraphFrames is not very active and maintainers don't even have the capacity to make releases. Enrico Am 22.03.22 um 00:10 schrieb Sean Owen: GraphX is not active, though still there and does continue to build and test with each Spark release. GraphFrames kind of superseded it, but is also not super active FWIW. On Mon, Mar 21, 2022 at 6:03 PM Jacob Marquez wrote: Hello! My team and I are evaluating GraphX as a possible solution. Would someone be able to speak to the support of this Spark feature? Is there active development or is GraphX in maintenance mode (e.g. updated to ensure functionality with new Spark releases)? Thanks in advance for your help! -- Jacob H. Marquez He/Him Data & Applied Scientist Microsoft Cloud Data Sciences
RE: Spark kafka structured streaming - how to prevent dataloss
Hi all, Any suggestion? Regards, Gnana From: Gnanasoundari Soundarajan Sent: Tuesday, March 8, 2022 10:02 PM To: user@spark.apache.org Subject: Spark kafka structured streaming - how to prevent dataloss Hi, In spark, it uses checkpoints to keep track of offsets in kafka. If there is any data loss, can we edit the file and reduce the data loss? Please suggest the best practices to reduce the data loss under exceptional scenarios. Regards, Gnana
