There is a PR for this now. [SPARK-40491][SQL] Expose a jdbcRDD function in SparkContext <https://github.com/apache/spark/pull/37937>
man. 19. sep. 2022 kl. 12:47 skrev [email protected] <[email protected]>: > Thank you Bjorn Jorgensen and also thank to Sean Owen. > > DataFrame and .format("jdbc") is good way to resolved it. > But in some reasons, i can't using DataFrame API, only can use RDD API in > PySpark. > ...T_T... > > thanks all you guys help. but still need new idea to resolve it. XD > > > > > > ------------------------------ > [email protected] > > > *发件人：* Bjørn Jørgensen <[email protected]> > *发送时间：* 2022-09-19 18:34 > *收件人：* [email protected] > *抄送：* Xiao, Alton <[email protected]>; [email protected] > *主题：* Re: 答复: [how to]RDD using JDBC data source in PySpark > https://www.projectpro.io/recipes/save-dataframe-mysql-pyspark > and > https://towardsdatascience.com/pyspark-mysql-tutorial-fa3f7c26dc7 > > man. 19. sep. 2022 kl. 12:29 skrev [email protected] <[email protected]>: > >> Thank you answer alton. >> >> But i see that is use scala to implement it. >> I know java/scala can get data from mysql using JDBCRDD farily well. >> But i want to get same way in Python Spark. >> >> Would you to give me more advice, very thanks to you. >> >> >> ------------------------------ >> [email protected] >> >> >> *发件人：* Xiao, Alton <[email protected]> >> *发送时间：* 2022-09-19 18:04 >> *收件人：* [email protected]; [email protected] >> *主题：* 答复: [how to]RDD using JDBC data source in PySpark >> >> Hi javacaoyu: >> >> https://hevodata.com/learn/spark-mysql/#Spark-MySQL-Integration >> >> I think spark have already integrated mysql >> >> >> >> *发件人**:* [email protected] <[email protected]> >> *日期**:* 星期一, 2022年9月19日 17:53 >> *收件人**:* [email protected] <[email protected]> >> *主题**:* [how to]RDD using JDBC data source in PySpark >> >> 你通常不会收到来自 [email protected] 的电子邮件。了解这一点为什么很重要 >> <https://aka.ms/LearnAboutSenderIdentification> >> >> Hi guys: >> >> >> >> Does have some way to let rdd can using jdbc data source in pyspark? >> >> >> >> i want to get data from mysql, but in PySpark, there is not supported >> JDBCRDD like java/scala. >> >> and i search docs from web site, no answer. >> >> >> >> >> >> So i need your guys help, Thank you very much. >> >> >> ------------------------------ >> >> [email protected] >> >> > > -- > Bjørn Jørgensen > Vestre Aspehaug 4, 6010 Ålesund > Norge > > +47 480 94 297 > > -- Bjørn Jørgensen Vestre Aspehaug 4, 6010 Ålesund Norge +47 480 94 297
