Ok so you want to generate some random data and load it into Kafka on a
regular interval and the rest?

HTH

Mich Talebzadeh,
Dad | Technologist | Solutions Architect | Engineer
London
United Kingdom


   view my Linkedin profile
<https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>


 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 27 Dec 2023 at 12:16, Поротиков Станислав Вячеславович
<s.poroti...@skbkontur.ru.invalid> wrote:

> Hello!
>
> Is it possible to write pyspark UDF, generated data to streaming dataframe?
>
> I want to get some data from REST API requests in real time and consider
> to save this data to dataframe.
>
> And then put it to Kafka.
>
> I can't realise how to create streaming dataframe from generated data.
>
>
>
> I am new in spark streaming.
>
> Could you give me some hints?
>
>
>
> Best regards,
>
> Stanislav Porotikov
>
>
>
  • Pyspark UDF... Поротиков Станислав Вячеславович
    • Re: Py... Mich Talebzadeh
      • RE... Поротиков Станислав Вячеславович
      • RE... Поротиков Станислав Вячеславович
        • ... Поротиков Станислав Вячеславович
          • ... Hyukjin Kwon
            • ... Mich Talebzadeh
              • ... Поротиков Станислав Вячеславович
                • ... Mich Talebzadeh
            • ... Mich Talebzadeh
    • Re: Py... Mich Talebzadeh

Reply via email to