Re: Topics for Spark online classes & webinars

2023-03-28 Thread asma zgolli
's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> >>> On Wed, 15 Mar 2023 at 18:31, Nitin Bhansali >&g

Re: Topics for Spark online classes & webinars

2023-03-13 Thread asma zgolli
Hello Mich, Can you please provide the link for the confluence page? Many thanks Asma Ph.D. in Big Data - Applied Machine Learning Le lun. 13 mars 2023 à 17:21, Mich Talebzadeh a écrit : > Apologies I missed the list. > > To move forward I selected these topics from the thread "Online classes

Re: Network statistics , network cost

2019-03-21 Thread asma zgolli
e jeu. 21 mars 2019 à 16:00, Saikat Kanjilal a écrit : > How about using this: https://github.com/LucaCanali/sparkMeasure > > Sent from my iPhone > > On Mar 21, 2019, at 7:46 AM, asma zgolli wrote: > > Hello , > > is there a way to get the network statistics, server an

Cross Join

2019-03-21 Thread asma zgolli
Hello , I need to cross my data and i'm executing a cross join on two dataframes . C = A.crossJoin(B) A has 50 records B has 5 records the result im getting with spark 2.0 is a dataframe C having 50 records. only the first row from B was added to C. Is that a bug in Spark? Asma ZGOLLI

Network statistics , network cost

2019-03-21 Thread asma zgolli
Hello , is there a way to get the network statistics, server and distribution statistics from spark? I m looking for that information in order to work on network communication performance. thank you very much for your help kind regards Asma ZGOLLI PhD student in data engineering - computer

understanding the plans of spark sql

2019-03-18 Thread asma zgolli
g the physical plan in spark, this plan includes hashaggregation operators but in the log of my MongoDB server the execution plan has pipelines for aggregation. I am really confused. thank you very much for your answers. yours sincerely Asma ZGOLLI PhD student in data engineering - computer science