Oops, I was confused about the time and distance in the US. I won't make it too. Let me find another time slot that works for more ppl.
On Thu, 23 Jun 2022 at 00:19, Dongjoon Hyun <[email protected]> wrote: > Thank you, Hyukjin! :) > > BTW, unfortunately, it seems that I cannot join that quick meeting. > I have another schedule at South Bay around 7PM and need to leave San > Francisco at least 5PM. > > Dongjoon. > > > On Wed, Jun 22, 2022 at 3:39 AM Hyukjin Kwon <[email protected]> wrote: > >> (cc @Yikun Jiang <[email protected]> @Gengliang Wang >> <[email protected]> @Maxim Gekk <[email protected]> >> @Yang,Jie(INF) <[email protected]> FYI) >> >> On Wed, 22 Jun 2022 at 19:34, Hyukjin Kwon <[email protected]> wrote: >> >>> Couple of updates: >>> >>> - >>> >>> All builds passed now with all combinations we defined in the GitHub >>> Actions (e.g., branch-3.2, branch-3.3, JDK 11, >>> JDK 17 and Scala 2.13), see https://github.com/apache/spark/actions >>> cc @Tom Graves <[email protected]> @Dongjoon Hyun >>> <[email protected]> FYI >>> - >>> >>> except one test that is being failed due to OOM. That’s being fixed >>> at https://github.com/apache/spark/pull/36954, see >>> also https://github.com/apache/spark/pull/36787#discussion_r901190636 >>> - >>> >>> I am now adding PySpark, SparkR jobs to the scheduled builds at >>> https://github.com/apache/spark/pull/36940 >>> and see if they pass. We might need a couple of more fixes there. >>> - >>> >>> There’s one last task to simply caching the Docker image ( >>> https://issues.apache.org/jira/browse/SPARK-39522). >>> I will have to be less active for this week and next week because of >>> the Spark Summit. Would appreciate if somebody >>> finds some time to take a stab. >>> >>> About a quick hallway meetup, I will be there after Holden’s talk at >>> least to say hello to her :-). >>> Let’s have a quick chat about our CI. We still have some general >>> problems to cope with like the lack of resources in >>> GitHub Actions. >>> >>> >>> >>> On Tue, 21 Jun 2022 at 11:49, Hyukjin Kwon <[email protected]> wrote: >>> >>>> Just chatted offline - both I and Holden have multiple sessions :-). >>>> Probably let's meet up for a quick chat after your talk >>>> https://databricks.com/dataaisummit/session/what-do-when-your-job-goes-oom-night-flowcharts >>>> ? >>>> >>>> >>>> On Mon, 20 Jun 2022 at 22:23, Holden Karau <[email protected]> >>>> wrote: >>>> >>>>> How about a hallway meet up at Data AI summit to talk about build CI >>>>> if folks are >>>>> Interested? >>>>> >>>>> On Sun, Jun 19, 2022 at 7:50 PM Hyukjin Kwon <[email protected]> >>>>> wrote: >>>>> >>>>>> Increased the priority to a blocker - I don't think we can release >>>>>> with these build failures and poor CI >>>>>> >>>>>> On Mon, 20 Jun 2022 at 10:39, Hyukjin Kwon <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> There are too many test failures here. I pinged in some PRs I could >>>>>>> identify from a cursory look but would be great for you guys to take a >>>>>>> look >>>>>>> if you guys haven't tested your change against other environments like >>>>>>> JDK >>>>>>> 11, Scala 2.13. >>>>>>> >>>>>>> On Mon, 20 Jun 2022 at 10:04, Hyukjin Kwon <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi all, >>>>>>>> >>>>>>>> I am trying to rework GitHub Actions CI at >>>>>>>> https://issues.apache.org/jira/browse/SPARK-39515. Any help would >>>>>>>> be very appreciated. >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>> Twitter: https://twitter.com/holdenkarau >>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>> >>>>
