Dear all, We are organizing a side meeting on "Inter-DC & Edge AI traffic handling" on Thursday 7th from 1:30pm to 3pm in Wicklow Hall 2A. This side meeting at IETF121 will continue the dialogue initiated during IETF 120.
The growth in terms of number of parameters of LLM models as well as the need to use or train those models with private or protected data will require service providers operating LLM-based services to cooperate to train, specialize or serve LLM-based services in a distributed or decentralized setting involving heterogeneous resources. Given their structure, the number of parameters they incorporate and the collective communication libraries they are built with, LLM training and inference (or serving) network traffic has specific characteristics. In that regard, understanding the specificities of AI-related workloads is critical to determine how to operate AI-based services in a heterogeneous setting. The side meeting will feature presentations to tease out key insights from various players in this field, leaving dedicated time for discussing possible next and concrete steps in the IETF to move forward, with the following agenda: Room: Wicklow Hall 2A Remote participation: https://ietf.webex.com/meet/ietfsidemeeting2 (IETF Webex) Github link (with presentation slides coming as soon as possible): https://github.com/afressancourt/IDEA-traffic-handling/blob/main/side-meetings/IETF-121/README.md Agenda: 13:30 - 13:35: Meeting setup and introduction of the topic (Antoine Fressancourt, Huawei) 13:35 - 13:50: Accommodating LLM Service over Heterogeneous Computational Resources (Binhang Yuan, HKUST) 13:50 - 14:00: RDMA proxy Inter-DC Over WAN Using Gateway (Rubing Liu, H3C) 14:00 - 14:15: Considerations on Inter-DC Network Requirements (Yisong Liu, China Mobile) 14:15 - 14:30: Research Progress of Intelligent Computing Networks in China (Liang Guo - Chief Engineer of Cloud Computing and Big Data Research Institute, CAICT) 14:30 - 14:40: Presentation by Oscar Gonzalez de Dios (Telefónica) 14:40 - 15:00: Discussion on challenges to address in IETF and conclusion We hope to see you on Thursday for a fruitful and engaging discussion! Best, Antoine Fressancourt, on behalf of the organizers
_______________________________________________ Int-area mailing list -- int-area@ietf.org To unsubscribe send an email to int-area-le...@ietf.org
