...
LLMs on Edge with AI Accelerators , @L.c Chen Lai, Meta, 20 minutes
Recording
https://bytedance.us.larkoffice.com/minutes/obushm383935yto9t2f21255
Participants
@Wilson Wang @Tina Tsou @Ying Wang @Ashwanth Gnanavelu @Caleb J @HaruhisaFukano @Kris @李博睿 @Tom Qin @Lai Chen, Qi Wang, @Akram Sheriff
Summary
The meeting discussed the work progress and plans of the Infinite H AI TSC and its sub-teams, the main contents included:
TSC introduction: Tina Tsou introduced the TSC and Infinite H AI, and participants introduced themselves.
Edge computing: Chen Lei presented on deploying PyTorch models on edge with accelerators.
Workstream 3: Wilson Wang provided an update and overview of Workstream 3.
Workstream 5: Tom Qin discussed the potential integration of Chen Lei's presentation with Workstream 5.
Edge database: Qi Tang shared ideas on using a generic data manager for LLM services.
Next steps: Tina Tsou announced the next meeting and invited participants to a ByteDance open source event.
Chapters
00:08 Roundtable introductions in Infinite H AI TSC meeting before starting the agenda
...