...
Release 1 Presentation (10-15min each)
Work stream 1https://lf-edge.atlassian.net/wiki/x/KwLP : C.C. Fan Yona Cao
Work stream 2https://lf-edge.atlassian.net/wiki/x/fwDP : Qi Tang
Work stream 3https://lf-edge.atlassian.net/wiki/x/mQDP : Borui Li (李博睿) Wilson Wang
Work stream 4https://lf-edge.atlassian.net/wiki/x/cwHP : Moshe Shadmon
Work stream 5https://lf-edge.atlassian.net/wiki/x/OQLP : Tom Qin Kris He
Work stream 6: Haruhisa Fukano
Coze AI Agent Marketplace Coze AI Agent Marketplace Tina Tsou https://lf-edge.atlassian.net/wiki/x/DICVAQ : Haruhisa Fukano
Recording
https://bytedance.us.larkoffice.com/minutes/obusk1j1b2p8i7rv87c34bjl?from=from_copylink
Summary
The meeting discussed various aspects of projects like Spear, AI platform, work streams, and robotics. The main contents include:
Release 1 Review Meeting Preparation：Discussed the preparations and issues related to the Release 1 review meeting, including sharing the screen, adding agenda items, and presenting work streams.
Spear: Scalable and Performant Agent Runtime：Discussed the overview, progress and future plans of Spear, a scalable and performant agent runtime, including its system workflow and key technologies.
Spear Building Block Figure and Release Plan：Discussed the preliminary building block figure of spear, including its organization into user space and kernel space, components to be implemented, and the release plan for various features.
Implementation and Project Progress of Spear：Discussed the implementation of the first release and the project progress of Spear, including various features and future plans.
Spear Project Presentation and Q&A：Discussed the plans and progress of the Spear project, including industry collaboration and community engagement, and addressed questions and suggestions.
Software Installation and Release Discussion：Discussed the software's support for Linux and Mac, the Linux version used, the issue of test documentation, and the requirements for the release note.
Review of Work Streams and Issues：Discussed the review of various work streams including test documentation, one-pager, CD logs, and security, along with identified issues and proposed solutions.
Preparing Security Document and Work Stream Updates：Discussed the preparation of the security document, alignment with other work streams, and updates on various work stream aspects such as Yumo.
Updates and Features of an AI Platform：Discussed the various functions and features of an AI platform, including system prompt editing, cost efficiency, new features like prompt catching, and upcoming additions such as node JS support.
Infinite Edge AI Open Source Project and Documentation Review：Discussed the plans for an open source project in Infinite Edge AI, including building a new tool and migrating the project to Github, as well as reviewed various related documents and addressed issues regarding tests, logs, and one-pager presentation.
Work Stream Updates and Requirements：Discussed the progress and requirements of various work streams, including security scan, upstream software dependency, and presentation of work stream materials.
Work Stream Release 1 Presentation of Age Gateway：Discussed the presentation of work stream release 1 of Age Gateway, including its introduction, challenges, solutions, updates and future plans.
Product Subcloud and Its Device APIs：Discussed the scalability, seamless integration, and application development based on the device APIs of the product Subcloud.
Challenges and Solutions of Deploying LM on Devices：Discussed the challenges and solutions when deploying language models (LM) on devices, including identifying user intent, mapping to function calls, dealing with device limitations, and building a workflow pipeline.
Improvement of Age Model and Gateway Update：Discussed the methods to improve the age model's understanding of user queries and generate accurate function calls, as well as the update of the age gateway with a new protocol.
Updates and Plans of SIFU：Discussed the current status and future plans of SIFU, including function support, model improvement, and documentation.
Updates on Releases and Robotics Architecture
Release Repository：All releases are kept in the TikTok repository. The latest release is 0.59 with features, enhancements, and dependency updates.
One Pager Content：The one-pager for qifu will include a high-level summary of its role as an edge gateway, along with live demo features, terminologies, community links, installation documents, demo links, and contributions.
CD Locks and Logs：All runs are on Azure Devops, where each release, build logs, detailed logs, testing, and building can be viewed.
Security Verification：Security verification is using the built-in Github. Currently, there are no security advisories and repos are updated to avoid outdated packages.
Robotics Architecture：The architecture document for robotics was described two years ago. It includes components like automatic space recognition core, sensor networks, data analysis, and data storage. Also covers the working of each component, hardware used for tests and installations, and open source versions used for installation and test.
Installation and Documentation of Components
Component Installation：Installed architectures of components like IoT gateways and PCC for robotics control based on certain steps.
Test Document：Test items based on installations, described test procedures and results to confirm successful installation.
Release Note：Summarized release contents, update procedure, included Lily's statement, and noted no limitations and issues.
Log File Issue：Approved upload of CD and security certification log files to the system 2 years ago, but now they are missing and being confirmed.
Updates on Robotics and AI Agent Marketplace
Robotics Security：Docker container for speech recognition in robotics has security protocols and checks, but Signal Logic didn't.
Robotics Constraints：Robotics running on edge devices without cloud connection has limitations.
AI Agent Creation：Coast offers a platform for developers to build agents, allowing naming, function description, model selection, and plugin addition.
AI Agent Workflows：Complex or simple workflows can be created for various applications like in the hospitality industry.
AI Agent Sharing：Sharing agents with the public requires billing and the option of sponsored messages.
Knowledge Consumer Applications and Agent Creation
Document Formats：The platform can handle different document formats like PDFs, Google Docs, and custom content for better assistance in answering consumer questions.
API Connections：Users can connect to an API and use image formatting. The platform can parse and understand the input information.
Agent Creation：Developers can create a single agent to solve specific solutions, which can be published in different chat UIs and deployed through SDK or API connection.
Customization：Agents can be customized and integrated with various digital forms like Squarespace sites based on the knowledge base and variables input.
Approval of Work Streams and Voting Members
Conditional Approval Motion：Tina Tsou proposed a motion to conditionally approve all work streams 1 to 6 except 4 and asked for a second.
Members' Responses：Some members like CC, Tom Qin, Yongli Chen, Wenhui Zhang, etc. responded with yes or no for the voting.
Absent Members：Some members like Jose, Caleb Jiang, and Qitang were not present or did not respond.
Waiting for Votes：Waiting for additional votes from TSC members within 24 hours and asked Wilson Wang to contact Wenhui Zhang and Caleb Jiang for their votes.
Chapters
00:25 Pre - meeting arrangements and presentation order for Release 1 review meeting
This section is about a pre - meeting discussion. Tina Tsou asks Tom Qin to share the agenda screen and Wilson Wang to remind leaders about the Release 1 review meeting. Tina Tsou mentions adding the Codes AI Agent Marketplace to the agenda. CC is unprepared to present from work stream 1. Tom Qin asks about Qicang's presence and Tina Tsou asks Wilson to remind Chi. Finally, Boray and Watson will start presenting from work stream 3.
04:39 Spear Project: Overview, Progress, and Future Plans
This section is about the SPEAR project. It first presents the system workflow with offline and online phases and key technologies. Then it shows the building blocks in user and kernel spaces. Wilson Wang shares the first - release implementation like POC platform. The project progress in aspects like runtime support is discussed. Future plans for Release 2 including technology progress and collaborations are also mentioned.
23:33 Review of Spear TikTok project deliverables and related discussions
This section mainly focuses on a review meeting. Tina Tsou asks about slide upload, collaboration documentation, and item-by -item presentation. There are discussions on various topics like release notes, read me one -pager, CD logs, security documents, upstream reviews, and presentation documents. Tina Tsou will conditionally approve deliverables with some materials to be supplemented within 24 hours, and then they will move to the next work stream.
36:09 Yumo: A Stateful Service Framework for Hai with Function - Calling Features and Future Plans
This section is about CC's presentation on Yumo. Yumo is a stateful service framework for Hai. It adds features for easier function calling, like connecting to third - party APIs or databases. Plans include releasing a service card next year. There are various features and improvements, such as a system prompt editor on the dashboard. CC also mentioned future plans like adding node GS support and opening with great to infinite edge org. Tina Tsou then reviewed some related items like architecture DOC, installation, etc.
54:46 Work progress review and upcoming presentations in multiple work streams
This section is mainly about the work stream. One person apologized for not preparing enough materials due to being busy but will work on a one - slide summary and fill up a table that night. The goal of work stream No.2 was mentioned as turning data into agent services on the edge for easy user access without online tools or coding knowledge. Tina Tsou asked for all materials within 24 hours for an online review, and then they moved on to discuss work stream four and five.
57:46 Age Gateway (Sifu) Introduction, Challenges, Solutions and Future Plans
This section is about a work stream release 1 presentation. The presenter, Chris (何建新), outlines the agenda including introducing Age Gateway (sifu), its deep features like embodied intelligence, function calling challenges on it and solutions. He also covers the Age Gateway update and future plans. After the presentation, Tina Tsou asks about the version for Blake and requests to see a big table for items.
01:15:33 Discussion on Shifu's Architecture, Testing, Releases, and Documentation
This section mainly focuses on various aspects of a project. Tom Qin presents items like the architecture diagram, testing documentation with mock devices, releases in TikTok repository, UH1 pager's readme for qifu, CD locks on Azure Devops with security verification on Github. Tina Tsou requests that external links and documentation be placed in the wiki and code base, and then they move on to the next work stream.
01:20:53 Discussion on Robotics - Walkstream 6 and Related Documents
This section mainly focuses on Walkstream 6 in robotics. HaruhisaFukano presents various documents related to it, such as the architecture document, installation guide, test document, latest note, one - pager document. There are also discussions on issues like CD log and security certification log files. Tina Tsou and others further discuss aspects like security and upstream software use, and finally move on to the topic of AI agent marketplace.
01:30:13 Coast Platform: A Platform for Developers to Create and Publish Agents
This section is a presentation about Codes for developers interested in creating agents on the Coast platform. It covers how Codes works, features like building solutions with AI, different application types (consumer and business - to - consumer), creating agents, adding plugins, creating knowledge in various formats, and how agents can be published in different ways. Also, an example of an agent on a Squarespace site is given, and there's a mention of the marketplace.
01:36:21 TSC Voting on Work Stream Deliverables and Holiday Wishes
This section focuses on various meeting topics. Noe Otero and Tina Tsou discuss using something in the marketplace. Tina Tsou gives a motion to conditionally approve work streams 1 - 6 except 4 and asks for seconds. Votes are taken, but it's unclear if it passes half of the TSC. They'll wait 24 hours for additional votes. Tina Tsou also mentions future nominations and holidays.