Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Time

Title

Presenter

Presenter Organization or Company

Category

Tracks

View file
nameClussys_AI_Networking_LF.pdf

Slides

10:00

Opening

 

View file
nameOPEA _Bytedance_AI4D_Sept_2024.pptx

10:10

Use Coze to simplify your AI development

Gary Qi

Bytedance

Development with AI

https://docs.google.com/presentation/d/1B3l1L8_30vjP-wKV_BVj_WMgznEjHqhYRgKrGkWPLVM/edit#slide=id.g2cfeed57b1e_0_0

10:25

AI4D: Bridging the Gap Between Edge AI and Distributed Cloud Computing

Tina Tsou

ByteDance; InfiniEdge AI

Infrastructure, architecture

InfiniEdge AI

View file
nameAI4D-Bridging-the-Gap(1).pdf

11:05

Optimizing Edge and Cloud Inference Systems for Collaborative Large Language Models

Wenhui Zhang

Bytedance

Co-Ding Studio

Infrastructure, architecture

Akraino; InfiniEdge AI;

View file
nameOptimizing Edge and Cloud Inference Systems for Collaborative Large Language Models (1).pdf

11:45

Network and Computing Infrastructure for the 2030s

Haruhisa Fukano

Fujitsu

Infrastructure, architecture

Akraino;

View file
nameNetwork and Computing Infrastructure for the 2030s.pdf

12:15

Revolutionizing Edge Computing: AI and IoT with InfiniEdge AI

Tom Qin; C.C.

Edgenesis; Allegro

Infrastructure, architecture

InfiniEdge AI

https://docs.google.com/presentation/d/1hv27o1EPtvGGsVzW681ERJI-2q5eIVq-bkQSYzyOt6Y/edit?usp=sharing

13:00

Lunch

 

 

 

 

14:00

AutoSE: An Agentic AI Application Workflow

Zixuan Zhang

Bytedance

Development with AI

Linux Foundation AI & Data

View file
nameAutoSE_ An Agentic AI Application Workflow (2).pdf

14:40

Write Once Run Anywhere, but for GPUs

Michael Yuan

WasmEdge

Infrastructure, architecture

InfiniEdge AI;Linux Foundation AI & Data;

View file
nameWrite once, run anywhere, for GPUs.pdf

15:20

From '+AI' to 'AI+':China Mobile's New Strategic Planning and Practice in AI Era

Lingli Deng

China Mobile

Infrastructure, architecture

Linux Foundation AI & Data; Akraino;

View file
nameFrom '+AI' to 'AI+':China Mobile's New Strategic Planning and Practice in AI Era-part2.pdf

16:00

Using AI to scale global scale massive applications

Sujata Tibrewala

Bytedance

Development with AI

InfiniEdge AI

View file
nameAi Learning from massive scale applications.pdf

16:40

AI Networking: From TCP/IP to RDMA and UEC over CXL and UALink

Dr. Fu Li

Clussys Inc.

Infrastructure, architecture

Linux Foundation AI & Data

View file
nameClussys_AI_Networking_LF.pdf

17:20

An overview of IOWN Global Forum and a hardware-accelerated pipeline for efficient AI analysis over All Photonics Network

Rintaro Harada

NTT

Infrastructure, architecture

View file
nameAI for Developers_NTT.pdf

17:35

Closing

 

 

 

 

...

Time

Title

Presenter

Presenter Organization or Company

Category

Tracks

Slides

10:00

Opening

Malini

OPEA TSC Chair, LF AI & Data

 

 

View file
nameOPEA _Bytedance_AI4D_Sept_2024.pdf

View file
nameOPEA _Bytedance_AI4D_Sept_2024.pptx

10:10

Introduction to EdgeLake

Moshe Shadmon

AnyLog

Data management

EdgeLake

View file
nameEdgeLake-Intro.pdf

10:50

EdgeLake - Enabling AI at the Edge Using a Plug & Play Software Stack

John Freier

AnyLog

Data management

InfiniEdge AI

View file
nameEdgeLake-AI.pdf

11:30

A novel solution to tackle the data silos in AGI era

Jerry Shao

Datastrato

Data management

Linux Foundation AI & Data;

View file
nameGravitino - A novel solution to tackle data silos in AGI era (LF AI&Data) (1).pdf

12:10

Identifying the Drivers of Political Polarization Using Language Models

Josh Joseph

Stanford University / Fileread AI

AI model, Use case

Linux Foundation AI & Data;

https://combating-polarization-w-wqbzbxa.gamma.site/

12:25

Jose Menendez

Groq

View file
nameByteDanceFri13th.pdf

13:05

Lunch

 

 

 

 

13:55

Turbo your data analysis by open source project Ryoma 

Hao Xu

AITA

AI model, Use case

Linux Foundation AI & Data;

View file
nameAita @ LF Edge.pdf

14:35

Small Language Model for On-Device Speech Recognition

Jeff Brower

Signalogic, Inc.

AI model, Use case

Akraino; InfiniEdge AI;

View file
nameInfiniEdge_AI_Fall_AI_Data_Meeting_Signalogic_v3.pdf

15:15

Toward teams of AIs: Conversational assistants that converse with each other

Deborah Dahl

Conversational Technologies

AI model, Use case

Linux Foundation AI & Data;

View file
nameteamsOfAssistants.pdf

View file
nameteamsOfAssistants.pptx

15:30

Closing

 

 

 

 

...

The meeting discussed the development and application of AI in various fieldsartificial intelligence, as well as related technologies and challenges, the main contents included:

  • Speech recognition: Wilson Wang introduced the challenges and solutions in speech recognition, including the use of proximity addressable memory for efficient processing.

  • Data catalog and LM agent: Hao Xu presented the data catalog and LM agent, which can help users query data and interact with LM.

  • Conversational assistance interoperability: Deborah Dahl talked about enabling voice and conversational AI systems to function like the web, and the Open Voice Interoperability Initiative.

  • Sound alike errors: Wilson Wang focused on the problem of sound alike errors in speech recognition and how to fix them.

  • Intermediate stage in SLM: Wilson Wang emphasized the need for an intermediate stage before the SLM to identify likely possible sound like substitutionsEdge Lake: A software enabling AI at the edge, with features and potential applications.

  • Graftino: A unified metadata layer to handle data silos in the AG era.

  • Language models: Used in identifying drivers of political polarization and reducing it through deliberative polling.

  • Interoperable chatbot: Its features, ability to participate in teams, and handling of security concerns.

  • AI in data analysis, speech recognition, and intelligent assistants: Research results and experiences shared.

  • Challenges and solutions in AI development: Such as data privacy, model performance, and energy consumption.

  • Open source projects and initiatives: To promote the development and application of AI.

Chapters

00:00 Meeting Kickoff

Meeting Kickoff

01:34 Challenges and Solutions in Real-Time Speech Recognition with AI and Energy Efficiency Considerations

This section discusses speech recognition challenges, especially sound alike errors and precision issues. It focuses on post-processing with AI, using small language models and proximity addressable memory for accuracy. It also covers hardware requirements, energy efficiency concerns, and the status of ongoing efforts and potential future developments.

24:14 Challenges and Approaches in Context Processing and Security for First Responders' Devices

This section discusses challenges and approaches in language processing for various scenarios like factories and first responders. It considers the need for context base processing, testing in different conditions, issues of security and privacy, authentication, and the use of models like Lama 2. The conversation also touches on potential solutions and the next steps for testing and implementation.

32:37 The Project of Using LM Agent to Address Data Query Issues in the Team

This section is about a presentation by Hao Xu representing the item team. They have around 4.5 people working on the project. The team is addressing the issue of numerous ad hoc data-related queries and exploring using an LM agent to assist. They avoid giving raw data to third-party vendors due to privacy concerns and are building a system with three major components for processing and answering queries.

40:52 Overview of Components and Features in Data Query and Processing Framework

This section covers various aspects including direct data query methods, use of data frame APIs and Linux projects for metadata. It discusses the core component agent controlling aspects like prompts and tools. Workflow customization, built-in tools, prompt templates, vector stores, data catalogs, and their relationships are also mentioned.

49:49 Overview of Hao Xu's Project and Call for Contributions

This section covers the use of Python and various technologies for building an application. It mentions an integrated notebook environment for query modification and interaction. Three teams are currently using ITA. The project is in an early stage, lacks cloud deployment, needs robust testing and automation. It was recently renamed and those interested can reach out. There are no questions today and a next person introduction is planned.

56:32 Interoperability of Conversational AI Systems and Ongoing Work

...

03:45 Edge Lake: Enabling AI at the Edge and Addressing Challenges

This section is a meeting transcript mainly discussing issues related to Lark, including someone's inability to join, the use of AI transcription feature, and account purchase. It also covers an overview and demonstration of Edge Lake, a platform for managing data at the edge, along with questions on data protection and handling single point of failure.

33:31 Edge Lake: Enabling AI and Federated Learning with Virtualization and Security

This section discusses Edge Lake, its use of blockchain for virtualization and metadata sharing, enabling synchronized operation of nodes. It covers Edge Lake's role in AI, including data collection, model generation, and distribution, comparing traditional and federated learning. Security and challenges of federated learning are also addressed. The presentation is a work in progress, welcoming input and contributions.

55:39 Discussions on Various Technical and Operational Issues in TikTok and Related Fields

This section contains a somewhat chaotic and diverse discussion. It covers topics such as breaks, TikTok, data and security issues related to AI products, login problems, various musical mentions, and scattered remarks about different technologies and experiences. The conversation is fragmented and lacks a clear central theme.

01:14:06 Introducing Graptino: A Unified Metadata Lake for Data Management

This section focuses on the introduction of Graptino, a unified metadata lake project. It discusses the evolution of data management architectures and the challenges they pose. Graptino aims to unify metadata to solve data silo problems, support various data types and scenarios, and is presented with its architecture, features, usage scenarios, and community aspects. Different from similar projects, Graptino is an open source solution with a focus on real-time operation and a distinct scope.

01:57:02 Research on Reducing Political Polarization with AI and Deliberative Polling

This section mainly focuses on Josh Joseph's presentation on using AI tools to address political polarization. He explains the concept of deliberative polling and its challenges, presents a new model with Bert and GPT-4 components, shows its training and results, and discusses applications and future work. It also covers issues like data analysis, synthetic noise addition, and potential expansions to other domains.

02:31:40 Discussions and Thoughts on Various Topics

This section is a rather chaotic and diverse discussion involving lunch preparations, presentations, various topics such as TikTok, personal experiences, and random thoughts. Participants like Wilson Wang and others contribute sporadically with no clear central theme or concrete decisions reached.

03:11:06 Discussions on AI-related Projects and Technologies

This section contains discussions from multiple speakers on various AI-related topics. It includes talks about Grog's focus on inference part in AI, Jose's presentation on its capabilities, and alivedaru's introduction to the Open Platform for Enterprise AI project with its components, challenges, and ways to get involved like hackathons. There were also questions and exchanges on related aspects.

03:56:20 Challenges and Solutions in Real-Time Speech Recognition for Robotics and First Responders

This section is mainly about Signal Logic's participation in various projects related to speech recognition for robotics and edge computing. It discusses challenges such as sound alike errors, background noise, and the need for real-time processing without relying on the cloud. The company is working on post-processing and using reduced language models to improve accuracy, and they are exploring different hardware and algorithms to meet functional requirements.

04:33:33 Updates on ETA and Conversational Technologies in Data and AI

This section features presentations from Wilson Wang and Zebra Doll. Wilson Wang represents the ETA team, discussing their project addressing data-related challenges and the use of LM agents. Zebra Doll presents on the Open Voice Interoperability Initiative, aiming to enable seamless interaction among conversational AI systems and outlining their progress and future work. There were also technical issues and limited questions.

05:19:06 Various Topics and Experiences Shared

This section contains various remarks from different speakers. It mentions the happy hour at 4:30 and driving directions. There are also discussions about events, TikTok connections, work experiences, and the growth of a company from 29 to over 25 people. Speakers share diverse and somewhat disjointed information.