- Leaders: Yona Cao C.C. Fan
- Objective: This work stream focuses on optimizing the performance and scalability of cloud infrastructure across multiple geographical locations. It aims to address challenges related to latency, data sovereignty, and efficiency in distributed computing environments.
- Approach: The team will develop strategies for seamless data synchronization and application performance across dispersed networks, ensuring robust, secure, and compliant operations globally.
Introduction to vivgrid (private beta)
vivgrid.com is a geo-distributed public edge cloud for AI agents, which helps developers deploy their AI apps closer to users for lightning-fast performance. With vivgrid, developers will enjoy higher efficiency at lower costs with global infrastructure solutions. Give users the seamless experience they deserve.
Features
- Globally located AI inference infrastructure
- Developers can deploy their AI applications with a single click, and Vivgrid will deploy the application across multiple nodes worldwide, automatically selecting the compute node closest to the user based on their location.
...
- Function calling
With the general function calling service, developers only need to configure function calling once on the Vivgrid platform to correctly invoke the function calling capabilities of different large language models
- Easily prompt management
- Enable non-developers to easily update system prompts directly from the dashboard, applying changes instantly without coding. Say goodbye to constant modifications for developers and streamline your workflow with our intuitive prompt management feature.
Timeline
Phase 1: Provide OpenAI API acceleration gateway, allowing developers to easily start using the globally accelerated OpenAI API on Vivgrid with simple configuration. Additionally, offer easy-to-use best practices for streaming requests and responses with the OpenAI API.
...