TSC 2024/08/15 (Scaling and Performance)

Date: Aug. 15 2024

Topic: Architecture / Tunning / Scaling and Performance

The meeting includes a presentation on the EdgeLake Architecture in the context of scaling and performance.

EdgeLake is deployed as a network of nodes that operate as a single machine to process and service edge data.  One characteristic of the edge is the huge volumes of data. A second characteristic is the distribution of the data.

Using Virtualization, EdgeLake provides a unified view of the distributed data. In this meeting. We will explain and discuss the architecture and monitoring of the individual nodes in the context of large volumes of distributed data.  We will also discuss the architecture that enables and monitors MapReduce processes, allowing for a high degree of parallelism when multiple nodes operate concurrently to service data as a single collection of data.

Agenda:

1. Single Node

• Data Path

• Threads

  • Insert

  • Query

• Configurations

• Monitoring

2. Network of Nodes

• Data Distributions

• Queries

• Monitoring

3. Q & A, Open Discussion

Meeting Recording

Presentation:

Open