...
First video demo https://youtu.be/tRk5pqiVJVA?si=syFt8Hl3Izhul3WT
10/22
LwM2M integration done
Start working on tests and documentation
Begin working with ROS2
10/29
working with https://github.com/pytorch/executorch/blob/main/examples/models/llama/README.md running LLM on device guide.
Working with Meta team Running quantized llama 3.2 model https://ai.meta.com/blog/meta-llama-quantized-lightweight-models/ on S23 cell phone and try Edge AI function calling inference on device. The AI power are mostly on CPU now.
Continue waiting on another quantized model which running AI inference on NPU.