TinyML MCU 等級開源推論引擎

Jack OmniXRI, 2025.6.5 整理製作

開源推論引擎

• Arm CMSIS-6 (NN, DSP)
  https://github.com/ARM-software/CMSIS_6
• Google LiteRT （TensorFlow Lite）
  https://github.com/google-ai-edge/litert
• Google TensorFlow Lite for Microcontroller (TFLite-Micro)
  https://github.com/tensorflow/tflite-micro
• PyTorch ExecuTorch
  https://github.com/pytorch/executorch
• PyTorch QNNPack
  https://github.com/pytorch/qnnpack
• Alibaba MNN
  https://github.com/alibaba/MNN
• Alibaba TinyNeuralNetwork  
  https://github.com/alibaba/TinyNeuralNetwork  
  
• Tencent TNN
  https://github.com/Tencent/TNN
• Tencent NCNN
  https://github.com/Tencent/ncnn
• uTensor
  https://github.com/uTensor/uTensor
• Fraunhofer-IMS AIfES
  https://github.com/Fraunhofer-IMS/AIfES_for_Arduino
• Sipeed TinyMaix
  https://github.com/sipeed/TinyMaix
• XiaoMi MACE
  https://github.com/XiaoMi/mace
• PaddlePaddle Paddle-Lite
  https://github.com/PaddlePaddle/Paddle-Lite
• Eloquent EloquentMicroML
  https://github.com/eloquentarduino/EloquentMicroML
• Kraiskil ONNX2C
  https://github.com/kraiskil/onnx2c
• Huawei MindSpore
  https://github.com/mindspore-ai/mindspore
• SenseTime OpenPPL (PPLNN)
  https://github.com/OpenPPL/ppl.nn
• Open AI Lab Tengine
  https://github.com/OAID/Tengine

AI 相關編譯器

• MicroTVM
  https://tvm.hyper.ai/docs/topic/microtvm/
• Skymizer ONNC
  https://github.com/ONNC/onnc
• Arm Ethos-U Vela Compiler
  https://pypi.org/project/ethos-u-vela/

MCU 專用工具

• Edge Impulse
  https://docs.edgeimpulse.com/docs
• STM32
  • CubeAI (X-CUBE-AI)
    https://stm32ai.st.com/stm32-cube-ai/
  • NanoEdge AI Studio
    https://stm32ai.st.com/nanoedge-ai/
  • ST Edge AI Suit
    https://www.st.com/content/st_com/en/st-edge-ai-suite.html
• NXP eIQ
  https://www.nxp.com/design/design-center/software/eiq-ai-development-environment:EIQ
• Renesas eAI
  https://www.renesas.com/en/key-technologies/artificial-intelligence/e-ai/e-ai-development-environment-microcontrollers