Edge Impulse, the leading platform for building, refining and deploying machine learning models and algorithms to Edge devices, has released a new suite of tools developed on NVIDIA’s Omniverse and AI platforms, bringing state-of-the-art AI models to a previously inaccessible class of devices on the Edge, and significantly speeding up the maturation of those models.
For the first time, transfer the power of NVIDIA TAO models from GPUs to run on any Edge device, including MCUs and MPUs.
Edge Impulse has pioneered a solution that automates and accelerates the use of large NVIDIA GPU-trained models on affordable MCUs and MPUs with AI accelerators. Users now have access to a large library of NVIDIA production-tested pretrained models directly in the Edge Impulse platform, and Edge Impulse’s EON Tuner simplifies selection of the optimal model for each application.
With the Edge Impulse and NVIDIA TAO Toolkit, engineers can create accurate, custom, production-ready computer vision models that can be seamlessly deployed to Edge-optimised hardware, including the Arm Cortex-M based NXP I.MXRT1170, Alif E3, STMicro STM32H747AI, and Renesas CK-RA8D1. The Edge Impulse platform allows users to now provide their own custom data with GPU-trained NVIDIA TAO models like YOLO and RetinaNet, optimising them for deployment on efficient, cost-optimised Edge devices, including MCUs, MPUs, and accelerators.
This new development also enables deployment of large-scale NVIDIA models to Arm-based devices, opening up a significant universe of hardware that can now be augmented with best-in-breed AI and ML models.
“The advent of generative AI and the growth of IoT deployments means the industry must evolve to run AI models at the Edge,” said Paul Williamson, Senior Vice President and General Manager, IoT Line of Business, Arm. “NVIDIA and Edge Impulse have now made it possible to deploy state-of-the-art computer vision models on a broad range of technology based on Arm Cortex-M and Cortex-A CPUs and Arm Ethos-U NPUs, unlocking a multitude of new AI use cases at the edge.”
Edge Impulse has developed applications for synthetic data and testing environments for the Edge with NVIDIA Omniverse, enabling faster time-to-market in key business verticals.
Synthetic data generation is a game-changer for industries operating in complex industrial, remote, or sensitive environments, where obtaining real-world data can be costly, time-consuming, create privacy concerns, or simply cannot account for all types of scenarios.
NVIDIA Omniverse Replicator, a framework for developing custom synthetic data generation pipelines, can be integrated into existing workflows to generate highly realistic, physically based datasets tailored to train computer vision models. Now, with Omniverse Replicator combined with Edge Impulse, users can rapidly create professional-grade industrial ML models that can run on resource-constrained devices, for use cases such as visual inspection of manufacturing production lines to detect defects, equipment malfunctions, or surgery inventory object detection to prevent postoperative complications. This allows customers to:
- Reduce physical prototyping and testing costs via virtual tools
- Speed up development time and experimentation, leading to faster time-to-market
- Simulate sensor and model behaviour, test MCU compatibility, and more
- Use synthetic data to fortify model reliability and create difficult-to-replicate scenarios
“Working closely with NVIDIA has enabled us to significantly expand the practical applications of AI on the Edge for critical business use cases in industrial productivity, healthcare, and much more. For the first time, NVIDIA’s state-of-the-art machine learning research and model architectures can be deployed on any device under the sun, from the smallest microcontrollers to the latest GPUs and neural accelerators,” said Jan Jongboom, Co-founder and CTO of Edge Impulse.
“NVIDIA Omniverse and TAO have incredibly simplified the creation of all computer vision models, including the latest generative AI models,” said Deepu Talla, Vice President of Robotics and Edge Computing at NVIDIA. “Edge Impulse is integrating this powerful capability into easy-to-use workflows for the hundreds of billions of IoT and Edge devices, including MCUs, accelerators and CPUs.”
There’s plenty of other editorial on our sister site, Electronic Specifier! Or you can always join in the conversation by commenting below or visiting our LinkedIn page.