Vision Algorithms for Embedded Vision
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language. Some of the pixel-processing operations (ex: spatial filtering) have changed very little in the decades since they were first implemented on mainframes. With today’s broader embedded vision implementations, existing high-level algorithms may not fit within the system constraints, requiring new innovation to achieve the desired results.
Some of this innovation may involve replacing a general-purpose algorithm with a hardware-optimized equivalent. With such a broad range of processors for embedded vision, algorithm analysis will likely focus on ways to maximize pixel-level processing within system constraints.
This section refers to both general-purpose operations (ex: edge detection) and hardware-optimized versions (ex: parallel adaptive filtering in an FPGA). Many sources exist for general-purpose algorithms. The Embedded Vision Alliance is one of the best industry resources for learning about algorithms that map to specific hardware, since Alliance Members will share this information directly with the vision community.
General-purpose computer vision algorithms
One of the most-popular sources of computer vision algorithms is the OpenCV Library. OpenCV is open-source and currently written in C, with a C++ version under development. For more information, see the Alliance’s interview with OpenCV Foundation President and CEO Gary Bradski, along with other OpenCV-related materials on the Alliance website.
Hardware-optimized computer vision algorithms
Several programmable device vendors have created optimized versions of off-the-shelf computer vision libraries. NVIDIA works closely with the OpenCV community, for example, and has created algorithms that are accelerated by GPGPUs. MathWorks provides MATLAB functions/objects and Simulink blocks for many computer vision algorithms within its Vision System Toolbox, while also allowing vendors to create their own libraries of functions that are optimized for a specific programmable architecture. National Instruments offers its LabView Vision module library. And Xilinx is another example of a vendor with an optimized computer vision library that it provides to customers as Plug and Play IP cores for creating hardware-accelerated vision algorithms in an FPGA.
Other vision libraries
- Halcon
- Matrox Imaging Library (MIL)
- Cognex VisionPro
- VXL
- CImg
- Filters
Navigating the LiDAR Revolution: Trends and Innovations Ahead
This market research report was originally published at the Yole Group’s website. It is reprinted here with the permission of the Yole Group. There are today two distinct LiDAR markets: China and the rest of the world. In China, approximately 128 car models equipped with LiDAR are expected to be released by Chinese OEMs in
Axelera AI Demonstration of Fast and Efficient Workplace Safety with the Metis AIPU
Bram Verhoef, Co-founder of Axelera AI, demonstrates the company’s latest edge AI and vision technologies and products at the 2024 Embedded Vision Summit. Specifically, Verhoef demonstrates how his company’s Metis AIPU can accelerate computer vision applications. Axelera AI, together with its partner FogSphere, has developed a computer vision system that detects if people are wearing
AMD to Acquire Silo AI to Expand Enterprise AI Solutions Globally
Europe’s largest private AI lab to accelerate the development and deployment of AMD-powered AI models and software solutions Enhances open-source AI software capabilities for efficient training and inference on AMD compute platforms SANTA CLARA, Calif. — July 10, 2024 — AMD (NASDAQ: AMD) today announced the signing of a definitive agreement to acquire Silo AI,
Network Optix Demonstration of Instantly Deployable Face Detection on OrinAGX with the Nx AI Manager
Jason Lee, Nx Business Development Manager at Network Optix, demonstrates the company’s latest edge AI and vision technologies and products at the 2024 Embedded Vision Summit. Specifically, Lee demonstrates an instantly deployable face detection AI model on NVIDIA’s OrinAGX using the Nx AI Manager, a plugin specifically designed to add AI functionality on the edge
Decoding How the Generative AI Revolution BeGAN
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. NVIDIA Research’s GauGAN demo set the scene for a new wave of generative AI apps supercharging creative workflows. Editor’s note: This post is part of the AI Decoded series, which demystifies AI by making the technology more
Network Optix Demonstration of Instantly Scalable AI Models Using the Nx AI Manager
Wim De Wispelaere, Nx Senior Business Development Manager at Network Optix, demonstrates the company’s latest edge AI and vision technologies and products at the 2024 Embedded Vision Summit. Specifically, De Wispelaere demonstrates the Nx AI Manager, a plugin specifically designed to add AI functionality on the edge to video solutions built using the Nx Enterprise
Network Optix Demonstration of Seamlessly Deploying AI Models at the Edge with Nx AI Manager
Wim De Wispelaere, Nx Senior Business Development Manager at Network Optix, demonstrates the company’s latest edge AI and vision technologies and products at the 2024 Embedded Vision Summit. Specifically, De Wispelaere demonstrates Nx AI Manager, the newest addition to the Nx Toolkit, a plugin specifically designed to add AI functionality on the edge to video
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Useful Sensors
Pete Warden, CEO of Useful Sensors, presents the “Deploying Large Language Models on a Raspberry Pi,” tutorial at the May 2024 Embedded Vision Summit. In this presentation, Warden outlines the key steps required to implement a large language model (LLM) on a Raspberry Pi. He begins by outlining the motivations… “Deploying Large Language Models on
Broad Industry Recognition for Our Centrally Processed 4D Imaging Radar Architecture and Corporate Culture
This blog post was originally published at Ambarella’s website. It is reprinted here with the permission of Ambarella. Winning an award is always exciting, but winning eight is truly exhilarating! We’re honored that our groundbreaking architecture—which includes both Ambarella’s Oculii™ adaptive AI radar software and our CV3-AD family of highly efficient 5nm AI central domain
“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentation from Synaptics
Deepak Mital, Senior Director of Architectures at Synaptics, presents the “How to Run Audio and Vision AI Algorithms at Ultra-low Power” tutorial at the May 2024 Embedded Vision Summit. Running AI algorithms on battery-powered, low-cost devices requires a different approach to designing hardware and software. The power requirements are stringent… “How to Run Audio and
AI-powered Productivity: Windows on Snapdragon X Elite Welcomes Game-changing Apps
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. A new generation of AI apps for Windows powered by the 45 TOPS NPU in Snapdragon X Elite Get ready to turbo-charge your productivity and creativity this summer, when Windows gets enhanced by artificial intelligence (AI). AI-powered
“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Presentation from Midokura, a Sony Group Company
Dan Mihai Dumitriu, Chief Technology Officer at Midokura, a Sony Group company, presents the “Build a Tiny Vision Application in Minutes with the Edge App SDK” tutorial at the May 2024 Embedded Vision Summit. In the fast-paced world of embedded vision applications, moving rapidly from concept to deployment is crucial.… “Build a Tiny Vision Application
Generate Traffic Insights Using YOLOv8 and NVIDIA JetPack 6.0
This article was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Intelligent Transportation Systems (ITS) applications are becoming increasingly valuable and prevalent in modern urban environments. The benefits of using ITS applications include: Increasing traffic efficiency: By analyzing real-time traffic data, ITS can optimize traffic flow, reducing congestion and
Can Ceva Ignite the Yet-to-explode TinyML Market?
The IoT market is yet to see an “explosive growth” in TinyML. Is that due to inadequate hardware, ever-shifting software or not enough ML skills in the embedded community? What’s at stake: TinyML in embedded systems can be implemented many ways, often by leveraging beefed-up MCUs, DSPs, AI accelerators and Neural Processing Units (NPUs). The
“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Presentation from Intel
Tara Thimmanaik, AI Systems and Solutions Architect at Intel, presents the “Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” tutorial at the May 2024 Embedded Vision Summit. AI at the edge is powering a revolution in industrial IoT, from real-time processing and analytics that drive greater efficiency and learning… “Intel’s Approach to Operationalizing AI
The Next Frontier in Education: How Generative AI and XR will Evolve the World of Learning in the Next Decade
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. (Ai)Daptive XR empowers students through real-time personalization and collaborative learning Envisioning the future of education, and the art of learning overall, is nothing new. Over 120 years ago, French artist Jean-Marc Côté suggested how learning may look
