Vision Algorithms for Embedded Vision
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language. Some of the pixel-processing operations (ex: spatial filtering) have changed very little in the decades since they were first implemented on mainframes. With today’s broader embedded vision implementations, existing high-level algorithms may not fit within the system constraints, requiring new innovation to achieve the desired results.
Some of this innovation may involve replacing a general-purpose algorithm with a hardware-optimized equivalent. With such a broad range of processors for embedded vision, algorithm analysis will likely focus on ways to maximize pixel-level processing within system constraints.
This section refers to both general-purpose operations (ex: edge detection) and hardware-optimized versions (ex: parallel adaptive filtering in an FPGA). Many sources exist for general-purpose algorithms. The Embedded Vision Alliance is one of the best industry resources for learning about algorithms that map to specific hardware, since Alliance Members will share this information directly with the vision community.
General-purpose computer vision algorithms
One of the most-popular sources of computer vision algorithms is the OpenCV Library. OpenCV is open-source and currently written in C, with a C++ version under development. For more information, see the Alliance’s interview with OpenCV Foundation President and CEO Gary Bradski, along with other OpenCV-related materials on the Alliance website.
Hardware-optimized computer vision algorithms
Several programmable device vendors have created optimized versions of off-the-shelf computer vision libraries. NVIDIA works closely with the OpenCV community, for example, and has created algorithms that are accelerated by GPGPUs. MathWorks provides MATLAB functions/objects and Simulink blocks for many computer vision algorithms within its Vision System Toolbox, while also allowing vendors to create their own libraries of functions that are optimized for a specific programmable architecture. National Instruments offers its LabView Vision module library. And Xilinx is another example of a vendor with an optimized computer vision library that it provides to customers as Plug and Play IP cores for creating hardware-accelerated vision algorithms in an FPGA.
Other vision libraries
- Halcon
- Matrox Imaging Library (MIL)
- Cognex VisionPro
- VXL
- CImg
- Filters
An Easy Introduction to Multimodal Retrieval-augmented Generation for Video and Audio
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Building a multimodal retrieval augmented generation (RAG) system is challenging. The difficulty comes from capturing and indexing information from across multiple modalities, including text, images, tables, audio, video, and more. In our previous post, An Easy Introduction
Computer Vision Pipeline v2.0
This blog post was originally published at Tenyks’ website. It is reprinted here with the permission of Tenyks. In the realm of computer vision, a shift is underway. This article explores the transformative power of foundation models, digging into their role in reshaping the entire computer vision pipeline. It also demystifies the hype behind the
Generative AI In the Medical Domain: Not Quite Yet
This blog post was originally published at Digica’s website. It is reprinted here with the permission of Digica. Why data is expensive Data is the bedrock of any AI/ML project, and serves as the vital link between mathematical algorithms and real-world problems. And yet, we often grapple with two common data-related challenges, which are the
Virtual and Augmented Reality: The Rise and Drawbacks of AR
While being closed off from the real world is an experience achievable with virtual reality (VR) headsets, augmented reality (AR) offers images and data combined with real-time views to create an enriched and computing-enhanced experience. IDTechEx‘s portfolio of reports, including “Optics for Virtual, Augmented and Mixed Reality 2024-2034: Technologies, Players and Markets“, explore the latest
Why Smaller, More Accurate GenAI Models Put Safety Front and Center
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. In the rapidly evolving world of generative artificial intelligence (GenAI), the focus has traditionally been on large, complex models that require significant computational resources. However, a new trend is emerging: the development and deployment of small, efficient
Revolutionizing Embedded Vision: Macnica Americas at CES 2025
At CES® 2025, Macnica Americas is proud to spotlight the transformative potential of generative AI in embedded vision solutions, showcasing its role as a leader in imaging and vision solutions. Collaborating with innovative partners such as iENSO and Ambarella, Macnica is enabling next-generation advancements in IoT, surveillance, consumer electronics, and beyond. iENSO, a trusted solution
NVIDIA Unveils Its Most Affordable Generative AI Supercomputer
The Jetson Orin Nano Super delivers up to a 1.7x gain in generative AI performance, supporting popular models for hobbyists, developers and students. NVIDIA is taking the wraps off a new compact generative AI supercomputer, offering increased performance at a lower price with a software upgrade. The new NVIDIA Jetson Orin Nano Super Developer Kit,
An Easy Introduction to Multimodal Retrieval-augmented Generation
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. A retrieval-augmented generation (RAG) application has exponentially higher utility if it can work with a wide variety of data types—tables, graphs, charts, and diagrams—and not just text. This requires a framework that can understand and generate responses
“Using Computer Vision-powered Robots to Improve Retail Operations,” a Presentation from Simbe Robotics
Durgesh Tiwari, VP of Hardware Systems, R&D at Simbe Robotics, presents the “Using Computer Vision-powered Robots to Improve Retail Operations” tutorial at the December 2024 Edge AI and Vision Innovation Forum. In this presentation, you’ll learn how Simbe Robotics’ AI- and CV-enabled robot, Tally, provides store operators with real-time intelligence to improve inventory management, streamline
Useful Sensors Demonstration of Its Torre Standalone Translation Solution
Jacqueline Cervantes, Head of Sales and Business Development at Useful Sensors, demonstrates the company’s latest edge AI and vision technologies and products at the December 2024 Edge AI and Vision Alliance Forum. Specifically, Cervantes demonstrates her company’s Torre standalone translation solution, which provides real-time, on-device, and secure voice translation and transcription. Useful Sensors is dedicated
Amid the Rise of LLMs, is Computer Vision Dead?
This blog post was originally published at Tenyks’ website. It is reprinted here with the permission of Tenyks. The field of computer vision has seen incredible progress, but some believe there are signs it is stalling. At the International Conference on Computer Vision 2023 workshop “Quo Vadis, Computer Vision?”, researchers discussed what’s next for computer
The Impact of AI On the Automotive Industry
This blog post was originally published at Digica’s website. It is reprinted here with the permission of Digica. The automotive industry has undergone a profound transformation over the years, with technological advancements driving innovation at an unprecedented pace. One of the most influential technologies shaping the future of vehicles is Artificial Intelligence. AI’s integration into
Software-defined Vehicles: AI Assistants and Biometrics
Software-defined vehicles (SDVs) represent a combination of automotive features that provide new possibilities for passengers to engage with vehicles. In the report, “Software-Defined Vehicles, Connected Cars, and AI in Cars 2024-2034: Markets, Trends, and Forecasts“, IDTechEx depicts how the cellular connectivity within SDVs can provide access to IoT (Internet of Things) features including OTA (over-the-air)
Qualcomm at NeurIPS 2024: Our Groundbreaking Innovations and Cutting-edge Advancements in AI
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. See how Qualcomm AI Research continues to innovate, from platform enhancements to AI fundamentals Neural Information Processing Systems (NeurIPS), the premier machine learning conference, returns in person this year with an impressive 25% acceptance rate, maintaining its
How RTX AI PCs Unlock AI Agents That Solve Complex Problems Autonomously With Generative AI
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. NVIDIA RTX-accelerated AnythingLLM launches Community Hub for sharing prompts, slash commands and AI agent skills. Editor’s note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases
“Vision Language Models for Regulatory Compliance, Quality Control and Safety Applications,” a Presentation from Camio
Carter Maslan, CEO of Camio, presents the “Vision Language Models for Regulatory Compliance, Quality Control and Safety Applications” tutorial at the December 2024 Edge AI and Vision Innovation Forum. In this presentation, you’ll learn how vision language models interpret policy text to enable much more sophisticated understanding of scenes and human behavior compared with current-generation
