Cameras and Sensors for Embedded Vision
WHILE ANALOG CAMERAS ARE STILL USED IN MANY VISION SYSTEMS, THIS SECTION FOCUSES ON DIGITAL IMAGE SENSORS
While analog cameras are still used in many vision systems, this section focuses on digital image sensors—usually either a CCD or CMOS sensor array that operates with visible light. However, this definition shouldn’t constrain the technology analysis, since many vision systems can also sense other types of energy (IR, sonar, etc.).
The camera housing has become the entire chassis for a vision system, leading to the emergence of “smart cameras” with all of the electronics integrated. By most definitions, a smart camera supports computer vision, since the camera is capable of extracting application-specific information. However, as both wired and wireless networks get faster and cheaper, there still may be reasons to transmit pixel data to a central location for storage or extra processing.
A classic example is cloud computing using the camera on a smartphone. The smartphone could be considered a “smart camera” as well, but sending data to a cloud-based computer may reduce the processing performance required on the mobile device, lowering cost, power, weight, etc. For a dedicated smart camera, some vendors have created chips that integrate all of the required features.
Cameras
Until recent times, many people would imagine a camera for computer vision as the outdoor security camera shown in this picture. There are countless vendors supplying these products, and many more supplying indoor cameras for industrial applications. Don’t forget about simple USB cameras for PCs. And don’t overlook the billion or so cameras embedded in the mobile phones of the world. These cameras’ speed and quality have risen dramatically—supporting 10+ mega-pixel sensors with sophisticated image processing hardware.
Consider, too, another important factor for cameras—the rapid adoption of 3D imaging using stereo optics, time-of-flight and structured light technologies. Trendsetting cell phones now even offer this technology, as do latest-generation game consoles. Look again at the picture of the outdoor camera and consider how much change is about to happen to computer vision markets as new camera technologies becomes pervasive.
Sensors
Charge-coupled device (CCD) sensors have some advantages over CMOS image sensors, mainly because the electronic shutter of CCDs traditionally offers better image quality with higher dynamic range and resolution. However, CMOS sensors now account for more 90% of the market, heavily influenced by camera phones and driven by the technology’s lower cost, better integration and speed.
Microchip to Accelerate Real-time Edge AI with NVIDIA Holoscan
PolarFire® FPGA Ethernet Sensor Bridge provides low-power multi-sensor bridging to NVIDIA edge AI platforms CHANDLER, Ariz., November 14, 2024 — To enable developers building artificial intelligence (AI)-driven sensor processing systems, Microchip Technology (Nasdaq: MCHP) has released its PolarFire® FPGA Ethernet Sensor Bridge that works with the NVIDIA Holoscan sensor processing platform. PolarFire FPGAs enable multi-protocol
In-cabin Sensing: Gaze Tracking and Steering Wheel Sensors
Driver monitoring systems and occupant monitoring systems operating within a vehicle are designed to enhance passenger welfare and increase the safety of vehicles. IDTechEx outlines technologies from infrared cameras and time-of-flight cameras, to potential ECG monitoring within the steering wheel in their report, “In-Cabin Sensing 2024-2034: Technologies, Opportunities and Markets“. Infrared uses and adoption RGB-infrared
How Do LWIR Cameras Fit Into Vehicles of Today and In the Future?
The Society of Automotive Engineers defines 6 levels (0 to 5) of autonomy available to vehicles, ranging from level 0 (no automation) to level 5 (full automation). The jump from level 2 to 3 is a large one that has seen limited deployment, as automotive OEMs assume greater liability, and eyes can be taken off
What are the Key Camera Features of Retail Kiosks?
This blog post was originally published at e-con Systems’ website. It is reprinted here with the permission of e-con Systems. Retail kiosks, from self-checkout to interactive displays, rely on cameras to deliver seamless and efficient customer experiences. Discover how high-performance cameras can enhance security, streamline operations, and drive sales. Explore the latest advancements in camera
The Building of the New FRAMOS Campus is Completed
Campus combines research & development, production, and supportive functions under one climate-positive umbrella. Čakovec, Croatia / Munich, Germany – November 12th, 2024 – FRAMOS, the leading global expert in embedded vision, has completed its new campus building in Čakovec, Croatia. The campus will increase FRAMOS’ production capacity and bring research & development, and administration closer
Electrification and Autonomy: A Semiconductor Content Boost to $1,000 per Car by 2029
This market research report was originally published at the Yole Group’s website. It is reprinted here with the permission of the Yole Group. Automotive OEMs are moving upstream in the semiconductor supply chain with diverse strategies. OUTLINE The automotive semiconductor market is expecting a significant CAGR of 11% between 2023 and 2029 to almost $100
Free Webinar Explores Sensing Solutions for ADAS and Autonomous Vehicles
On January 28, 2025 at 9 am PT (noon ET), Ian Riches, Vice President of the Global Automotive Practice at TechInsights, will present the free hour webinar “Sensing In ADAS and Autonomous Vehicles: What’s Winning, and Why?,” organized by the Edge AI and Vision Alliance. Here’s the description, from the event registration page: It’s clear
What is Depth of Field and Its Relevance in Embedded Vision?
This blog post was originally published at e-con Systems’ website. It is reprinted here with the permission of e-con Systems. Depth of Field (DoF) is crucial for embedded vision since it can improve the ability to process and analyze visual data. It is impacted by factors such as aperture size, focal length, and more. Get
Web-based Tool from STMicroelectronics Accelerates AIoT Projects with Smart Sensors
Deploy models on MEMS machine-learning core for sensor node-to-cloud solutions Geneva, Switzerland, November 5, 2024 — ST AIoT Craft, a new web-based tool from STMicroelectronics, simplifies developing and provisioning node-to-cloud AIoT (Artificial Intelligence of Things) projects that use the machine-learning core (MLC) of ST’s smart MEMS sensors. The MLC is unique to the ST MEMS
Give AI a Look: Any Industry Can Now Search and Summarize Vast Volumes of Visual Data
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Accenture, Dell Technologies and Lenovo are among the companies tapping a new NVIDIA AI Blueprint to develop visual AI agents that can boost productivity, optimize processes and create safer spaces. Enterprises and public sector organizations around the