Cameras and Sensors for Embedded Vision
WHILE ANALOG CAMERAS ARE STILL USED IN MANY VISION SYSTEMS, THIS SECTION FOCUSES ON DIGITAL IMAGE SENSORS
While analog cameras are still used in many vision systems, this section focuses on digital image sensors—usually either a CCD or CMOS sensor array that operates with visible light. However, this definition shouldn’t constrain the technology analysis, since many vision systems can also sense other types of energy (IR, sonar, etc.).
The camera housing has become the entire chassis for a vision system, leading to the emergence of “smart cameras” with all of the electronics integrated. By most definitions, a smart camera supports computer vision, since the camera is capable of extracting application-specific information. However, as both wired and wireless networks get faster and cheaper, there still may be reasons to transmit pixel data to a central location for storage or extra processing.
A classic example is cloud computing using the camera on a smartphone. The smartphone could be considered a “smart camera” as well, but sending data to a cloud-based computer may reduce the processing performance required on the mobile device, lowering cost, power, weight, etc. For a dedicated smart camera, some vendors have created chips that integrate all of the required features.
Cameras
Until recent times, many people would imagine a camera for computer vision as the outdoor security camera shown in this picture. There are countless vendors supplying these products, and many more supplying indoor cameras for industrial applications. Don’t forget about simple USB cameras for PCs. And don’t overlook the billion or so cameras embedded in the mobile phones of the world. These cameras’ speed and quality have risen dramatically—supporting 10+ mega-pixel sensors with sophisticated image processing hardware.
Consider, too, another important factor for cameras—the rapid adoption of 3D imaging using stereo optics, time-of-flight and structured light technologies. Trendsetting cell phones now even offer this technology, as do latest-generation game consoles. Look again at the picture of the outdoor camera and consider how much change is about to happen to computer vision markets as new camera technologies becomes pervasive.
Sensors
Charge-coupled device (CCD) sensors have some advantages over CMOS image sensors, mainly because the electronic shutter of CCDs traditionally offers better image quality with higher dynamic range and resolution. However, CMOS sensors now account for more 90% of the market, heavily influenced by camera phones and driven by the technology’s lower cost, better integration and speed.

NVIDIA DRIVE Hyperion Platform Achieves Critical Automotive Safety and Cybersecurity Milestones for AV Development
Adopted and Backed by Automotive Manufacturers and Safety Authorities, Latest Iteration to Feature DRIVE Thor on NVIDIA Blackwell Running NVIDIA DriveOS January 6, 2025 — CES — NVIDIA today announced that its autonomous vehicle (AV) platform, NVIDIA DRIVE AGX™ Hyperion, has passed industry-safety assessments by TÜV SÜD and TÜV Rheinland — two of the industry’s

NXP Accelerates the Transformation to Software-defined Vehicles (SDV) with Agreement to Acquire TTTech Auto
NXP strengthens its automotive business with a leading software solution provider specialized in the systems, safety and security required for SDVs TTTech Auto complements and accelerates the NXP CoreRide platform, enabling automakers to reduce complexity, maximize system performance and shorten time to market The acquisition is the next milestone in NXP’s strategy to be the

Qualcomm Brings Industry-leading AI Innovations and Broad Collaborations to CES 2025 Across PC, Automotive, Smart Home and Enterprises
Highlights: Spotlight on bringing edge AI across devices and computing spaces, including PC, automotive, smart home and into enterprises broadly, with global ecosystem partners at the show. In PC, continued traction for the Snapdragon X Series, the launch of the new Snapdragon X platform, and the launch of a new desktop form factor and NPU-powered

Qualcomm Aware Unveils New Services to Drive Connected Intelligence Across Industries
Highlights: Qualcomm Aware adds observability, monitoring and location services to enable the development of IoT solutions that meet specific needs and challenges of consumers and enterprises across a wide range of industries and use cases. By pre-integrating Qualcomm Aware software across select Qualcomm Technologies and third-party processors, Qualcomm Technologies will provide a simple, fast and

Snapdragon X Series Continues to Redefine the PC Category with a New Platform, Mini Desktop Form Factors, and NPU Powered AI Experiences
Highlights: The 4th platform to join the Snapdragon X Series, Snapdragon X, brings AI PC leadership to Copilot+ PCs in the $600 range. Snapdragon X Series continues to gain traction with now over 60 designs in production or development with more than 100 coming by 2026 from leading OEMs including Asus, Acer, Dell Technologies, HP,

New Edge AI-enabled Radar Sensor from TI Empowers Automakers to Reimagine In-cabin Experiences
News highlights: TI enhances detection accuracy with the industry’s first single-chip 60GHz millimeter-wave (mmWave) radar sensor to support three in-cabin sensing applications enabled by edge artificial intelligence (AI). Auto manufacturers can deliver premium audio experiences with a highly integrated automotive Arm®-based microcontroller (MCU) and processor with TI’s vector-based C7x digital signal processor (DSP) core to

Nextchip Demonstration of an ISP-based Thermal Imaging Camera
Barry Fitzgerald, local representative for Nextchip, demonstrates the company’s latest edge AI and vision technologies and products at the December 2024 Edge AI and Vision Alliance Forum. Specifically, Fitzgerald demonstrates a thermal imaging camera design based on the company’s ISP. The approach shown enhances night-time detection of pedestrians and animals beyond current visual capabilities, which

What is Interpolation? Understanding Image Perception in Embedded Vision Camera Systems
This blog post was originally published at e-con Systems’ website. It is reprinted here with the permission of e-con Systems. Interpolation is a mathematical technique used to estimate unknown values that lie between known data points. Interpolation helps transform raw sensor data into stunning, full-color images in embedded vision systems. Read the blog to learn

Automotive Radar Market 2025-2045: Robotaxis and Autonomous Cars
For more information, visit https://www.idtechex.com/en/research-report/automotive-radar-market-2025-2045-robotaxis-and-autonomous-cars/1061. The automotive radar market is forecast to hit 500 million annual sales in 2041 IDTechEx’s report, Automotive Radar Market 2025-2045: Robotaxis & Autonomous Cars, predicts the automotive radar market will hit 500 million annual sales in 2041. The market share today is dominated by the big tier-one companies like Continental,

Why an RGB-IR Camera is Crucial for Liveness Detection in Facial Recognition Systems
This blog post was originally published at e-con Systems’ website. It is reprinted here with the permission of e-con Systems. Facial recognition systems, though powerful, are vulnerable to spoofing attacks. To combat this, RGB-IR cameras have emerged as a crucial solution. By capturing both visible and infrared light, these cameras can detect liveness of a