Leopard Imaging unveiled an in-car camera module at the Embedded Vision show

Last May, Leopard Imaging launched an in-car camera module at Embedded Vision, marking a new milestone in the history of driver monitoring systems (DMS) and paving the way for the adoption of DMS in cars. As a ST licensed partner, Leopard Imaging has previously launched several in-car camera modules using ST's VG5761 devices. Now, it supports wider lighting conditions by using ST's VB56G4A backlit global shutter image sensor to improve the accuracy of machine learning algorithms while reducing the overall power consumption of the system. As a result, Leopard Imaging will be able to provide automakers with more options, including modules with and without backshots, allowing driver monitoring systems (DMS) and Occupant monitoring systems (OMS) to become mainstream applications.

The modern DMS concept has been around for at least 20 years. In 2004, researchers from Paderborn University in Germany and Queensland University of Technology in Australia presented a paper at the IEEE International Congress on Systems, Humans and Cybernetics on how sensors could track eyes and blinking to determine if a driver was tired or distracted. Because the research uses more commonly used components, this paper stands out and opens the door to mainstream applications for DMS. However, 20 years later, DMS and OMS are not ubiquitous in cars. What's holding this technology back? What is unique about Leopard Imaging's exhibits on Embedded Vision? Let's find out.

ST's VG56G4A device makes DMS/OMS suitable for more environments

Leopard Imaging has been in this field for 15 years, and the VG56G4A will help them leverage their existing technology accumulation to create new opportunities. In fact, the company has already introduced camera modules that do not require fill light sources, such as the DMS module based on the ST VG5761. In the past, they have been installing these modules behind the steering wheel and installing light sources elsewhere. The problem is that it only works for certain cabins. Leopard Imaging therefore believes that it is important to find ways to customize the solution to the environment. In short, innovation is about making technology work in a wider space.

LI-ST-VB56G4A-MONO-DMS-ADJ from Leopard Imaging

Equipped with a 940nm near-infrared laser emitter, the VB56G4A's light source does not produce distracting red light. This wavelength is also not disturbed by sunlight and can work in any light environment. In addition, the VCSEL light source can also be combined with the 940nm narrow filter to better filter the infrared in the sunlight.

In addition, replacing the roller shutter sensor with a global shutter eliminates image artifacts, so rapid lateral movement can be detected and the target edge detected more precisely. In addition, the backlit image sensor allows camera modules to be installed in positions that were previously unavailable. Leopard Imaging showed the LI-ST-VB56G4A-DMS-GMSL2 and LI-ST-VB56G4A-MONO-DMS-ADJ camera modules at Embedded Vision.

▲LI-ST-VB56G4A-DMS-GMSL2

Leopard Imaging has been working on cockpit monitoring technology for several years and has introduced solutions. These two new modules are significant because they enable greater customization, higher performance and energy efficiency at a lower price, and are simpler to deploy, allowing the company to build on years of technology to develop solutions for more use cases. Therefore, we see the new modules based on VG56G4A as landmark innovations, not because they make DMS and OMS possible, but because they make them mainstream.

The Leopard Imaging module enables DMS/OMS to transition to machine learning and comply with new regulations

Another milestone pushing DMS and OMS into the mainstream is the increasingly deep adoption of edge machine learning. While working with customers to collect training data with camera modules, Leopard Imaging noticed a shift toward machine learning with heuristic based DMS and OMS that allows developers to implement more use cases without using more resources, which also means lower development costs. Instead of perfecting application scenarios through decades of technology accumulation, machine learning algorithms shift the decision-making process to neural networks that can easily self-optimize over time.

With the introduction of new policies and regulations, DMS and OMS are increasingly valued by the industry. In 2021, US senators introduced a new bill proposing to study the benefits of DMS and make it mandatory for new cars to be installed. The European Parliament has been more proactive, having approved in 2019 the implementation of the DMS regulation by mid-2024. The European security Organisation is considering requiring the DMS to issue five-star ratings. Leopard Imaging has been working with solution developers to keep abreast of the new regulations and make their solutions compliant. As industry challenges continue to be overcome, DMS and OMS will also become standard in the general public.

Camera Module Solution Service Provider

Tel:+86 186 6497 2870

WhatsApp:+86 186 6497 2870

E-mail:caida@dgzx.hk

https://dgzx.hk