In ipXchange’s first of two interviews with Neonode at CES 2024, Guy chats to Per about a remarkable HMI software platform that enables hardware-agnostic full-body, gesture, and facial perception in 3D, even when using a standard 2D camera, such as on the tablet used for the demonstration. This software can even do this real-time perception for multiple people in the frame, and works down to the level of eye- and hand-tracking!
After a brief history of Neonode as an HMI solutions provider in the consumer electronics and automotive sectors, Per shows how Neonode’s solution can be used, in particular, for automotive in-cabin monitoring applications. This software works with the engineer’s choice of camera, radar sensor, etc., as the sensing basis for the 3D perception. It can also be used with sensor fusion datasets.
The essential aim of Neonode’s solution is improved automotive safety, with 3D perception vital in determining the position of the driver and passengers – including pets – for correct seatbelt use and airbag deployment, for example. The fact that Neonode’s solution can do this high-performance 3D sensing using commodity cameras is remarkable, but most importantly, it provides a scalable, cost-saving solution for new European automotive safety standards for in-cabin monitoring.
But this is not the extent of what Neonode’s solution offers: with additional software features, this machine-vision-based approach can replace capacitive sensors on the steering wheel, for example, to provide hand-tracking-based control of vehicle functions without additional hardware. This extends to detecting where the driver is looking and enabling functionality like the infotainment system only when required. In-cabin data can also be combined with external sensor data to determine whether it is safe to open a door in the current road environment.
Learn more about Neonode’s MultiSensing technology by following the link to the board page below, where you can apply to evaluate this technology for use in a commercial project.
Keep designing!
Enjoyed this interview? Check out ipXchange’s other automotive sensor videos from CES 2024, and our first interview with Neonode back in 2023:
Next-level heartbeat detection! AKM flexes a decade of R&D for superior mm-wave radar sensing
Asahi Kasei’s car that says ‘NO’ to drunk driving!
Infrared sensor provides noise-immune touch capabilities on any surface
You must be a member to leave a comment. Sign up or Sign in