Synsis Developer Kit
We developed a comprehensive Developer Kit designed to accelerate time-to-market for automotive brands implementing human-state algorithms in vehicles. Our technology can detect a range of human states, including stress, fatigue, and comfort, and features a two-dimensional valence-arousal model to capture a broader spectrum of emotions. The primary objective was to create a product that seamlessly integrates and processes multimodal data streams, enabling the synchronization of data, algorithm training, and testing of use cases—all without the need for R&D teams to build their own infrastructure.
Setting the Scene
Sensum had spent years developing emotion response algorithms and creating custom experiences for brands like BBC, Jaguar, Ford, Red Bull, and Unilever. While successful, the technology struggled to find scalable, repeatable use cases. A promising partnership with an extreme sports brand ended abruptly before the Developer Kit launch, but Sensum’s expertise in sensor tech and emotion science—gained through extreme data collection—remained strong. The team’s goal was to create a viable product before funds ran out.
How Do You Predict Human State?
Sensum used sensors to measure heart rate, breathing, and skin response, inferring human states and emotions. Data was rigorously collected and labelled to design algorithms, with additional collaboration on facial coding (Fraunhofer) and emotion detection in voice (Audeering).
Transition to Machine Learning
Before the Developer Kit, Sensum pioneered a multi-modal approach to understanding human states, combining biometric, facial, and vocal inputs. Machine learning was key to creating a generalized model trained with lab-collected data.
Our team of psychologists worked in collaboration with Queen’s University and the French tier 1 automotive supplier Valeo to design a study which would help us to induce a stress > comfort state amongst a broad range of participants. We built a driving simulator to reflect the real driving experience as much as possible. The lab was also kitted out with face cameras, audio recorders and biometric sensors.
Focusing on the problem space
The big question for us was; Is there a thirst for the type of outputs Synsis provides? If so, who wants them? More importantly, who has the sensor technology and conditions that are far enough along that they would pay to get their hands on our Developer Kit.