RSS feed LinkedIn Watch us on Youtube

Activity title

Air vehicles crew’s neuro-psychophysiological based real-time stress monitoring for Human Machine Interfaces workload evaluation enforcing mission execution

Activity Reference



Human Factors and Medicine

Security Classification




Activity type


Start date


End date



Artificial Intelligence, Bedford Workload Rating Scale BWRS, Crew, Deep Learning, Fatigue, Health Usage Monitoring System HUMS, Infrared Stress Monitoring System ISMS, Mission Effectiveness, Neuroenhancement, Real Time Data, Smar Human Sensors, Workload


The optimal interaction between pilot and aircraft has been always considered a milestone to be reached in order to achieve better operational performance while increasing safety and mission effectiveness. Re-thinking human-machine interaction on the basis of the recent advancements of neuroscience opens the possibility to generate a highly reliable objective methodology, with a specific metrics used to evaluate the Human-Machine Interface (HMI) effectiveness, to address and validate the solutions for creating a new generation of cockpits centered on the pilot and the human factor. The Italian NATO community (composed by Leonardo Helicopters Company, Next2U, a University “G. d’Annunzio” academic spin-off company, and the Italian Army Aviation - AVES) is engaged in a development program aimed at creating a new generation of rotary and tilt wing mission cockpits for which the human-machine interaction is fully inspired by neuroscience and neuro-ergonomics principles, translated into viable and flyable technological solutions. This group, named Team ISMS (Infrared Stress Monitoring System) after the system used to carry on the activities, has reached a first set of consolidated results flown in Combat Mission Simulator environment, is now proposing to launch ET (Exploratory Team) to establish a common.


The objectives of this ET is to define a common set of requirements and standards for the Airborne ISMS (A-ISMS) technical demonstrator to be validated with NATO supplied rotary wing assets in the following RTG/CDT phases, to obtain a recognized BWRS objective metrics with specific OSA (Open System Architecture) compliant OPerational SoftWare (OPSW), with data acquired from different NATO partners.


The following topics shall be assessed and evaluated, in terms of capabilities and associated requirements : • On-board miniaturized sensors for thermal IR, near IR, eye tracking, biological and voice monitoring with crew self-adaptation features; • Crew workload/stress database implementation based on human factors constrains, requirements and performances; • Operational Software modularity for easy cross platform integration and deployment (training/operation), addressing legacy architectures and NGR ones. The scientific KPI (Key Performance Indicator) - based on the above referenced topics – will allow make available matured and validated BWRS SLI (Stress Level Index) metrics for aircraft use.

Contact Panel Office