Skip to content
A trainee in police uniform and a VR headset stands on a round platform with one arm raised.
#xr#ai

DEFSENSE

AI-driven synthetic training environments

defsense.ai ↗
> by crowtecxr training · 2022
01· the project
> A Crowtec venture.

Training for high stress, measured on the body.

DEFSENSE is our synthetic training environment for armed forces, police and emergency services. Trainees go through VR and AR scenarios built in Unreal Engine while their body signals and behaviour are recorded and analysed for the instructors. R&D funded by CDTI with NextGenerationEU.

Six training scenarios cover the three sectors, from a hostage rescue for the armed forces to an undercover operation for the police and a car accident for emergency services, built from 360 footage, motion capture and 3D. Heart rate, heart rate variability, skin conductance, blood oxygen, temperature, grip pressure and brain activity are recorded live, partly by RAVEN, our own sensor board in the replica weapon. Instructors follow it on a monitoring panel with stress curves, heatmaps and a timeline of critical events, so they see how each trainee responded under pressure, not only what they did.

> cat /works/defsense.md
TYPEXR TRAINING
OWN PRODUCTCrowtec
YEAR2022
LOCATIONMADRID
built with
  • Unreal Engine
  • VR
  • AR
  • Meta Quest Pro
  • RAVEN
  • EmotiBit
  • Biometric sensors
  • AI
02· in numbers
6> training scenarios
7> body signals, recorded live
3> sectors: armed forces, police, emergency services
VR + AR> scenarios in Unreal Engine
03· how it works
A rendered office for the undercover operation scenario, with an agent at a desk and a visitor seated opposite.
01

Build

Each exercise is a scenario of its own, built from 360 footage, motion capture and 3D.

A digital human answers questions at a microphone in a questioning scenario, seen past the trainee's headset.
02

Experience

Trainees go through VR and AR scenarios built in Unreal Engine: a hostage rescue, an undercover operation, a car accident and more.

The monitoring panel during a session: brain activity curves, heart rate and the trainee seen from the room camera.
03

Monitoring

Heart rate, heart rate variability, skin conductance, blood oxygen, temperature, grip pressure and brain activity are recorded in real time, partly by RAVEN, our sensor board in the replica weapon.

The evaluation panel on a tablet: facial tracking, a gaze heatmap and the trainee's view of the scene.
04

Evaluation

Rules and AI models turn the data and the behaviour into stress curves, heatmaps and a timeline of critical events for the instructors.

04· gallery
05· credits
by crowtec. VR - XR - AI. 2022
06· references

Request a demo

defsense.ai ↗
07· next project
> cd /works/ikea-next-gen
IKEA Next Gen Seniors> Interactive installation
> navbar collapsed · scroll to the end
Crowtec