The goal of this project is to consider the way Augmented Reality (AR) can improve and speed up the TE process in Counter-IED operations, while decreasing operational risks. To attain this goal, three technology demonstrators (TRL 6-7) are developed, aiming to rise to the aforementioned challenges.
Throughout this project, I played a comprehensive role from inception to completion. Initially, the primary focus was on generating features that operators could utilize effectively. To this end, we developed three demonstrators to showcase the potential for recording information during operations and subsequently using this data for debriefings and to establish connections between cases.
We continuously iterated on the project by gathering feedback from end-users, allowing us to align our approach with their needs and guide the project in their desired direction.
Project Background
As the project advanced, it became evident that there was significant interest in the operational aspects of Artex. In response, we shifted our primary focus to optimizing the operational phase. This involved enhancing the system’s stability and user-friendliness, while also exploring advanced topics such as decentralized databases and networking. Our efforts aimed to ensure that the system could meet the dynamic needs of operators in real-world scenarios.
The operational phase was structured into three levels. The first level focused on recording information and providing operators with real-time updates on their teammates. Using the HoloLens, operators’ locations and surroundings were shared, enabling safer, more informed decision-making through enhanced situational awareness. The commander/scribe could monitor team findings and the positions of all personnel and discoveries via a laptop application.
The second level enabled operators to replay this recorded information, allowing them to step back into previous scenarios and draw connections between different cases.
In the third level, this information can be utilized by forensic institutes to gain a deeper understanding of operational processes, which can support investigations and improve future procedures.
Skills Used
Communication: Data flow from the hub to clients was managed through controllers, with SignalR transmitting important updates.
Databases: MySQL, MariaDB, PostgreSQL, TimescaleDB for storing information.
Backend Development: .NET/C# as a central hub, facilitating communication between clients (Scribe) to share information.
Application Development: Unity (C#) to create the HoloLens application for operators and the Debrief application for commanders/scribes.
Decentralized Database/Networking Research: Raspberry Pi with Batman Adv and a custom database synchronization.
See also
Read this magazine to find out the perspective of the Dutch Army: https://magazines.defensie.nl/landmacht/2022/06/09_cde-artex