Real-time Assistance with AR HUD Screen in the...
URL: https://dl.acm.org/doi/10.1145/3789624.3789637
Heli Kymäläinen, Borja García-Pascual, Carlos Martín-Cortés, Martino Rogai, Mari Selkimäki, Xin Zhou, Esteban Arboix, Mauricio Acuna, Blas Mola-Yudego This study investigates a gamified real-time assistance concept for forest harvesters, integrating augmented reality (AR) and LiDAR-based data visualization through a head-up display (HUD). The approach draws from gamification principles—enhancing engagement, feedback, and situational awareness—to support operator decision-making and ergonomics. A field test was conducted in Ilomantsi, Finland, employing a John Deere 1170G harvester equipped with an external LiDAR scanner and an in-cabin holographic HUD. Real-time tree detection and diameter estimation were achieved through LiDAR data processing with a YOLO-based convolutional neural network. The system successfully projected tree positions and estimated diameters onto the HUD during the felling of 60 trees. Operator workload, assessed using the NASA-TLX method, indicated low cognitive strain and positive usability feedback. The results demonstrate the feasibility of real-time holographic visualization in dynamic forest environments but highlight calibration and information flow challenges. Further improvements are needed in system setup, eye-position alignment, and data visualization to optimize ergonomic benefits and decision support in mechanized harvesting operations.
Additional Information
| Field | Value |
|---|---|
| Data last updated | unknown |
| Metadata last updated | April 9, 2026 |
| Created | unknown |
| Format | |
| License | Creative Commons Attribution Share-Alike |
| Created | 5 months ago |
| Datastore active | False |
| Has views | True |
| Id | cf97f3fe-c1e6-4ad7-b0fd-e0ef88be50d9 |
| Package id | 688f28f2-75cf-4dab-8644-643bd1d346fe |
| Position | 0 |
| State | active |