Deteksi Otomatis Peralatan Perawatan dan Instrumen Pesawat Udara di Lingkungan Pendidikan Penerbangan Berbasis YOLO11

Donna N.M. Sirait; Nurmahendra Harahap; Muhammad Amril; Suherman Suherman

doi:10.35447/jitekh.v14i1.1466

Authors

Donna N.M. Sirait Program Studi Teknik Telekomunikasi dan Navigasi Udara, Politeknik Penerbangan Medan, Medan
Nurmahendra Harahap 2Program Studi Teknik Elektro, Fakultas Sains dan Teknologi, Universitas Tjut Nyak Dhien, Medan
Muhammad Amril Program Studi Teknik Telekomunikasi dan Navigasi Udara, Politeknik Penerbangan Medan, Medan
Suherman Suherman Program Studi Teknik Telekomunikasi dan Navigasi Udara, Politeknik Penerbangan Medan, Medan

DOI:

https://doi.org/10.35447/jitekh.v14i1.1466

Keywords:

YOLO11, object detection, aircraft maintenance tools, aircraft instruments, aviation education

Abstract

This study aims to develop an automatic recognition system for aircraft maintenance tools and flight instruments using the YOLO11 model in an aviation education environment. The dataset was collected from the Avionic Laboratory and consisted of five object classes: Airspeed Indicator, Flight Director, Pictorial Navigation Instrument, Crimping GMT 208, and Crimping GMT 221. The model was trained iteratively through three stages using data augmentation techniques and evaluated using precision, recall, mAP50, mAP50-95, confusion matrix analysis, and live video testing. The best performance was achieved in the third iteration with an mAP50-95 value of 0.85082, precision of 0.96013, recall of 0.99207, and mAP50 of 0.97450. Real-time testing demonstrated that the system performed very well under normal conditions; however, its performance decreased when visual disturbances were introduced. The confusion matrix analysis showed that the model most frequently confused the two crimping tool classes due to their similar visual characteristics. Overall, the results indicate that YOLO11 has strong potential to be implemented as an effective and adaptive learning support tool in aviation vocational education.

Downloads

Download data is not yet available.

References

Australian Transport Safety Bureau, “Screwdriver tip left in engine during maintenance results in blade failure on take-off,” ATSB. [Online]. Available: https://www.atsb.gov.au/media/news-items/2021/tool-control

N. Zendehdel, H. Chen, and M. C. Leu, “Real-time tool detection in smart manufacturing using You-Only-Look-Once (YOLO) v5,” Manuf. Lett., vol. 35, pp. 1052–1059, 2023.

Y. Zhang, “AI-Driven Transformation of Vocational Education,” Int. J. Knowl. Manag., vol. 21, no. 1, 2024.

L. T. Ramos and A. D. Sappa, “A decade of you only look once (yolo) for object detection: A review,” IEEE Access, vol. 13, pp. 192747–192794, 2025.

N. Pati et al., “A real-time industrial safety automation using YOLO architectures leveraging diverse chromatic domains,” Sci. Rep., 2026.

M. Yaseen, “What is YOLOv9: An in-depth exploration of the internal features of the next-generation object detector,” arXiv Prepr. arXiv2409.07813, 2024.

L. Ali, F. Alnajjar, M. M. A. Parambil, M. I. Younes, Z. I. Abdelhalim, and H. Aljassmi, “Development of YOLOv5-based real-time smart monitoring system for increasing lab safety awareness in educational institutions,” Sensors, vol. 22, no. 22, p. 8820, 2022.

B.-H. Lin, J.-C. Chen, and J.-J. J. Lien, “Defect inspection using modified YoloV4 on a stitched image of a spinning tool,” Sensors, vol. 23, no. 9, p. 4476, 2023.

A. Lu, P. Liu, J. Yang, Z. Li, and K. Wang, “Tailhook Recognition for Carrier-Based Aircraft Based on YOLO with Bi-Level Routing Attention,” Algorithms, vol. 17, no. 11, p. 488, 2024.

Z. He, Y. He, and Y. Lv, “DT-YOLO: An improved object detection algorithm for key components of aircraft and staff in airport scenes based on YOLOv5,” Sensors, vol. 25, no. 6, p. 1705, 2025.

R. Wen, Y. Yao, Z. Li, Q. Liu, Y. Wang, and Y. Chen, “LESM-YOLO: An improved aircraft ducts defect detection model,” Sensors, vol. 24, no. 13, p. 4331, 2024.

G. Morales Méndez and F. del Cerro Velázquez, “Augmented reality in Industry 4.0 assistance and training areas: a systematic literature review and bibliometric analysis,” Electronics, vol. 13, no. 6, p. 1147, 2024.

H.-J. Kwon, S.-I. Lee, J.-H. Park, and C.-S. Kim, “Design of augmented reality training content for railway vehicle maintenance focusing on the axle-mounted disc brake system,” Appl. Sci., vol. 11, no. 19, p. 9090, 2021.

Y. Zhou and B. Zhao, “You Only Look Once 11 (YOLOv11) optimization for lightweight and accurate plant detection in uncrewed aerial vehicle imagery,” PeerJ Comput. Sci., vol. 11, p. e3322, 2025.

A. A. Murat and M. S. Kiran, “A comprehensive review on YOLO versions for object detection,” Eng. Sci. Technol. an Int. J., vol. 70, p. 102161, 2025, doi: https://doi.org/10.1016/j.jestch.2025.102161.

L. He, Y. Zhou, L. Liu, W. Cao, and J. Ma, “Research on object detection and recognition in remote sensing images based on YOLOv11,” Sci. Rep., vol. 15, no. 1, p. 14032, 2025.

J. Chen, S. Pan, Y. Chan, Y. Ni, and D. Ye, “A new method based on YOLOv5 and multiscale data augmentation for visual inspection in substation,” Sci. Rep., vol. 14, no. 1, p. 9362, 2024, doi: 10.1038/s41598-024-60126-2.

R. Sapkota et al., “YOLO advances to its genesis: A decadal and comprehensive review of the You Only Look Once (YOLO) series,” Artif. Intell. Rev., vol. 58, no. 9, p. 274, 2025.

A. Mumuni and F. Mumuni, “Data augmentation: A comprehensive survey of modern approaches,” Array, vol. 16, p. 100258, 2022.

R. F. Puspita, M. Naufal, and F. Al Zami, “Improving YOLO Performance with Advanced Data Augmentation for Soccer Object Detection,” J. Appl. Informatics Comput., vol. 9, no. 6, pp. 3601–3611, 2025.

J. Jonathan and D. Hermanto, “Penentuan Epochs Hasil Model Terbaik: Studi Kasus Algoritma YOLOv8,” Digit. Transform. Technol., vol. 4, no. 2, pp. 792–798, 2024.

I. A. Zulkarnain and K. Kusrini, “Optimasi YOLOv11 Melalui Hyperparameter Tuning dan Data Augmentasi untuk Meningkatkan Akurasi Deteksi Kendaraan pada Kondisi Malam Hari: YOLOv11 Optimization Through Hyperparameter Tuning and Data Augmentation to Improve Vehicle Detection Accuracy at Night,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 5, no. 4, pp. 294–1303, 2025.

A. Abdulghani, M. Abdulghani, W. Walters, and K. Abed, “Multiple data augmentation strategy for enhancing the performance of yolov7 object detection algorithm,” J. Artif. Intell., vol. 5, p. 15, 2023.

Z. Xu, H. Zhao, P. Liu, L. Wang, G. Zhang, and Y. Chai, “SRTSOD-YOLO: stronger real-time small object detection algorithm based on improved YOLOv11 for UAV imageries,” Remote Sens., vol. 17, no. 20, p. 3414, 2025.

M. Munson and C. F. Olson, “Real-Time Evaluation of Aircraft Instruments,” in International Symposium on Visual Computing, 2024, pp. 396–409.

V. Hendriko and D. Hermanto, “Performance comparison of YOLOv10, YOLOv11, and YOLOv12 models on human detection datasets,” Brill. Res. Artif. Intell., vol. 5, no. 1, pp. 440–450, 2025.