INTELLIGENT HUMAN RESCUE ROBOT: AN AI-DRIVEN APPROACH WITH FPGA TECHNOLOGY

Salam Al-Khammasi; Hasanain Ali  Hussein; Ebtesam Najim  AlShemmary; Ammar  Karkar

doi:10.30572/2018/KJE/170140

Authors

Salam Al-Khammasi Information Technology Research and Development Center, University of Kufa, Kufa, Iraq
Hasanain Ali Hussein Information Technology Research and Development Center, University of Kufa, Kufa, Iraq
Ebtesam Najim AlShemmary Information Technology Research and Development Center, University of Kufa, Kufa, Iraq
Ammar Karkar Higher Education Development Center, University of Otago, Dunedin, New Zealand

DOI:

https://doi.org/10.30572/2018/KJE/170140

Keywords:

AI robotics, Disaster response, FPGA, Multi-sensor fusion, Search and rescue (SAR), YOLOv8

Abstract

This study introduces an innovative AI-driven robotic system designed to enhance search and rescue operations in disaster-stricken areas, including earthquakes, floods, and conflict zones. The system integrates a multi-modal sensory framework combining RGB and thermal imaging, processed through a robust pipeline: raw sensor data undergoes validity checks and noise filtering to ensure input integrity, followed by human detection via the You Only Look Once (YOLOv8) algorithm. Concurrently, ultrasonic sensors relay environmental data to a Field-Programmable Gate Array (FPGA) module, enabling real-time obstacle avoidance and dynamic path planning for rapid, precise navigation. Experimental results demonstrate a 96% accuracy rate in survivor detection, outperforming comparable AI-FPGA hybrid systems—particularly in identifying partially obscured humans. The system also exhibits superior response times and operational safety, as quantified in the results section. Future work will focus on expanding sensory modalities, adaptive learning mechanisms, and multi-robot coordination to further enhance mission efficacy

Downloads

Download data is not yet available.

References

U.S. Geological Survey (2017) Significant earthquakes—2017. Available at: http://earthquake.usgs.gov/earthquakes/browse/significant.php (Accessed: 23 February 2017).

AlShemmary, E.N. (1999) Path planning for robot arm using neural networks. M.Sc. thesis. University of Technology, Baghdad, Iraq.

Huo, R., Agapiou, A., Bocos-Bintintan, V., Brown, L.J., Burns, C., Creaser, C.S., Devenport, N.A., Gao-Lau, B., Guallar-Hoyas, C., Hildebrand, L., Malkar, A. et al. (2011) ‘The trapped human experiment’, Journal of Breath Research, 5(4), p. 046006.

Riya, F.F. and Azam, K.S. (2020) ‘Fascinating autonomous robot for calamity strategies that can offer assistance under rubble and to total errands rapidly and proficiently’, International Journal of Advanced Science and Technology, 29(03), pp. 7606–7612.

Kiriazis, E. and Zisiadis, A. (1999) Technical handbook for search & rescue operations in earthquakes. 2nd edn. Edited by Z. Voi and M. Dandoulaki. Athens, Greece: Access Soft Limited, pp. 1–48.

Berger, W., Coutinho, E.S.F., Figueira, I., Marques-Portella, C., Luz, M.P., Neylan, T.C., Marmar, C.R., and Mendlowicz, M.V. (2012) ‘Rescuers at risk: A systematic review and meta-regression analysis of the worldwide current prevalence and correlates of PTSD in rescue workers’, Social Psychiatry and Psychiatric Epidemiology, 47, pp. 1001–1011.

Alaa, R., Hussein, E. & Al-libawy, H. (2024) 'Object Detection Algorithms Implementation on Embedded Devices: Challenges and Suggested Solutions', Kufa Journal of Engineering, 15(3), pp. 148–169. Available at: https://doi.org/10.30572/2018/KJE/150309.

Lopez, J., Fernandes, R. and Zhang, L. (2025) ‘Multimodal AI rescue system combining LiDAR, thermal imaging, and FPGA-based sensor fusion’, International Journal of Advanced Robotic Systems, 12(1), 22–35.

Huang, C.-H., Chen, Y.-C., Hsu, C.-C., Yang, J.-T. and Chang, C.-Y. (2024) ‘FPGA-based UAV and UGV for search and rescue applications: A case study’, Social Science Research Network (SSRN). Available at: https://doi.org/10.2139/ssrn.4715901 [Accessed: 20 February 2025].

Pallapothu, U., Reddy, J.M., Anilet, B. and Christen, P. (2024) ‘A rescue aid for hazardous situations’, 2024 Asia Pacific Conference on Intelligent Technology (APCIT). Available at: https://doi.org/10.1109/apci61480.2024.10617065 [Accessed: 20 February 2025].

Murali, K.P. (2024) Intelligent robotics: AI-driven solutions for autonomous systems and smart machines. New York: NESX Publications. Available at: https://doi.org/10.62311/nesx/905742 [Accessed: 20 February 2025].

Saengsint, C. et al. (2023) ‘Autonomous rescue hexapod robot with AI human detection and tracking’, 2023 IEEE International Conference on Robotics and Biomimetics (ROBIO). Available at: https://doi.org/10.1109/robio58561.2023.10354946 [Accessed: 20 February 2025].

Kim, S., Rao, A. and Li, M. (2022) ‘Real-time human detection in disaster zones using AI and edge-computing-enabled UAVs’, Journal of Intelligent Robotics and Applications, 6(2), 101–112.

Huang, C.-H., Yang, S.-Y., Huang, W.-T. and Wu, P.-R. (2021) ‘An edge AI-based robot system for search and rescue applications’, Proceedings of the International Conference on Omni-layer Intelligent Systems (COINS). Available at: https://doi.org/10.1109/COINS51742.2021.9524186 [Accessed: 20 February 2025].

Alam, S.K., Ahmed, T., Islam, M.S., and Chowdhury, M.M.F. (2021) ‘A smart approach for human rescue and environment monitoring autonomous robot’, International Journal of Mechanical Engineering and Robotics Research, 10(4), pp. 209–215.

Zahid, A.Z.G., Muttair, K.S., Shareef, O.A., Diwan, A.A., Taher, H.B., Alfilh, R.H.C., Farhan, A.M., Mosleh, M.F. & Arith, F. (2025) 'A New Intelligent Driver Vigilance System Design Using Tilt Sensors', Kufa Journal of Engineering, 16(1), pp. 298–323. Available at: https://doi.org/10.30572/2018/KJE/160118

AlShemmary, E.N. (2025) Rescue robot project for disaster response [GitHub repository]. Available at: https://github.com/Ebtesam-AlShemmary/Rescue-Robot-Project-for-Disaster-Response.git [Accessed: 14 January, 2025].

Aidi Sharif, M., Ismael, H.H., Jasim, M.A. & Jasim, F.Z. (2025) 'Artificial Intelligence in Robotic Manipulators: Exploring Object Detection and Grasping Innovations', Kufa Journal of Engineering, 16(1), pp. 136–159. Available at: https://doi.org/10.30572/2018/KJE/160109.

Da Silva, T.S., Silveira, M.S., Maurer, F., and Hellmann, T. (2012) ‘User experience design and agile development: From theory to practice’, Journal of Software Engineering and Applications, 5, pp. 4236–434.

Norman, D.A. (2002) ‘Emotion & design: Attractive things work better’, Interactions, 9(4), pp. 36–42.

Cheng, J., Tan, D., Zhang, T., Wei, A., and Chen, J. (2022) ‘YOLOv5-MGC: GUI element identification for mobile applications based on improved YOLOv5’, Mobile Information Systems, 2022(1), p. 8900734.

Atiqur, A.R. and Li, Y. (2020) ‘Automated smart car parking system using Raspberry Pi 4 and iOS application’, International Journal of Reconfigurable and Embedded Systems (IJRES), 9(3), pp. 229–234.

Niu, Y., Cheng, W., Shi, C., and Fan, S. (2023) ‘YOLOv8-CGRNet: A lightweight object detection network leveraging context guidance and deep residual learning’, Electronics, 13(1).

SIMCom (2014) SIM808 hardware design V1.00. Available at: https://cdn-shop.adafruit.com/datasheets/SIM808_Hardware+Design_V1.00.pdf [Accessed: 2 February 2025].

Suntaxi, R.J.J. (2024) Implementation of a two-wheeled self-balancing vehicle for microcontroller practice. Undergraduate thesis. Universidad de las Fuerzas Armadas ESPE. Available at: https://repositoriobe.espe.edu.ec/server/api/core/bitstreams/037e3f29-8630-433e-9138-720e1e325551/content [Accessed: 2 February, 2025].

Paglinawan, C.C., Lagman, J.K.D., and Evangelista, A.B. (2024) ‘A search operation unmanned aerial vehicle using YOLO v5 with real-time human detection and counting’. In: Proceedings of the International Conference on Computing and Artificial Intelligence.

Zhao, H., Zhang, J., Wu, Y., and Chen, J. (2024) ‘Design of rescue robot system based on multi-sensor information fusion’. In: Proceedings of the 4th International Conference on Control and Intelligent Robotics, Beijing, China, pp. 133–137.

Aboualola, M., Abualsaud, K., Khattab, T., Zorba, N., and Hassanein, H.S. (2023) ‘Edge technologies for disaster management: A survey of social media and artificial intelligence integration’, IEEE Access.

Drew, D.S. (2021) ‘Multi-agent systems for search and rescue applications’, Current Robotics Reports, 2, pp. 189–200.