OBJECT DETECTION ALGORITHMS IMPLEMENTATION ON EMBEDDED DEVICES: CHALLENGES AND SUGGESTED SOLUTIONS

Ruqaya Alaa; Ehab Hussein; Hilal Al-libawy

doi:10.30572/2018/KJE/150309

Authors

Ruqaya Alaa Department of Electrical Engineering, College of Engineering, University of Babylon, Republic of Iraq https://orcid.org/0009-0009-6545-7726
Ehab Hussein Department of Electrical Engineering, College of Engineering, University of Babylon, Republic of Iraq
Hilal Al-libawy Department of Electrical Engineering, College of Engineering, University of Babylon, Republic of Iraq

DOI:

https://doi.org/10.30572/2018/KJE/150309

Keywords:

Tiny Machine Learning, Deep learning; Artificial intelligence, Embedded devices, TensorFlow Lite, MicroPython

Abstract

Object detection and image classification are among the most important areas to which scientific research is directed, which are commonly used in various applications based on computer vision. The development of low-cost embedded devices with powerful processing is leading to a trend in their use in computer vision, which provides reduced access time, reliability, and data security. That's why Tiny Machine Learning (TinyML) technology appeared, which is field that specifically explores the application of machine learning on highly limited edge devices. Deep learning techniques are increasingly employed in data-intensive and time-sensitive IoT applications. Deploying Deep Neural Network (DNN) models on microcontrollers (MCUs) is challenging due to limited resources such as RAM. Recent advancements in the field of TinyML hold the potential to introduce a novel category of peripheral applications. TinyML enables the development of new applications and services by eliminating the reliance on cloud computing, which consumes power and poses risks to data security and privacy. TinyML currently regarded as a promising artificial intelligence (AI( alternative that specifically targets technologies and applications for devices with very low profiles. In this paper, the most important algorithms used in object detection will be presented, in addition to the challenges in using low-resource embedded systems that support TinyML technology.

Downloads

Download data is not yet available.

References

A. Faraone and R. Delgado-Gonzalo, ‘‘Convolutional-recurrent neural networks on low-power wearable platforms for cardiac arrhythmia detection,’’ in Proc. 2nd IEEE Int. Conf. Artif. Intell. Circuits Syst. (AICAS), Aug. 2020, pp. 153–157.

A. Shawahna, S. M. Sait, and A. El-Maleh, ‘‘Fpga-based accelerators of deep learning networks for learning and classification: A review,’’ ieee Access, vol. 7, pp. 7823–7859, 2018.

Abadade, Y., Temouden, A., Bamoumen, H., Benamar, N., Chtouki, Y., & Hafid, A. S. (2023). A comprehensive survey on tinyml. IEEE Access.

Abadade, Youssef, et al. "A comprehensive survey on tinyml." IEEE Access (2023).

Abbas, Syed Mazhar, and Shailendra Narayan Singh. "Region-based object detection and classification using faster R-CNN." 2018 4th International Conference on Computational Intelligence & Communication Technology (CICT). IEEE, 2018.

Alajlan, Norah N., and Dina M. Ibrahim. "DDD TinyML: A TinyML-Based Driver Drowsiness Detection Model Using Deep Learning." Sensors 23.12 (2023): 5696.

Álvarez, José Luis, Juan Daniel Mozo, and Eladio Durán. "Analysis of single board architectures integrating sensors technologies." Sensors 21.18 (2021): 6303.

Aoueileyine, Mohamed Ould-Elhassen. "Tiny Machine Learning for IoT and eHealth Applications: Epileptic Seizure Prediction Use Case." International Conference on Digital Technologies and Applications. Cham: Springer Nature Switzerland, 2023.

ARSLAN, S.E. and BOLAT, B., Tiny machine learning model for obstacle detection with multi-zone time of flight sensors. C. Nicolas, B. Naila, and R.-C. Amar, ‘‘TinyML smart sensor for energy saving in Internet of Things precision agriculture platform,’’ in Proc. 13th Int. Conf. Ubiquitous Future Netw. (ICUFN), Jul. 2022, pp. 256–259.

Bell, Charles. MicroPython for the Internet of Things. Berlin/Heidelberg, Germany: Springer, 2017.

Bharati, Puja, and Ankita Pramanik. "Deep learning techniques—R-CNN to mask R-CNN: a survey." Computational Intelligence in Pattern Recognition: Proceedings of CIPR 2019 (2020): 657-668.

Bhattacharya, Saurabh, and Manju Pandey. "Deploying an energy efficient, secure & high-speed sidechain-based TinyML Model for Soil Quality Monitoring and Management in Agriculture." Expert Systems with Applications (2023): 122735.

Du, Lixuan, Rongyu Zhang, and Xiaotian Wang. "Overview of two-stage object detection algorithms." Journal of Physics: Conference Series. Vol. 1544. No. 1. IOP Publishing, 2020.

Fu, Xiang, et al. "DA-FPN: Deformable Convolution and Feature Alignment for Object Detection." Electronics 12.6 (2023): 1354.

Jolles, Jolle W. "Broad‐scale applications of the Raspberry Pi: A review and guide for biologists." Methods in Ecology and Evolution 12.9 (2021): 1562-1579.

Kallimani, R., Pai, K., Raghuwanshi, P., Iyer, S. and López, O.L., 2023. TinyML: Tools, applications, challenges, and future research directions. Multimedia Tools and Applications, pp.1-31

Kamath, Vidya, and A. Renuka. "Deep Learning Based Object Detection for Resource Constrained Devices-Systematic Review, Future Trends and Challenges Ahead." Neurocomputing (2023).

Kunhoth, Jayakanth, et al. "VisualAid+: Assistive System for Visually Impaired with TinyML Enhanced Object Detection and Scene Narration." 2023 International Symposium on Networks, Computers and Communications (ISNCC). IEEE, 2023.

Kurniawan, Agus. "Iot projects with arduino nano 33 ble sense." Berkeley: Apress 129 (2021).

Lin, Ji, et al. "Tiny Machine Learning: Progress and Futures [Feature]." IEEE Circuits and Systems Magazine 23.3 (2023): 8-34.

Lin, Szu-Yin, and Hao-Yu Li. "Integrated circuit board object detection and image augmentation fusion model based on YOLO." Frontiers in Neurorobotics 15 (2021): 762702.

Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B. and Belongie, S., 2017. Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117-2125).

Lin, Tsung-Yi, et al. "Feature pyramid networks for object detection." Proceedings of the IEEE conference on computer vision and pattern recognition. 2017.

Maslov, D. (2022) Announcing Official Support for the Arduino Nicla Vision, Edge impulse. Available at: https://edgeimpulse.com/blog/announcing-official-support-for-the-arduino-nicla-visionwww.skroutz.gr/s/38491287/Arduino-Nicla-Vision-ABX00051.html (Accessed: 02 January 2024). (Accessed: 03 January 2024).

Murthy, C. B., Hashmi, M. F., Bokde, N. D., & Geem, Z. W. (2020). Investigations of object detection in images/videos using various deep learning techniques and embedded platforms—A comprehensive review. Applied sciences, 10(9), 3280.‏

P. Andrade, I. Silva, G. Signoretti, M. Silva, J. Dias, L. Marques, and D. G. Costa, ‘‘An unsupervised TinyML approach applied for pavement anomalies detection under the Internet of Intelligent vehicles,’’ in Proc. IEEE Int. Workshop Metrology for Ind. 4.0 IoT (MetroInd4.0IoT), Jun. 2021, pp. 642–647

Qureshi, Rizwan, et al. "A Comprehensive Systematic Review of YOLO for Medical Object Detection (2018 to 2023)." Authorea Preprints (2023).

R. Banbury, V. J. Reddi, M. Lam, W. Fu, A. Fazel, J. Holleman, X. Huang, R. Hurtado, D. Kanter, A. Lokhmotov, D. Patterson, D. Pau, J. sun Seo, J. Sieracki, U. Thakker, M. Verhelst, and P. Yadav, “Benchmarking TinyML systems: Challenges and direction,” 2021

Rakkiannan, Thamilselvan, et al. "An automated network slicing at edge with software defined networking and network function virtualization: a federated learning approach." Wireless Personal Communications 131.1 (2023): 639-658.

Rani, Shilpa, Deepika Ghai, and Sandeep Kumar. "Object detection and recognition using contour based edge detection and fast R-CNN." Multimedia Tools and Applications 81.29 (2022): 42183-42207.

Ray, Partha Pratim. "A review on TinyML: State-of-the-art and prospects." Journal of King Saud University-Computer and Information Sciences 34.4 (2022): 1595-1623.

Raza, Wamiq, et al. "Energy-efficient inference on the edge exploiting TinyML capabilities for UAVs." Drones 5.4 (2021): 127.

Sabovic, Adnan, et al. "Towards energy-aware tinyML on battery-less IoT devices." Internet of Things 22 (2023): 100736.

Sakr, F. O. U. A. D. "Tiny Machine Learning Environment: Enabling Intelligence on Constrained Devices." (2023).

Sanchez-Iborra, Ramon, and Antonio F. Skarmeta. "Tinyml-enabled frugal smart objects: Challenges and opportunities." IEEE Circuits and Systems Magazine 20.3 (2020): 4-

Schizas, Nikolaos, et al. "TinyML for Ultra-Low Power AI and Large Scale IoT Deployments: A Systematic Review." Future Internet 14.12 (2022): 363.

Sérgio, André G. Ferreira, and Jorge Cabral. "Machine learning in resource-scarce embedded systems, FPGAs, and end-devices: A survey." Electronics 8.11 (2019): 1289.

Siderius, J. C. Teaching (Tiny) ML using a tangible educational kit. BS thesis. University of Twente, 2023.

Simões, Bruno Gobato, et al. "SPECIALIZED BRAIN TUMOR DETECTION SYSTEM FOR SUPERIOR VIEW OF CRANIAL MRI USING AI AND TINY ML TECHNIQUES." Anais Do Workshop De Micro-ondas. Clube de Autores, 2023.

Sobha, Prathibha, and Shahram Latifi. "A Survey of the Machine Learning Models for Forest Fire Prediction and Detection." International Journal of Communications, Network and System Sciences 16.7 (2023): 131-150.

V. Gutti and R. Karthi, ‘‘Real time classification of fruits and vegetables deployed on low power embedded devices using tiny ML,’’ in Proc. Int. Conf. Image Process. Capsule Netw. Cham, Switzerland: Springer, 2022, pp. 347–359.

V. M. Oliveira and A. H. Moreira, ‘‘Edge AI system using a thermal camera for industrial anomaly detection,’’ in International Summit Smart City 360◦ . Cham, Switzerland: Springer, 2022, pp. 172–187.

Warden, Pete, and Daniel Situnayake. Tinyml: Machine learning with tensorflow lite on arduino and ultra-low-power microcontrollers. O'Reilly Media, 2019.

Xu, K., Zhang, H., Li, Y., Zhang, Y., Lai, R. and Liu, Y., 2023. An ultra-low power tinyml system for real-time visual processing at edge. IEEE Transactions on Circuits and Systems II: Express Briefs.

Zhang, Xi, et al. "A Novel SSD-Based Detection Algorithm Suitable for Small Object." IEICE TRANSACTIONS on Information and Systems 106.5 (2023): 625-634.

Zhou, Xu, et al. "A Survey of the Security Analysis of Embedded Devices." Sensors 23.22 (2023): 9221.

Zim, Md Ziaul Haque. "TinyML: analysis of Xtensa LX6 microprocessor for neural network applications by ESP32 SoC." arXiv preprint arXiv:2106.10652 (2021).