MITIGATING ENERGY DISSIPATION IN WIRELESS SENSOR NETWORKS VIA REINFORCEMENT LEARNING

Awan Nahel  Mahmood; Turkan Ahmed  Khaleel

doi:10.30572/2018/KJE/170323

Authors

Awan Nahel Mahmood Control System Engineering Department, College of Electronic Engineering, Ninevah University, Iraq
Turkan Ahmed Khaleel Computer Engineering Department, College of Engineering, University of Mosul, Iraq

DOI:

https://doi.org/10.30572/2018/KJE/170323

Keywords:

Energy efficiency, consumption, Routing protocols, Reinforcement Learning, Wireless Sensor Networks

Abstract

The Wireless Sensor Networks (WSNs) are widely used in environmental monitoring, healthcare, and smart farming. However, energy consumption remains critical since battery-powered sensor nodes directly affect network lifetime. The conventional clustering and multi-hop routing algorithms are prone to collapse when used in dynamic environments, resulting in poor energy consumption and frequent node failures. This paper proposes a novel reinforcement learning (RL) routing algorithm based on Q-learning to enhance energy savings in WSNs. The algorithm is dynamic in assigning routes based on node energy, communication distance, and packet size, and adapts in real-time to network changes. It ensures that data transfer is efficient and the load distribution throughout the network is even by updating routing decisions with Q-learning. These simulation outcomes indicate that the suggested algorithm can save up to 25% of energy per round relative to traditional protocols and increase network life to 50 times that of the LEACH protocol

Downloads

Download data is not yet available.

References

Abbas, D.T., Hammood, D.A. and Azemi, S.N. (2023) "Minimizing energy consumption based on clustering & data aggregation technique in WSN (MECCLADA)", Journal of Techniques, 5(2), pp. 10–19.

Abdulzahra, A.A., Khudor, B.A.Q. and Alshawi, I.S. (2023) "Energy-efficient routing protocol in wireless sensor networks based on bacterial foraging optimization", Indonesian Journal of Electrical Engineering and Computer Science, 29(2), pp. 911–920.

Abuhmida, M., Radhakrishnan, K. and Wells, I. (2015) "Performance evaluation of mobile ad hoc routing protocols on wireless sensor networks for environmental monitoring", in 17th UKSim-AMSS International Conference on Modelling and Simulation (UKSim).

Al-Janabi, H.A. (2022) "Energy-efficient clustering techniques in wireless sensor networks: A comparative study", Journal of Kufa for Engineering, 10(3), pp. 101–115.

Al-Shimary, R.H. and Al-Doski, S.H. (2023) "Performance evaluation of clustering protocols for energy efficiency in wireless sensor networks", Journal of Kufa for Engineering, 12(2), pp. 55–67.

Bains, V. and Sharma, K. (2012) "Ant colony based routing in wireless sensor networks", International Journal of Electronics and Computer Science Engineering, 1(4), pp. 2516–2524.

Begum, B.A. and Nandury, S.V. (2022) "A survey of data aggregation protocols for energy conservation in WSN and IoT", Wireless Communications and Mobile Computing, 2022, pp. 1–28.

Boonlert, A., Pornavalai, C., Tuwanut, P. and Tanessakulwattana, S. (2024) "EORL: Energy optimization via reinforcement learning in software-defined wireless sensor networks", in Proc. 9th International Conference on Information Technology (INCIT), pp. 618–623.

Cengiz, K. and Dag, T. (2018) "Energy aware multi-hop routing protocol for WSNs", IEEE Access, 6, pp. 2622–2633.

Cui, R., Qu, Z. and Yin, S. (2013) "Energy-efficient routing protocol for energy harvesting wireless sensor network", in 15th IEEE International Conference on Communication Technology.

Del-Valle-Soto, C., Velázquez, R., Valdivia, L.J., Giannoccaro, N.I. and Visconti, P. (2020) "An energy model using sleeping algorithms for wireless sensor networks under proactive and reactive protocols: A performance evaluation", Energies, 13(11), p. 3024.

Ghaffari, A. (2014) "An energy efficient routing protocol for wireless sensor networks using A-star algorithm", Journal of Applied Research and Technology, 12(4), pp. 815–822.

Godfrey, D., Suh, B., Lim, B.H., Lee, K.C. and Kim, K.I. (2023) "An energy-efficient routing protocol with reinforcement learning in software-defined wireless sensor networks", Sensors, 23(20), p. 8435.

Heinzelman, W. R., Chandrakasan, A., & Balakrishnan, H. (2002). An Application-Specific Protocol Architecture for Wireless Microsensor Networks. IEEE Transactions on Wireless Communications, 1(4), 660–670.

Humady, Z.A. and Mahdi, M.A. (2023) "A localization in WSN based on area of field and mobility: A survey", Journal of Kufa for Mathematics and Computer, 10(2), pp. 15–28. Available at: https://journal.uokufa.edu.iq/index.php/jkmc/article/download/10750/10729.

Kumar, A. et al. (2024) "Hardware implementation of a reinforcement learning based energy efficient protocol for wireless sensor network", pp. 1–5. Available at: 10.1109/mac61551.2024.10837438.

Liu, Y., Wu, Q., Zhao, T., Tie, Y., Bai, F. and Jin, M. (2019) "An improved energy-efficient routing protocol for wireless sensor networks", Sensors (Basel), 19(20), p. 4579.

Makimaa, Y.P. and Sudarmani, R. (2024) "Secured routing protocol for improving the energy efficiency in WSN applications", IET Circuits, Devices & Systems, 2024(1).

Nishat, T.A.H., Jeong, J.H., Jo, H., Xia, S. and Liu, J. (2025) "Reinforcement learning for adaptive battery management of structural health monitoring IoT sensor network", Applied Energy, 390, p. 125731.

Pradeep, S., Sharma, Y.K., Verma, C., Dalal, S. and Prasad, C. (2022) "Energy efficient routing protocol in novel schemes for performance evaluation", Applied System Innovation, 5(5), p. 101.

Prithi, S. and Sumathi, S. (2023) "Implementation framework for energy efficient routing in wireless sensor network", International Journal of Engineering, Science and Technology, 15(2), pp. 36–47.

Raj, L.D.A.A. (2018) "Analysis on energy efficiency flat routing protocols for wireless sensor communication network", International Journal of Research in Applied Science and Engineering Technology, 6(4), pp. 526–530.

Sachithanandam, V., Jessintha, D., Balaji, V.S. and Manoharan, M. (2025) "Deep reinforcement learning and enhanced optimization for real-time energy management in wireless sensor networks", Sustainable Computing: Informatics and Systems, 45, p. 101071.

Saleem, M.M. and Alabady, S.A. (2023) "Energy‐efficient multipath clustering with load balancing routing protocol for wireless multimedia sensor networks", IET Wireless Sensor Systems, 13(3), pp. 104–114.

Salih, M.A. and Sulaiman, D.R. (2023) "Throughput and energy efficiency evaluation of WSN using efficient routing protocols", University of Thi-Qar Journal for Engineering Sciences, 13, pp. 25–33.

Saravanan, G. and Santhosh Babu, A.V. (2024) "Workload prediction for enhancing power efficiency of cloud data centers using optimized self-attention-based progressive generative adversarial network", International Journal of Communication Systems, 37(1), p. e5634.

Schurgers, C. and Srivastava, M.B. (2002) "Energy efficient routing in wireless sensor networks", in 2001 MILCOM Proceedings Communications for Network-Centric Operations: Creating the Information Force (Cat. No.01CH37277).

Soltani, P., Eskandarpour, M., Ahmadizad, A. and Soleimani, H. (2025) "Energy-efficient routing algorithm for wireless sensor networks: A multi-agent reinforcement learning approach", arXiv preprint arXiv:2508.14679.

Srinivasamurthy, P.K.N. and Tabassum, N. (2024) "An extensive study on energy efficient clustering and routing protocols in wireless sensor networks (WSN)", in International Conference on Electronics, Computing, Communication and Control Technology (ICECCC).

Subhashini, G., Rajalakshmi, R., Shriram, S.H., Krishnakumari, L., Chandralekha, R. and Neerathilingam, E. (2023) "Modern WSN routing protocol using methods for reducing energy consumption based on blockchain technology", in International Conference on Recent Advances in Science and Engineering Technology (ICRASET).

Suresh, S., Prabhu, V., Parthasarathy, V., Boddu, R., Sucharitha, Y. and Teshite, G. (2022) "A novel routing protocol for low-energy wireless sensor networks", Journal of Sensors, 2022, pp. 1–8.

Wang, Y., Deng, K., Ren, Y., Chan, J., Tian, G. and Jensen, C.S. (2024) "Reinforcement learning for tackling energy-saving and energy-balance dilemma of cluster-based routing protocols in WSNs", IEEE Access.

Younus, H.A. and Koçak, C. (2022) "Optimized routing by combining grey wolf and dragonfly optimization for energy efficiency in wireless sensor networks", Applied Sciences (Basel), 12(21), p. 10948