Alshahrani, Haya Mesfer; Princess Nourah Bint Abdulrahman University > Department of Information Systems, College of Computer and Information Sciences
Nemri, Nadhem; King Khalid University, Saudi Arabia > Department of Information Systems, College of Science & Art at Mahayil
M. Othman, Kamal; Umm Al-Qura University, Makkah, Saudi Arabia > Department of Electrical Engineering, College of Engineering
O. Aljehane, Nojood; University of Tabuk, Tabuk, Saudi Arabia > Department of Computer Science, Faculty of Computers and Information Technology
Maashi, Mashael; Department of Software Engineering, College of Computer and Information Sciences, King Saud University > Department of Software Engineering, College of Computer and Information Sciences
Dutta, Ashit Kumar; AlMaarefa University, Riyadh 11597, Saudi Arabia > Department of Computer Science and Information System, College of Applied Sciences
Assiri, Mohammed; Prince Sattam bin Abdulaziz University, Aflaj 16273, Saudi Arabia > Department of Computer Science, College of Sciences and Humanities- Aflaj
KHAN, Wali Ullah ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
External co-authors :
yes
Language :
English
Title :
Dynamic resource management in integrated NOMA terrestrial–satellite networks using multi-agent reinforcement learning
Ahmad, I., Suomalainen, J., Porambage, P., Gurtov, A., Huusko, J., Höyhtyä, M., Security of satellite-terrestrial communications: Challenges and potential solutions. IEEE Access 10 (2022), 96038–96052.
Ahmed, M., et al. Vehicular communication network enabled CAV data offloading: A review. IEEE Trans. Intell. Transp. Syst., 2023.
Arulkumaran, K., Deisenroth, M.P., Brundage, M., Bharath, A.A., Deep reinforcement learning: A brief survey. IEEE Signal Process. Mag. 34:6 (2017), 26–38.
Azari, M.M., Solanki, S., Chatzinotas, S., Kodheli, O., Sallouha, H., Colpaert, A., Montoya, J.F.M., Pollin, S., Haqiqatnejad, A., Mostaani, A., et al. Evolution of non-terrestrial networks from 5G to 6G: A survey. IEEE Commun. Surv. Tutorials, 2022.
Cao, B., Li, M., Liu, X., Zhao, J., Cao, W., Lv, Z., Many-objective deployment optimization for a drone-assisted camera network. IEEE Trans. Netw. Sci. Eng. 8:4 (2021), 2756–2764.
Cao, Y., Lien, S.-Y., Liang, Y.-C., Deep reinforcement learning for multi-user access control in non-terrestrial networks. IEEE Trans. Commun. 69:3 (2020), 1605–1619.
Cao, B., Sun, Z., Zhang, J., Gu, Y., Resource allocation in 5G IoV architecture based on SDN and gog-cloud computing. IEEE Trans. Intell. Transp. Syst. 22:6 (2021), 3832–3840.
Cao, B., Zhang, J., Liu, X., Sun, Z., Cao, W., Nowak, R.M., Lv, Z., Edge–cloud resource scheduling in space–air–ground-integrated networks for internet of vehicles. IEEE Internet Things J. 9:8 (2022), 5765–5772.
Ferreira, P.V.R., Paffenroth, R., Wyglinski, A.M., Hackett, T.M., Bilen, S.G., Reinhart, R.C., Mortensen, D.J., Reinforcement learning for satellite communications: From LEO to deep space operations. IEEE Commun. Mag. 57:5 (2019), 70–75.
Gao, Z., Liu, A., Han, C., Liang, X., Sum rate maximization of massive MIMO NOMA in LEO satellite communication system. IEEE Wireless Commun. Lett. 10:8 (2021), 1667–1671.
Ge, R., Bian, D., Cheng, J., An, K., Hu, J., Li, G., Joint user pairing and power allocation for noma-based geo and leo satellite network. IEEE Access 9 (2021), 93255–93266.
Geraci, G., Garcia-Rodriguez, A., Azari, M.M., Lozano, A., Mezzavilla, M., Chatzinotas, S., Chen, Y., Rangan, S., Di Renzo, M., What will the future of UAV cellular communications be? A flight from 5G to 6G. IEEE Commun. Surv. Tutorials 24:3 (2022), 1304–1335.
Geraci, G., Lopez-Perez, D., Benzaghta, M., Chatzinotas, S., Integrating terrestrial and non-terrestrial networks: 3D opportunities and challenges. IEEE Commun. Mag., 2022.
Geraci, G., López-Pérez, D., Benzaghta, M., Chatzinotas, S., Integrating terrestrial and non-terrestrial networks: 3D opportunities and challenges. IEEE Commun. Mag. 61:4 (2023), 42–48, 10.1109/MCOM.002.2200366.
Giordani, M., Zorzi, M., Non-terrestrial networks in the 6G era: Challenges and opportunities. IEEE Netw. 35:2 (2020), 244–251.
Hasan, T., et al. Securing industrial internet of things against botnet attacks using hybrid deep learning approach. IEEE Trans. Netw. Sci. Eng., 2022.
Hu, X., Liu, S., Chen, R., Wang, W., Wang, C., A deep reinforcement learning-based framework for dynamic resource allocation in multibeam satellite systems. IEEE Commun. Lett. 22:8 (2018), 1612–1615.
Ji, Z., Wu, S., Jiang, C., Wang, W., Popularity-driven content placement and multi-hop delivery for terrestrial-satellite networks. IEEE Commun. Lett. 24:11 (2020), 2574–2578.
Jiang, H., Dai, X., Xiao, Z., Iyengar, A., Joint task offloading and resource allocation for energy-constrained mobile edge computing. IEEE Trans. Mob. Comput. 22:7 (2023), 4000–4015.
Jiao, J., Sun, Y., Wu, S., Wang, Y., Zhang, Q., Network utility maximization resource allocation for NOMA in satellite-based internet of things. IEEE Internet Things J. 7:4 (2020), 3230–3242.
Khan, W.U., Ali, Z., Lagunas, E., Chatzinotas, S., Ottersten, B., Rate splitting multiple access for cognitive radio GEO-leo co-existing satellite networks. GLOBECOM 2022-2022 IEEE Global Communications Conference, 2022, IEEE, 5165–5170.
Khan, W.U., Ali, Z., Lagunas, E., Mahmood, A., Asif, M., Ihsan, A., Chatzinotas, S., Ottersten, B., Dobre, O.A., Rate splitting multiple access for next generation cognitive radio enabled LEO satellite networks. IEEE Trans. Wireless Commun., 2023, 1, 10.1109/TWC.2023.3263116.
Khan, W.U., Ihsan, A., Nguyen, T.N., Ali, Z., Javed, M.A., NOMA-enabled backscatter communications for green transportation in automotive-industry 5.0. IEEE Trans. Ind. Inform. 18:11 (2022), 7862–7874.
Khan, W.U., Jameel, F., Kumar, N., Jäntti, R., Guizani, M., Backscatter-enabled efficient V2X communication with non-orthogonal multiple access. IEEE Trans. Veh. Technol. 70:2 (2021), 1724–1735.
Khan, W.U., Jameel, F., Li, X., Bilal, M., Tsiftsis, T.A., Joint spectrum and energy optimization of NOMA-enabled small-cell networks with QoS guarantee. IEEE Trans. Veh. Technol. 70:8 (2021), 8337–8342.
Khan, W.U., Jameel, F., Ristaniemi, T., Khan, S., Sidhu, G.A.S., Liu, J., Joint spectral and energy efficiency optimization for downlink NOMA networks. IEEE Trans. Cognit. Commun. Netw. 6:2 (2019), 645–656.
Khan, W.U., Lagunas, E., Mahmood, A., Ali, Z., Asif, M., Chatzinotas, S., Ottersten, B., Integration of NOMA with reflecting intelligent surfaces: A multi-cell optimization with SIC decoding errors. IEEE Trans. Green Commun. Netw., 2023.
Khan, W.U., Lagunas, E., Mahmood, A., Ali, Z., Chatzinotas, S., Ottersten, B., Dobre, O.A., Integration of backscatter communication with multi-cell NOMA: a spectral efficiency optimization under imperfect SIC. 2022 IEEE 27th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD), 2022, IEEE, 147–152.
Khan, W.U., Lagunas, E., Mahmood, A., Chatzinotas, S., Ottersten, B., RIS-assisted energy-efficient LEO satellite communications with NOMA. 2023 arXiv preprint arXiv:2306.10422.
Khan, W.U., Li, X., Ihsan, A., Khan, M.A., Menon, V.G., Ahmed, M., NOMA-enabled optimization framework for next-generation small-cell iov networks under imperfect SIC decoding. IEEE Trans. Intell. Transp. Syst. 23:11 (2021), 22442–22451.
Khan, W.U., Li, X., Zeng, M., Dobre, O.A., Backscatter-enabled NOMA for future 6G systems: A new optimization framework under imperfect SIC. IEEE Commun. Lett. 25:5 (2021), 1669–1672.
Khan, W.U., Liu, J., Jameel, F., Khan, M.T.R., Ahmed, S.H., Jäntti, R., Secure backscatter communications in multi-cell NOMA networks: Enabling link security for massive IoT networks. IEEE INFOCOM 2020-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), 2020, IEEE, 213–218.
Khan, W.U., Liu, J., Jameel, F., Sharma, V., Jäntti, R., Han, Z., Spectral efficiency optimization for next generation NOMA-enabled IoT networks. IEEE Trans. Veh. Technol. 69:12 (2020), 15284–15297.
Khan, W.U., Mahmood, A., Bozorgchenani, A., Jamshed, M.A., Ranjha, A., Lagunas, E., Pervaiz, H., Chatzinotas, S., Ottersten, B., Popovski, P., Opportunities for intelligent reflecting surfaces in 6G-empowered V2X communications. 2022 arXiv preprint arXiv:2210.00494.
Lagunas, E., Lei, L., Chatzinotas, S., Ottersten, B., Power and flow assignment for 5G integrated terrestrial-satellite backhaul networks. 2019 IEEE Wireless Communications and Networking Conference (WCNC), 2019, IEEE, 1–6.
Li, B., Li, Q., Zeng, Y., Rong, Y., Zhang, R., 3D trajectory optimization for energy-efficient UAV communication: A control design perspective. IEEE Trans. Wireless Commun. 21:6 (2022), 4579–4593.
Li, X., Zhang, H., Li, W., Long, K., Multi-agent DRL for user association and power control in terrestrial-satellite network. 2021 IEEE Global Communications Conference (GLOBECOM), 2021, IEEE, 1–5.
Li, B., Zhang, M., Rong, Y., Han, Z., Transceiver optimization for wireless powered time-division duplex MU-MIMO systems: Non-robust and robust designs. IEEE Trans. Wireless Commun. 21:6 (2022), 4594–4607.
Liao, X., Hu, X., Liu, Z., Ma, S., Xu, L., Li, X., Wang, W., Ghannouchi, F.M., Distributed intelligence: A verification for multi-agent drl-based multibeam satellite resource allocation. IEEE Commun. Lett. 24:12 (2020), 2785–2789.
Lin, X., An overview of 5G advanced evolution in 3GPP release 18. IEEE Commun. Stand. Mag. 6:3 (2022), 77–83.
Lin, X., Rommer, S., Euler, S., Yavuz, E.A., Karlsson, R.S., 5G from space: An overview of 3GPP non-terrestrial networks. IEEE Commun. Stand. Mag. 5:4 (2021), 147–153.
Liu, Q., Liu, R., Wang, Z., Han, L., Thompson, J.S., A V2X-integrated positioning methodology in ultradense networks. IEEE Internet Things J. 8:23 (2021), 17014–17028.
Liu, Q., Liu, R., Wang, Z., Thompson, J.S., UAV swarm-enabled localization in isolated region: a rigidity-constrained deployment perspective. IEEE Wireless Commun. Lett. 10:9 (2021), 2032–2036.
Liu, Q., Liu, R., Zhang, Y., Yuan, Y., Wang, Z., Yang, H., Ye, L., Guizani, M., Thompson, J.S., Management of positioning functions in cellular networks for time-sensitive transportation applications. IEEE Trans. Intell. Transp. Syst., 2023.
Mahmood, A., Ahmed, A., Naeem, M., Amirzada, M.R., Al-Dweik, A., Weighted utility aware computational overhead minimization of wireless power mobile edge cloud. Comput. Commun. 190 (2022), 178–189.
Mahmood, A., Ahmed, A., Naeem, M., Hong, Y., Partial offloading in energy harvested mobile edge computing: A direct search approach. IEEE Access 8 (2020), 36757–36763, 10.1109/ACCESS.2020.2974809.
Mahmood, A., Vu, T.X., Chatzinotas, S., Ottersten, B., Joint optimization of 3D placement and radio resource allocation for per-UAV sum rate maximization. IEEE Trans. Veh. Technol., 2023.
Nauman, A., Obayya, M., Asiri, M.M., Yadav, K., Maashi, M., Assiri, M., Ehsan, M.K., Kim, S.W., Minimizing energy consumption for NOMA multi-drone communications in automotive-industry 5.0. J. King Saud Univ. Comput. Inf. Sci., 2023, 101547.
Pan, S., Lin, M., Xu, M., Zhu, S., Bian, L.-A., Li, G., A low-profile programmable beam scanning holographic array antenna without phase shifters. IEEE Internet Things J. 9:11 (2022), 8838–8851.
Qian, Y., Wang, R., Wu, J., Tan, B., Ren, H., Reinforcement learning-based optimal computing and caching in mobile edge network. IEEE J. Sel. Areas Commun. 38:10 (2020), 2343–2355.
Rasheed, I., et al. LSTM-based distributed conditional generative adversarial network for data-driven 5G-enabled maritime UAV communications. IEEE Trans. Intell. Transp. Syst., 2022.
Raza, S., Wang, S., Ahmed, M., Anwar, M.R., Mirza, M.A., Khan, W.U., Task offloading and resource allocation for IoV using 5G NR-V2X communication. IEEE Internet Things J. 9:13 (2021), 10397–10410.
Rinaldi, F., Maattanen, H.-L., Torsner, J., Pizzi, S., Andreev, S., Iera, A., Koucheryavy, Y., Araniti, G., Non-terrestrial networks in 5G & beyond: A survey. IEEE Access 8 (2020), 165178–165200.
Sattarzadeh, A., Liu, Y., Mohamed, A., Song, R., Xiao, P., Song, Z., Zhang, H., Tafazolli, R., Niu, C., Satellite-based non-terrestrial networks in 5G: Insights and challenges. IEEE Access 10 (2021), 11274–11283.
Shaat, M., Pérez-Neira, A.I., Femenias, G., Riera-Palou, F., Joint frequency assignment and flow control for hybrid terrestrial-satellite backhauling networks. 2017 International Symposium on Wireless Communication Systems (ISWCS), 2017, IEEE, 293–298.
Shome, D., et al. Federated learning and next generation wireless communications: A survey on bidirectional relationship. Trans. Emerg. Telecommun. Technol., 33(7), 2022, e4458.
Wang, R., Kang, W., Liu, G., Ma, R., Li, B., Admission control and power allocation for NOMA-based satellite multi-beam network. IEEE Access 8 (2020), 33631–33643.
Wang, A., Lei, L., Lagunas, E., Pérez-Neira, A.I., Chatzinotas, S., Ottersten, B., NOMA-enabled multi-beam satellite systems: Joint optimization to overcome offered-requested data mismatches. IEEE Trans. Veh. Technol. 70:1 (2020), 900–913.
Zhang, Z., Chen, H., Hua, M., Li, C., Huang, Y., Yang, L., Double coded caching in ultra dense networks: Caching and multicast scheduling via deep reinforcement learning. IEEE Trans. Commun. 68:2 (2019), 1071–1086.
Zhang, H., Wang, B., Jiang, C., Long, K., Nallanathan, A., Leung, V.C., Poor, H.V., Energy efficient dynamic resource optimization in NOMA system. IEEE Trans. Wireless Commun. 17:9 (2018), 5671–5683.
Zhang, T., Wang, Z., Liu, Y., Xu, W., Nallanathan, A., Caching placement and resource allocation for cache-enabling UAV NOMA networks. IEEE Trans. Veh. Technol. 69:11 (2020), 12897–12911.
Zhang, T., Wang, Z., Liu, Y., Xu, W., Nallanathan, A., Joint resource, deployment, and caching optimization for AR applications in dynamic UAV NOMA networks. IEEE Trans. Wireless Commun. 21:5 (2021), 3409–3422.
Zhang, H., Yang, N., Huangfu, W., Long, K., Leung, V.C., Power control based on deep reinforcement learning for spectrum sharing. IEEE Trans. Wireless Commun. 19:6 (2020), 4209–4219.
Zhang, H., Zhang, H., Liu, W., Long, K., Dong, J., Leung, V.C., Energy efficient user clustering, hybrid precoding and power optimization in terahertz MIMO-NOMA systems. IEEE J. Sel. Areas Commun. 38:9 (2020), 2074–2085.
Zhao, Z., Xu, G., Zhang, N., Zhang, Q., Performance analysis of the hybrid satellite-terrestrial relay network with opportunistic scheduling over generalized fading channels. IEEE Trans. Veh. Technol. 71:3 (2022), 2914–2924.
