高密度NOMA网络中网络切片的子信道分配和功率分配优化：Q学习方法

The growing number of connected devices in high-density environments poses serious challenges for accommodating and managing these devices across different network slicing services, such as ultra-reliable low-latency communication (URLLC) and massive machine-type communication (mMTC). Because every service has distinct quality of service (QoS) requirements, it is essential to ensure the seamless coexistence of these devices. The main difficulty is allocating network resources to maximize spectrum utilization while meeting mMTC’s massive connectivity demands and offering URLLC’s demand for ultra-reliable, low-latency communication. In this study, non-orthogonal multiple access (NOMA) network slicing is utilized to share radio resources among various services, thereby improving connectivity for large-scale device deployments. When these services exist in high-density NOMA environments characterized by high network congestion with radio resource sharing, the level of difficulty increases significantly. To address these issues, an optimization algorithm is proposed for subchannel assignment and power allocation in NOMA high-density networks for URLLC and mMTC devices. The solution adopts a Q-learning algorithm to optimize decision-making processes and ensure efficient resource sharing between URLLC and mMTC devices, while satisfying their distinct QoS requirements. Extensive simulations demonstrate that the proposed algorithm is flexible and scalable in dynamic scenarios, outperforming random and exhaustive search algorithms in high-density NOMA networks in terms of sum rates. The sum rate of the proposed algorithm increased by approximately 23.44% compared to that of the exhaustive search algorithm.