Backhaul Capacity-Limited Joint User Association and Power Allocation Scheme in Ultra-Dense Millimeter-Wave Networks.

Millimeter-wave (mmWave) communication is considered a promising technology for fifth-generation (5G) wireless communications systems since it can greatly improve system throughput. Unfortunately, because of extremely high frequency, mmWave transmission suffers from the signal blocking problem, which leads to the deterioration of transmission performance. In this paper, we solve this problem by the combination of ultra-dense network (UDN) and user-centric virtual cell architecture. The deployment of dense small base stations (SBSs) in UDN can reduce transmission distance of signals. The user-centric virtual cell architecture mitigates and exploits interference to improve throughput by using coordinated multipoint (CoMP) transmission technology. Nonetheless, the backhaul burden is heavy and interbeam interference still severe. Therefore, we propose a novel iterative backhaul capacity-limited joint user association and power allocation (JUAPA) scheme in ultra-dense mmWave networks under user-centric virtual cell architecture. To mitigate interference and satisfy quality of service (QoS) requirements of users, a nonconvex system throughput optimization problem is formulated. To solve this intractable optimization problem, we divide it into two alternating optimization subproblems, i.e., user association and power allocation. During each iteration, a many-to-many matching algorithm is designed to solve user association. Subsequently, we perform power allocation optimization using a successive convex approximation (SCA) algorithm. The results confirm that the performance of the proposed scheme is close to that of the exhaustive searching scheme, which greatly reduces complexity, and clearly superior to that of traditional schemes in improving system throughput and satisfying QoS requirements.

Multi-Agent Reinforcement Learning Based Fully Decentralized Dynamic Time Division Configuration for 5G and B5G Network.

Future network services must adapt to the highly dynamic uplink and downlink traffic. To fulfill this requirement, the 3rd Generation Partnership Project (3GPP) proposed dynamic time division duplex (D-TDD) technology in Long Term Evolution (LTE) Release 11. Afterward, the 3GPP RAN#86 meeting clarified that 5G NR needs to support dynamic adjustment of the duplex pattern (transmission direction) in the time domain. Although 5G NR provides a more flexible duplex pattern, how to configure an effective duplex pattern according to services traffic is still an open research area. In this research, we propose a distributed multi-agent deep reinforcement learning (MARL) based decentralized D-TDD configuration method. First, we model a D-TDD configuration problem as a dynamic programming problem. Given the buffer length of all UE, we model the D-TDD configuration policy as a conditional probability distribution. Our goal is to find a D-TDD configuration policy that maximizes the expected discount return of all UE's sum rates. Second, in order to reduce signaling overhead, we design a fully decentralized solution with distributed MARL technology. Each agent in MARL makes decisions only based on local observations. We regard each base station (BS) as an agent, and each agent configures uplink and downlink time slot ratio according to length of intra-BS user (UE) queue buffer. Third, in order to solve the problem of overall system revenue caused by the lack of global information in MARL, we apply leniency control and binary LSTM (BLSTM) based auto-encoder. Leniency controller effectively controls Q-value estimation process in MARL according to Q-value and current network conditions, and auto-encoder makes up for the defect that leniency control cannot handle complex environments and high-dimensional data. Through the parallel distributed training, the global D-TDD policy is obtained. This method deploys the MARL algorithm on the Mobile Edge Computing (MEC) server of each BS and uses the storage and computing capabilities of the server for distributed training. The simulation results show that the proposed distributed MARL converges stably in various environments, and performs better than distributed deep reinforcement algorithm.

Energy-Efficient Optimization for Energy-Harvesting-Enabled mmWave-UAV Heterogeneous Networks.

Energy Harvesting (EH) is a promising paradigm for 5G heterogeneous communication. EH-enabled Device-to-Device (D2D) communication can assist devices in overcoming the disadvantage of limited battery capacity and improving the Energy Efficiency (EE) by performing EH from ambient wireless signals. Although numerous research works have been conducted on EH-based D2D communication scenarios, the feature of EH-based D2D communication underlying Air-to-Ground (A2G) millimeter-Wave (mmWave) networks has not been fully studied. In this paper, we considered a scenario where multiple Unmanned Aerial Vehicles (UAVs) are deployed to provide energy for D2D Users (DUs) and data transmission for Cellular Users (CUs). We aimed to improve the network EE of EH-enabled D2D communications while reducing the time complexity of beam alignment for mmWave-enabled D2D Users (DUs). We considered a scenario where multiple EH-enabled DUs and CUs coexist, sharing the full mmWave frequency band and adopting high-directive beams for transmitting. To improve the network EE, we propose a joint beamwidth selection, power control, and EH time ratio optimization algorithm for DUs based on alternating optimization. We iteratively optimized one of the three variables, fixing the other two. During each iteration, we first used a game-theoretic approach to adjust the beamwidths of DUs to achieve the sub-optimal EE. Then, the problem with regard to power optimization was solved by the Dinkelbach method and Successive Convex Approximation (SCA). Finally, we performed the optimization of the EH time ratio using linear fractional programming to further increase the EE. By performing extensive simulation experiments, we validated the convergence and effectiveness of our algorithm. The results showed that our proposed algorithm outperformed the fixed beamwidth and fixed power strategy and could closely approach the performance of exhaustive search, particle swarm optimization, and the genetic algorithm, but with a much reduced time complexity.

Beam Allocation and Power Optimization for Energy-Efficiency in Multiuser mmWave Massive MIMO System.

This paper studies beam allocation and power optimization scheme to decrease the hardware cost and downlink power consumption of a multiuser millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) system. Our target is to improve energy efficiency (EE) and decrease power consumption without obvious system performance loss. To this end, we propose a beam allocation and power optimization scheme. First, the problem of beam allocation and power optimization is formulated as a multivariate mixed-integer non-linear programming problem. Second, due to the non-convexity of this problem, we decompose it into two sub-problems which are beam allocation and power optimization. Finally, the beam allocation problem is solved by using a convex optimization technique. We solve the power optimization problem in two steps. First, the non-convex problem is converted into a convex problem by using a quadratic transformation scheme. The second step implements Lagrange dual and sub-gradient methods to solve the optimization problem. Performance analysis and simulation results show that the proposed algorithm performs almost identical to the exhaustive search (ES) method, while the greedy beam allocation and suboptimal beam allocation methods are far from the ES. Furthermore, experiment results demonstrated that our proposed algorithm outperforms the compared the greedy beam allocation method and the suboptimal beam allocation scheme in terms of average service ratio.

User Experience Estimation in Multi-Service Scenario of Cellular Network.

The estimation of user experience in a wireless network has always been a research hotspot, especially for the realization of network automation. In order to solve the problem of user experience estimation in wireless networks, we propose a two-step optimization method for the selection of the kernel function and bandwidth in a naive Bayesian classifier based on kernel density estimation. This optimization method can effectively improve the accuracy of estimation. At present, research on user experience estimation in wireless networks does not include an in-depth analysis of the reasons for the decline of user experience. We established a scheme integrating user experience prediction and network fault diagnosis. Key performance indicator (KPI) data collected from an actual network were divided into five categories, which were used to estimate user experience. The results of these five estimates were counted through the voting mechanism, and the final estimation results could be obtained. At the same time, this voting mechanism can also feed back to us which KPIs lead to the reduction of user experience. In addition, this paper also puts forward the evaluation standard of the multi-service perception capability of cell-level wireless networks. We summarize the user experience estimation for three main services in a cell to obtain a cell-level user experience evaluation. The results showed that the proposed method can accurately estimate user experience and diagnosis abnormal values in a timely manner. This method can improve the efficiency of network management.

Power Control and Clustering-Based Interference Management for UAV-Assisted Networks.

Unmanned Aerial Vehicle (UAV) has been widely used in various applications of wireless network. A system of UAVs has the function of collecting data, offloading traffic for ground Base Stations (BSs) and illuminating coverage holes. However, inter-UAV interference is easily introduced because of the huge number of LoS paths in the air-to-ground channel. In this paper, we propose an interference management framework for UAV-assisted networks, consisting of two main modules: power control and UAV clustering. The power control is executed first to adjust the power levels of UAVs. We model the problem of power control for UAV networks as a non-cooperative game which is proved to be an exact potential game and the Nash equilibrium is reached. Next, to further improve system user rate, coordinated multi-point (CoMP) technique is implemented. The cooperative UAV sets are established to serve users and thus transforming the interfering links into useful links. Affinity propagation is applied to build clusters of UAVs based on the interference strength. Simulation results show that the proposed algorithm integrating power control with CoMP can effectively reduce the interference and improve system sum-rate, compared to Non-CoMP scenario. The law of cluster formation is also obtained where the average cluster size and the number of clusters are affected by inter-UAV distance.