Reinforcement learning-based adaptive beam alignment in a photodiode-integrated array antenna module.

We successfully demonstrated an intelligent adaptive beam alignment scheme using a reinforcement learning (RL) algorithm integrated with an 8 × 8 photonic array antenna operating in the 40 GHz millimeter wave (MMW) band. In our proposed scheme, the three key elements of RL: state, action, and reward, are represented as the phase values in the photonic array antenna, phase changes with specified steps, and an obtained error vector magnitude (EVM) value, respectively. Furthermore, thanks to the Q-table, the RL agent can effectively choose the most suitable action based on its prior experiences. As a result, the proposed scheme autonomously achieves the best EVM performance by determining the optimal phase. In this Letter, we verify the capability of the proposed scheme in single- and multiple-user scenarios and experimentally demonstrate the performance of beam alignment to the user's location optimized by the RL algorithm. The achieved results always meet the signal quality requirement specified by the 3rd Generation Partnership Project (3GPP) criterion for 64-QAM orthogonal frequency division multiplexing (OFDM).

Characterization of In-Body to On-Body Wireless Radio Frequency Link for Upper Limb Prostheses.

Wireless implanted devices can be used to interface patients with disabilities with the aim of restoring impaired motor functions. Implanted devices that record and transmit electromyographic (EMG) signals have been applied for the control of active prostheses. This simulation study investigates the propagation losses and the absorption rate of a wireless radio frequency link for in-to-on body communication in the medical implant communication service (MICS) frequency band to control myoelectric upper limb prostheses. The implanted antenna is selected and a suitable external antenna is designed. The characterization of both antennas is done by numerical simulations. A heterogeneous 3D body model and a 3D electromagnetic solver have been used to model the path loss and to characterize the specific absorption rate (SAR). The path loss parameters were extracted and the SAR was characterized, verifying the compliance with the guideline limits. The path loss model has been also used for a preliminary link budget analysis to determine the feasibility of such system compliant with the IEEE 802.15.6 standard. The resulting link margin of 11 dB confirms the feasibility of the system proposed.

Wireless radio channel for intramuscular electrode implants in the control of upper limb prostheses.

In the last few years the use of implanted devices has been considered also in the field of myoelectric hand prostheses. Wireless implanted EMG (Electromyogram) sensors can improve the functioning of the prosthesis, providing information without the disadvantage of the wires, and the usability by amputees. The solutions proposed in the literature are based on proprietary communication protocols between the implanted devices and the prosthesis controller, using frequency bands that are already assigned to other purposes. This study proposes the use of a standard communication protocol (IEEE 802.15.6), specific for wireless body area networks (WBANs), which assign a specific bandwidth to implanted devices. The propagation losses from in-to-on body were investigated by numerical simulation with a 3D human model and an electromagnetic solver. The channel model resulting from the study represents the first step towards the development of myoelectric prosthetic hands which are driven by signals acquired by implanted sensors. However these results can provide important information to researchers for further developments, and manufacturers, which can decrease the production costs for hand prostheses having a common standard of communication with assigned frequencies of operation.