PLC-Informed Distributed Game Theoretic Learning of Energy-Optimal Production Policies.

This article describes a novel concept to optimize manufacturing systems distributively through data-based learning. We propose a game-theoretic (GT) learning set-up that is incorporated with accessible control code of the programmable logic controller (PLC) to accelerate the optimal policies learning procedures, instead of learning everything from scratch. Therefore, we offer to process the accessible and available control code into a GT-based learning framework which is subsequently optimized in a fully distributed manner. To this end, we employ the recently developed framework of state-based potential games (PGs) and prove that under mild conditions PLC-informed (PLCi) learning forms a state-based PG framework. We conduct the experiment on a laboratory scale testbed in numerous production scenarios. The experiment's results highlight the major potential of using the PLCi GT-learning, which is the reduction of energy consumption of the production timescales and improvement of production efficiency while nearly halven the learning times.

Distributed Self-Optimization of Modular Production Units: A State-Based Potential Game Approach.

This article presents a novel approach for distributed optimization of production units based on potential game (PG) theory and machine learning. The core of our approach is split into two parts: the first part concentrates on the conceptual treatment of modular installed production units in terms of a PG scenario. The second part focuses on the development and incorporation of suitable learning algorithms to finally form an intelligent autonomous system. In this context, we model the production environment as a state-based PG where each actuator of each module has the role of an agent in the game aiming to maximize its utility value by learning the optimal process behavior. The benefit of the additional state information is visible in the performance of the algorithm making the environment dynamic and serving as a connector between the players. We propose a novel learning algorithm based on a global interpolation method that is applied to a laboratory scale modular bulk good system. The thorough analysis of the encouraging results yields to highly interesting insights into the learning dynamics and the process itself. The benefits of our distributed optimization approach are the plug-and-play functionality, the online capability, fast adaption to changing production requirements, and the possibility of an IEC 61131 conforming to PLC implementation.