Distributed MPC for large scale systems using agent-based reinforcement learning
Document typeConference report
Rights accessOpen Access
In the present work, distributed control and artificial intelligence are combined in a control architecture for Large Scale Systems (LSS). The aim of this architecture is to provide a general structure and methodology to perform optimal control in networked distributed environments where multiple dependencies between sub-systems are found. Often these dependencies or connections represent control variables so the distributed control has to be consistent for both subsystems and the optimal value of these variables has to accomplish a common goal. The aim of the research described in this paper is to exploit the attractive features of MPC (meaningful objective functions and constraints) in a distributed implementation combining learning techniques to perform the negotiation of these variables in a cooperative Multi Agent environment and over a Multi Agent platform to provide speed, scalability, and computational effort reduction. This approach is based on negotiation, cooperation and learning. Results of the application of this architecture to a small drinking water network show that the resulting trajectories of the levels in tanks (control variables) can be acceptable compared to the centralized solution. The application to a real network (the Barcelona case) is currently under development.
- SAC - Sistemes Avançats de Control - Ponències/Comunicacions de congressos 
- Institut de Robòtica i Informàtica Industrial, CSIC-UPC - Ponències/Comunicacions de congressos 
- Departament d'Enginyeria de Sistemes, Automàtica i Informàtica Industrial - Ponències/Comunicacions de congressos 
Showing items related by title, author, creator and subject.
The effect of the choice of the control variables of the water level control of open channels: comparison of control schemes using the ASCE Test canal 2 Horvath, Klaudia; Gómez Valentín, Manuel; Rodellar Benedé, José (Institute of Electrical and Electronics Engineers (IEEE), 2013)
Restricted access - publisher's policyThe effect of the choice of the control action variables on centralized water level controllers for open channels is analyzed. Three models are compared. In the first model the control action variable is the discharge and ...
On the parametrization of the controllability pairs of a controllable subspaces of a controllable pair Puerta Sales, Ferran; Puerta Coll, Xavier; Zaballa, Ion (2004)
Open AccessGiven a controllable linear control system defined by a pair of constant matrices (A,B), the set of controllability subspaces is a stratified submanifold of the set of (A,B)-invariant subspaces. We parametrize each strata ...
Minimizing control cost in resource-constrained control systems: from Feedback scheduling to event-driven control Lozoya, Camilo; Martí Colom, Pau; Velasco García, Manel (IEEE Press. Institute of Electrical and Electronics Engineers, 2010)
Open AccessThis paper evaluates approaches aimed at minimizing aggregated control cost of a set of controllers that concurrently execute sharing limited computing resources. The evaluation focuses on feedback scheduling and event-driven ...