You are on page 1of 7

Microsyst Technol

DOI 10.1007/s00542-016-3212-9

TECHNICAL PAPER

Mean arterial pressure control system using model predictive


control andparticle swarm optimization
TeJenSu1,3 ShihMingWang1 HongQuanVu1 JauJiJou1 CheukKwanSun2

Received: 26 October 2016 / Accepted: 16 November 2016


Springer-Verlag Berlin Heidelberg 2016

Abstract Linear controllers have been designed to regulate central venous pressure (CVP). The stable control of MAP
mean arterial pressure (MAP) in treating various cardiovas- is important in the prevention of acute life-threatening con-
cular diseases. For patients with hemodynamic fluctuations, dition such as hemorrhagic stroke and the deterioration of
the MAP control system must be able to provide more sensi- chronic hypertension-associated morbidities. Previous stud-
tive control. Therefore, in this paper, a model predictive con- ies have shown that MAP is more accurate than systolic BP,
trol (MPC) approach is presented to improve the sensitivity diastolic BP and pulse pressure in predicting future meta-
of MAP control system. The MPC principle can effectively bolic syndrome among the normotensive elderly popula-
handle the dead times in nonlinear systems, and can also tion (Hsu etal. 2015). According to that research, an MAP
optimize the system responses when subjected to constraints higher than the cutoff value indicates an elevated risk of
of process states and control signals. Besides, particle swarm developing metabolic syndrome. For the patients following
optimization (PSO) is employed to solve the optimization cardiac arrest, hypoxic-ischemic brain injury is the major
problem of MPC at each control interval. According to our cause of death (Padmanabhan etal. 2015). While an MAP
simulations, the MAP control system with combined MPC below the auto-regulatory threshold leads to additional
PSO approach is superior in control qualities to the MAP ischemia and further brain injury, an elevated MAP above
control system with conventional linear control method. The the auto-regulatory threshold causes excessive brain perfu-
MPCPSO MAP control system is possible to be realized sion that may result in increased cerebral edema and wors-
through a field-programmable gate array. ening the pre-existing brain injury (Sekhon etal. 2016).
It is, therefore, suggested that keeping the MAP within
an optimal range using the relationship between brain tis-
1Introduction sue regional saturation of oxygen and MAP is critical for
survival for this patient population (Sekhon etal. 2016).
Mean arterial pressure (MAP) is the average blood pres- Hypotensive anesthesia, which is a widely used technique
sure (BP) over a cardiac cycle and is determined by the car- aimed at reducing intraoperative bleeding and the need
diac output (CO), systemic vascular resistance (SVR) and for post-operative blood transfusions in general surgical
procedures, requires administration of multiple drugs to
regulate key physiological variables, such as the level of
* JauJi Jou unconsciousness, heart rate, mean arterial pressure (MAP),
jjjou@kuas.edu.tw respiratory rates, and other vital parameters within desired
1 limits (Jeong etal. 2016). The fast-acting vasodilating
Department ofElectronic Engineering, National Kaohsiung
University ofApplied Sciences, Sanmin District, agent, sodium nitroprusside, is often used for the induction
Kaohsiung80778, Taiwan of hypotensive anesthesia to lower blood pressure using the
2
Department ofEmergency Medicine, EDa Hospital, I-Shou recommended close-loop feedback control that involves
University, YanChao District, Kaohsiung82445, Taiwan fine tuning of the drug infusion rate according to the rate
3
Graduate Institute ofClinical Medicine, Kaohsiung Medical of pressure measurement. Under this circumstance, manual
University, Sanmin District, Kaohsiung80708, Taiwan control by clinical personnel is not preferred because it is

13
Microsyst Technol

both time-consuming and risky for patients because of the minimize the error between the predicted outputs y (t + j|t)
lack of accuracy in dosage control. and the reference w(t + j) in the range 1 j N while
Previous studies (Luginbhl etal. 2006; Zhu etal. 2008; subject to constraints of control variables. Consider the fol-
Hoeksel etal. 2001; Liu etal. 2009) have reported a num- lowing cost function and constraints:
ber of classical approaches to realize the MAP control sys-
N1

tems, and the MAP is an important clinical parameter to be  
Wy (i + 1) w(t + i + 1) 

J(t) = y(t + i + 1|t) 
kept within a narrow physiological range in the settings of
i=0
anesthesia, surgery, and critical care. To refine the conven-
Nu

tional MAP control systems, soft computing approaches
+ Wu (i)u(t + i) u(t + i 1), (1)
such as fuzzy logic, neural networks, reinforcement learn-
i=0
ing have been proposed (Furutani etal. 2004; Kumar etal.
2009; Gao and Er 2003; Lin etal. 2008; Ferreira etal.
2009; Padmanabhan etal. 2015). Some techniques of these
x(t + 1) = f (x(t), u(t)), (2)
MAP control systems rely on the use of proportional-inte-
gral-derivative (PID) controllers, for which rather complex
y(t) = g(x(t), u(t)), (3)
design methodologies are used. Using field-programma-
ble gate array (FPGA) technology, the controllers can be
umin u(t) umax (4)
realized as integrated circuits (ICs) (Snchez-Durn etal.
2012). This study tested the validity of an MAP control sys-
xmin x(t) xmax , (5)
tem based on the combination of model predictive control
(MPC) and particle swarm optimization (PSO). The control This problem is to minimize the cost function (1) with
qualities of this approach were compared with those of the constraints (25), where Wy (i), Wu (i) are the weighted
classical control approaches. coefficient matrices of outputs and control variables;
xmin , xmax are the lower bound and upper bound of state
variables; umin , umax are the lower bound and upper bound
2Model predictive control of control variables, respectively. This optimization prob-
lem is either linear or nonlinear; the constraints also are
Model predictive control, which is also known as reced- linear or nonlinear, convex or non-convex. Nature-inspired
ing horizon control or moving horizon control, bases on metaheuristic optimization methods are alternative when
the past, present, and future information of the process the optimization problems are high-dimensional, nonlinear
and environment to generate the control actions (Holkar with the complex constraints.
and Waghmare 2010). The principle of MPC is shown in The MPC algorithm is described in four steps (Holkar
Fig.1 (Holkar and Waghmare 2010). Suppose the outputs and Waghmare 2010).
reference value, w(t), is already known in the time range (t, Step 1: At the current time t , measure the current outputs
t+N) in which t is the current time and N is the predictive y(t) and the current states x(t).
horizon, a set of Nu (control horizon, Nu N ) values of Step 2: Estimate the future states x(t + j) and outputs
control variable u(t + j|t), 0 j Nu will be calculated to y(t + j)( j = 1, 2 , . . . , N ). After that, construct the cost
function and the constraints.
Step 3: Minimize the cost function and get the optimal
control sequence:
U (t) = (u0 (t), u1 (t), . . . , uN u 1 (t)).
Step 4: Apply u0 (t) to the real process. In the next sam-
pling time t = t + 1, the algorithm is repeated from Step 1.

3Particle swarm optimization

Particle swarm optimization (PSO) is a meta-heuristic opti-


mization algorithm inspired by food-seeking behaviors
of bird flockings or fish schoolings. This method, which
needs no gradient information of object function as well as
Fig.1The principle of model predictive control (MPC) its mathematical representation, is suitable for solving high

13
Microsyst Technol

dimension, non-linear and non-convex optimization prob- j j1


pi = p i
j
+ vi . (7)
lems. The standard PSO algorithm works as follows: Imag-
ine that, a flock of birds is searching for food in an area. All After updating, new positions should be checked and
of the birds do not know where exactly the food is but the modified so that they still belong to the legal range, as
sense of the distance from each one to the food. Their behav- follows:
ior is following the birds that are closest to the food. PSO
j j
mimics that strategy to solve the optimization problems. In
pi if pmin pi pmax
j j
PSO, each bird is modelled as a particle, which is a poten- pi = pmin if pi < pmin


tial solution for the problem. The distance from each bird j
pmax if pi > pmax .
to the food becomes the value of cost function (or fitness
value) at the corresponding particle. The best position of Step 4: Update pi,best and gbest as (8) and (9):
each particle found until now is called the local best particle
pj if f (pj ) < f (pj1 )
pi,best. The particle, which has optimum fitness value over- j i i i,best
all group of particles, is called the global best particle gbest.
pi,best = (8)
p j1
otherwise,
i,best
After each iteration, the position and velocity of each particle
is updated following these best particles pi,best and gbest.
pj j j
if f (pi ) < f (gbest ) for all 1 i P
The algorithm of minimizing f (x) in search space x D j i
gbest =
using PSO is presented through the following steps (Yang gj1 otherwise.
best
2010; Kennedy and Eberthart 1995):
(9)
Step 1: Randomly initialize P particles with its position p0i
Step 5: Repeat Step 2 to Step 4 until terminal conditions
and velocity vi0, the best positions pi,best and gbest as follows:
are met (usually a sufficient good fitness or a maximum
xmin p0i xmax number of iterations). Output the best particle and corre-
sponding best fitness value.
vmin vi0 vmax
p0i,best = p0i (1 i, k P)
0 4Mean arterial pressure model
gbest = {p0k |f (p0k ) = min f (p0i )}.
1iP
The relationship between drug infusion rates and the rates
Step 2: At the iteration j (1 j iterationmax), update the
of reduction in MAP is shown in the following transfer
velocity of all particles as Eq.(6).
function (de Moura Oliveira etal. 2014):
j j1 j1 j1 j1 j1
vi = j v i + c1 r1 (pi,best pi ) + c2 r2 (gbest pi ) (6) Y (s) K(1 + T3 s)e s
Gp (s) = = ,
U(s) ((1 + T3 s)(1 + T2 s) )(1 + T1 s)
in which r1 , r2 are the random numbers within [0, 1], c1 , c2
where Y is the drop in pressure, due to the drug effect, U
are the factors used to control the related weighting of the
represents the rate of drug infusion. K is the system gain;
corresponding terms, j is the parameter which control the
T1, T2, T3 represent time constants associated with the drug
dynamic of velocity, determined as:
action; is the system time delay and is the fraction of
max min recirculated drug. The parameters of the model depend
j = max j, with max ,
iterationmax directly on each specific patient. In most common cases,
min are pre - defined positive values. we can take K =2.5mmHg/ml/h, T1 =50s, T2 =10s,
T3=30s, =60s, =0.5.
The use of random variables endows the PSO with the
The clear model for controller design is written in (10):
ability of stochastic searching. After updating, the veloci-
ties of all the particles should be checked and clamped to Y (s) 5(1 + 30s)e60s
the legal range to avoid violent random walking as follows: Gp (s) = = (10)
U(s) 1 + 130s + 4600s2 + 30000s3
Figure2 plots the response of the given system with a step
j j

vi if vmin vi vmax
j j change at t=0s. The rising time Tr
= 180 s, Ts = 250 s.
vi = vmin if vi < vmin

j Fig.3 shows the Bode plot of the model. It is observed that
vmax if vi > vmax . the cutting frequency is fc
= 0.011 rad/s.
The design objectives are to control the system repre-
Step 3: Update the position of all the particles by formula sented by model (10) in order to achieve following time-
(7): domain criteria: fast response, small overshoot, and zero

13
Microsyst Technol

step response of given MAP model Step response


5 1.4

4 1.2
mmHg

3
1

2
0.8

mmHg
1
0.6
0
0 100 200 300 400 500 600
0.4
time(sec)

0.2
Fig.2The step response of the given mean arterial pressure (MAP)
system 0
0 50 100 150 200 250 300 350 400 450 500
time (sec)
steady-state error. The designed controllers should also
satisfy actuator clinical constraints such as saturation limits Fig.4The control performance of an optimized PID controller
and drug infusion rate of change.
The PID control designs for MAP are proposed by
many studies, and it worked well in most patients. For the control quality with a higher calculation cost. In this
example, Fig.4 shows the performances of an optimal design, we choose Ts = 10 s. The discrete model of the sys-
PID controller design (de Moura Oliveira etal. 2014). The tem is:
rise time of this PID control system is about 110s. How-
ever, the settling time is about 200s. For certain groups 0.1735z2 0.00075z 0.08
Gp (z) = z6 , (11)
of patients, particularly those sensitive to drugs or those z3 1.992z2 + 1.224z 0.125
with fluctuating blood pressure, the system performance
needs a significant improvement. In this design, we aim The output of the system can be calculated as:
at improving system performances by using MPCPSO
y(k) = 1.992y(k 1) 1.224y(k 2) 0.125y(k 3) + . . .
approach.
+ 0.1735u(k 7) 0.00075u(k 8) 0.08u(k 9).
(12)
5Design ofMPCPSO controller The second step is design the parameters of the MPC.
The predicted horizon N should be bigger than the input
The first design step is changing the continuous model to delay. For a small value of N, the system response is very
discrete model. The sampling frequency should be at least quick, but tends to have large overshoots. In contrast, if N
two times bigger than the cutting frequency of the system is big, the system responds slower but without overshoot-
or Ts 45 s. The higher the sampling frequency, the better ing. For the good choice of N, the simulation software is

Fig.3The Bode diagram of Bode Diagram


the given mean arterial pressure 0
Magnitude (dB)

(MAP) system System: untitled1


-20
Frequency (rad/s): 0.0114
-40 Magnitude (dB): -3

-60
-80
-100 x 104
0
Phase (deg)

-2.304

-4.608
-4 -3 -2 -1 0 1
10 10 10 10 10 10
Frequency (rad/s)

13
Microsyst Technol

Table1Parameters of PSO progress of the best fitness value


31
Parameters Values
30.8
Swarm size (P) 20 30.6
Iteration limit 40
30.4
Search space D [-2, 2]
30.2
c1 2
c2 2 30
0 5 10 15 20 25 30 35 40 45
min 0.4
iteration
max 0.9

Fig.6The typical convergence progress of the PSO algorithm

used. The control horizon is fixed at Nc = 2. The cost func-


tion becomes: MPC-PSO control system response with step input

N 1.2

ref 2
J(t) = ((y(t + i|t) y ) ) 1
i=1 0.8

mmHg
N=7
2
 N=10
+ 0.1(u(t + i) u(t + i 1))2 . (13) 0.6 N=12
N=15
i=1 0.4

0.2
The constraint for proposed controller is the limitation
of the drug infusion rate: 0
0 20 40 60 80 100 120 140 160 180 200
time (sec)
u 2 (ml/h). (14)
The implemented procedures of the proposed controller Fig.7The responses of the MPCPSO control system with a step
are described through following steps: change at input

Step 1: At the current time t, measure the current outputs


y(t) and (or observe) the current states x(t).
Step 5: In the next sampling time t+1, repeat the Step 1
Step 2: Estimate the future outputs y (t + i|t) with to Step 4.
i = 1, 2, . . . , N by (12) assuming zero initial conditions. The simulation diagram using MATLAB/SIMULINK is
After that, form the cost function (13) and the constraint shown in Fig.5.
(14).
Step 3: Minimize the cost function (13) using PSO. The
implementation procedure of PSO includes five steps 6Simulation results anddiscussions
described in Sect.3. All the parameters of PSO are listed
in Table1. After finishing, the set of global best particles, Figure 6 describes the typical convergence progress each
which is also the best solution of optimization problem, is time running PSO. Just after several iterations, the fitness
obtained: value reaches the smallest one. As the simulation time
long enough, these smallest values gradually converge
U (t) = (u0 , u1 ) to zero. It proves the strong ability of PSO in finding the
optimal solutions without requiring complex mathematical
Step 4: Only apply u0 to the real process. transformations.

Fig.5The simulation structure


of the model predictive control
particle swarm optimization

13
Microsyst Technol

MPC-PSO control signal responses with step input de Moura Oliveira etal. (2014). It also should be noticed
2
that, for all the simulated values of predicted horizon, the
Drug infusion rate (ml/h)

N=7
1.5 N=10 system always response faster than PID controllers. That is
N=12
1 N=15 the main advantages of MPC principle. With the significant
0.5 improvement in response, this control approach is prom-
0 ised for a wider range of patients.
-0.5

-1
7Conclusions
-1.5
0 20 40 60 80 100 120 140 160 180 200
time (sec) The MPCPSO approach has been used to design our
MAP control system. The results showed that the substan-
Fig.8The control signals of the MPCPSO control system with the tial delay between drug infusion and change in blood pres-
step change at input sure posed a real challenge for PID controller design in the
MAP control system. In contrast, the MPCPSO controller
effectively handled the delay and the limitation of control
Step response signal. The simulation results clearly depicted the better
1.4
MPC-PSO (N=12)
performance of the MPCPSO MAP control system com-
1.2
PID pared to that of the conventional PID MAP control system.
Further studies are needed to deal with the variation of the
1 model parameters and the disturbance from environments.
The MPCPSO MAP controller will be also able to design
0.8 as a chip through a FPGA.
mmHg

0.6

0.4 References

0.2 de Moura Oliveira PB, Dures J, Pires EJS (2014) Mean arterial pres-
sure PID control using a PSO-BOIDS algorithm. In: Advances in
0 Intelligent Systems and Computing, pp 9199
0 50 100 150 200 250 300 350 400 450 500 Ferreira A, Boston JR, Antaki JF (2009) A control system for rotary
time (sec) blood pumps based on suction detection. IEEE Trans Biomed
Eng 56:656665
Furutani E, Araki M, Kan S, Aung T, Onodera H, Imamura M, Shi-
Fig.9The step response comparison between the MPCPSO con- rakami G, Maetani S (2004) An automatic control system of the
troller and the PID controller blood pressure of patients under surgical operation. Int J Control
Autom Syst 2:3954
Gao Y, Er MJ (2003) Adaptive fuzzy neural control of mean arterial
Figures7 and 8 show the outputs and control signals of pressure through Sodium Nitroprusside infusion. In: IEEE 42nd
the designed MPCPSO control system with four different Conf. on Decision and Control, vol. 3, pp 21982203
Hoeksel SAAP, Blom JA, Jansen JRC, Maessen JG, Schreuder JJ
values of predicted horizon, N=7, 10, 12, 15. For all the (2001) Computer control versus manual control of systemic
designed cases, the magnitudes of control signal are smaller hypertension during cardiac surgery. Acta Anaesthesiol Scand
than 2, which satisfy the constraints. With N =7, both 45:553557
the output and control signal present some oscillations. Holkar KS, Waghmare LM (2010) An overview of model predictive
control. Int J Control Autom 3:4763
Because of using largest control signal, the response of Hsu CH, Chang JB, Liu IC, Lau SC, Yu SM, Hsieh CH, Lin JD,
this system is faster than the others. However, the settling Liang YJ, Pei D, Chen YL (2015) Mean arterial pressure is bet-
time is still significant. When N increases, the response gets ter at predicting future metabolic syndrome in the normoten-
slower but presenting less overshoots as observed in case of sive elderly: a prospective cohort study in Taiwan. Prev Med
72:7682
N=10, 12 and 15. When the predicted horizon is N=12, Jeong J, Portnof JE, Kalayeh M, Hardigan P (2016) Hypotensive
the overshoot is approximately zero while the settling time anesthesia: comparing the effects of different drug combinations
is smallest (about 100s). At this point, the control perfor- on mean arterial pressure, estimated blood loss, and surgery time
mance reaches climax. in orthognathic surgery. J Cranio-Maxillofac Surg 44:854858
Kennedy J, Eberthart RC (1995) Particle swarm optimization. In:
The comparison in Fig.9 clearly proves that, the control Proc IEEE Int Conf on Neural Networks, vol. 4, pp 19421948
performances of MPCPSO controller (in case of N=12) Kumar ML, Harikumar R, Vasan AK, Sudhaman VK (2009) Fuzzy
is much better than that of the optimized PID controllers in controller for automatic drug infusion in cardiac patients. In:

13
Microsyst Technol

Proc. of the International MultiConference of Engineers and Snchez-Durn JA, Oballe-Peinado , Castellanos-Ramos J, Vidal-
Computer Scientists (IMECS 2009), vol. 1, pp 1820 Verd F (2012) Hysteresis correction of tactile sensor response
Lin AY, Huang HN, Su YC, Shiu CY, Hwang JL (2008) Implemen- with a generalized PrandtlIshlinskii model. Microsyst Technol
tation of fuzzy controller for measuring instantaneous arterial 18:11271138
blood pressures via tissue control method. IET Control Theory Sekhon MS, Smielewski P, Bhate TD, Brasher PM, Foster D, Menon
Appl 2:4050 DK, Gupta AK, Czosnyka M, Henderson WR, Gin K, Wong G,
Liu GZ, Zhang YT, Wang L (2009) A robust closed-loop control algo- Griesdale DE (2016) Using the relationship between brain tis-
rithm for mean arterial blood pressure regulation. In: 2009 Sixth sue regional saturation of oxygen and mean arterial pressure to
International Workshop on Wearable and Implantable Body Sen- determine the optimal mean arterial pressure in patients follow-
sor Networks, pp 7789 ing cardiac arrest: a pilot proof-of-concept study. Resuscitation
Luginbhl M, Bieniok C, Leibundgut D, Wymann R, Gentilini A, 106:120125
Schnider TW (2006) Closed-loop control of mean arterial blood Yang XS (2010) Nature-inspired metaheuristic algorithms. Luniver,
pressure during surgery with alfentanil clinical evaluation of a Frome, United Kingdom
novel model-based predictive controller. J Am Soc Anesthesiol Zhu KY, Zheng H, Zhang DG (2008) A computerized drug delivery
105:462470 control system for regulation of blood pressure. Int J Intell Com-
Padmanabhan R, Meskin N, Haddad WM (2015) Closed-loop con- put Med Sci Image Process 2:113
trol of anesthesia and mean arterial pressure using reinforcement
learning. Biomed Signal Process Control 22:5464

13

You might also like