Professional Documents
Culture Documents
Mathematical review
2. Mathematical review
2011/2012
1
2. Mathematical review
The norm kxk of a vector x Rn is a real valued function with the properties
p-norm
1/p
kxkp = (|x1 |p + |x2 |p + . . . + |xn |p ) , 1p<
-norm
kxk = max |xi |
i
The three most commonly used norms are kxk1 , kxk and the Euclidean norm
1/2
kxk2 = |x1 |2 + |x2 |2 + . . . + |xn |2
2
2. Mathematical review
Properties
For k.k ,k.k , with 6= there exist positive constants c1 , c2 such that
c1 kxk kxk c2 kxk , x Rn . In particular
kxk2 kxk1 n kxk2
kxk kxk2 n kxk
Holder inequality
T
1 1
x y kxkp kykq , + = 1, x, y Rn
p q
3
2. Mathematical review
kAxkp
kAkp = sup = sup kAxkp
x6=0 kxkp kxkp =1
In particular
p=1
m
X
kAk1 = max |aij |
j
i=1
(The maximum by columns)
p=2
1/
2
kAk2 = max AT A
1.
1
kAk kAk2 mkAk
n
2.
1
kAk1 kAk2 nkAk1
m
3. q
kAk2 kAk1 kAk
4.
kABkp kAkp kBkp
5
2. Mathematical review
Topological concepts in Rn
Convergence of sequences
A sequence of vectors x0 , x1 , ..., xk , ... Rn denoted by {xk }, is said to converge
to a limit vector x if
kxk xk 0
as k , which is equivalent to
Topological concepts in Rn
Sets Let S Rn
N (x, ) = {z Rn : kz xk < }
7
2. Mathematical review
Continuous functions
Differentiable functions
f (x + h) f (x)
f 0 (x) = lim
h0 h
exists. A function f : Rn Rm is said to be continuously differentiable (denoted as
fi
f C 1 ) at a point x0 if the partial derivatives x exist and are continuous at x0 for
j
1 i m, 1 j n.
8
2. Mathematical review
Jacobian Matrix
Chain rule
Let h(x) = g(f (x)) be a continuously differentiable function at x0 . Then the Jacobian
matrix is given by the chain rule
h g f
=
x x=x0
f f =f (x0 ) x x=x0
9
2. Mathematical review
10
2. Mathematical review
Mathematical review
Grownwall-Bellman Inequality
Zt
y (t) (t) + (s) y (s) ds, atb
a
then
Zt Rt
( )d
y (t) (t) + (s) (s) e s ds
a
Rt
( )d
y (t) ea
y (t) e(ta)
11