Introduction 3G Network KPIs

06.
April 2006
Introduction to UMTS
Radio KPI
3G network planning introduce
www.huawei
www.huawei.com
.com
Huawei Northwest Africa Region

RNP Solution Manage: William.chen
William.chen@huawei.com
HUAWEI TECHNOLOGIES CO., LTD.
PDF created with pdfFactory Pro trial version www.pdffactory.com

Agenda
n UMTS Radio KPI overview

n 3G Network Optimization
n Case Study of KPI Optimization
HUAWEI TECHNOLOGIES CO., LTD. Page 2

3G KPIs Principle: S.M.A.R.T
the KPI has clear and complete definition and

Specific formula, include check point and procedure.
KPIs are measurable by given condition,

Measurable
measurement equipment and procedure.
all the KPIs should be reachable, it is refer to the

Attainable commercial network.
Relevant the KPI can show the subscriber experience
Time-bound the KPI target should be on the base of time-bound

3G KPIs : Specific
Complete KPI definition include the formula combine with the check point or
procedure.
The example: RRC Connection Successful Rate
n formula
RRCConnectionSuccessservice
RRCS_SRService = ×100%
RRCConnectionAttempt service
n Check point
The number of “RRC Connection Attempt” is A1 or

A2?
A2 represent the effective number of “RRC
Connection Attempt”.

3G KPIs : Measurable – Drive Test
n Field Test -> Drive Test Driver test route is based on

cluster, it is involved about 20
Evaluate the overall network sites in one cluster usually.
performance, usually on the network
pre-launch phase and initial stage of
commercial launch.
Test platform
Multiple test model
UEs can perform
different tests.
Data analysis
Probe & Assistant is used
for analyzing test data

3G KPIs : Measurable – Stationary test
System KPI is suggested to be
n Field Test ->stationary Test test by stationary:
Evaluate the system / equipment performance. n Throughput KPI
n Delay KPI
n Quality KPI
Core Network
Stationary test condition is fixed,
NodeB and usually used in indoor test
scenario.
RNC
NodeB Radio Network KPI test is
suggested to be test by drive test
System performance Radio Network
performance n Call drop rate
nEquipment ability
nRadio network n Handover successful rate
nTransmission
planning
nNetwork construct
nSpecial environment
n…. condition

3G KPIs : Measurable – Statistic test
n Statistic Test
Nastar
server
Monitoring & analysis

center
Recommended for security Essential

Optimization team
OM system
Pre-Condition for Statistic Test

Subscriber care center
There must be enough statistic sample, that

Terminal: ordinary PC or laptop, no distance
mean network traffic should be reach high
limitation
Local networks level.
Any corresponding dept.

Huawei KPI test platform
comprehensive analysis of the iManagerTM M2000
performance, configuration,
alarm obtaining test data
GENEX Nastar 3G op para
tim me
iza
tion ter
fil au
es to
de matic
sharing of l ive
ry
analysis results Node B
RNC
v GENEX Probe
GENEX Assistant
v AGILENT 3G Node B
v QUALCOMM HLR/AC
multiple test data
v HUAWEI RNC
Node B
RNS
R NC PSTN
GENEX Probe te
d a ta s t MSC/SSP/ PLMN
wireless test data WCDMA ISDN
VLR
Node B
RNC
GMSC/SSP
CN
GENEX U- Node B
Net
Node B RNS
network pre-planning/planning

3G KPIs: Relevant
Examples of User Experience (QoE)
completion of a End-to-end response The voice and video

download file is fast is Clare
Voice, Video Phone, MMS, WAP, Email, FTP, HTTP…

Service Performance
Radio Network KPI

AMR12.2, CS64k,PS64k/128k/384k, HSDPA/HSUPA
Accessibility Retainability Integrity Mobility Utilization Availability
Statistic / Measurement data

Huawei 3G KPIs Architecture
3G KPIs
Accessability Retainability Service Integrity Mobility Delay/Latency Availability
• Call Setup • Call Drop • PS Throughput • SHO • Call Setup Delay • Worst Cell
Success Rate Rate Success (Voice/VP) Rate
(Voice/VP) (Voice/VP) Rate
• PDP Context
• PDP Context • PDP • Hard Activation Time
Activation Context Handover
• RTT
Success Rate Drop Rate Success
Rate
• SMS/MMS
Success Rate • Inter-RAT
Handover
Success
Rate

3G KPIs: It is not only a value
3G KPI is not only a value, but a system, for example of CDR (Call Drop Rate)
Network Planning Network Construct Transmission optimization
Coverage Root cause drop-call
Hand Pilot Neighbor

over pollution cell Others
Transport 2G
problem
Interference Scramble congestionresource
Call drop
cause
59.45% 10.02% 7.29% 4.56% 0.68% 0.68% 3% 2.28% 11.94%

3G KPIs: Attainable
3G KPI is output of combination with investment include technology, HR,
cost, competition strategy etc. Cost
Huawei KPI comply principle:

n Huawei will be responsibility for every complied KPI;
Reasonable
n Cooperate with Mobilis to work out a Competitive
KPIKPI;
target
n Use the experience from other commercial network;
Competition
Attainable Common target for Mobilis and Huawei Technical

3G KPIs: Time-bound
nMature Network
100
ü Drive Test KPIs

100
90
90
nOngoing Optimization
80
80
70
70
60
60
50
ü Stationary test KPIs

4050
3040
2030
1020
010
0
0
3
ü Network Statistics
6
9
12
0
15
3
18
6
21
9
24
12
27
15
30
18
33
21
36
24
27
39
42
30
33
45
48
Number of Sites
36
39
42
45
48
Number of Sites
ü Network Statistics
nCommercial Launch ü Benchmark test
Nastar
Probe & Assistant
Probe & Assistant
Ea
lif c h K
n Pre-Launch ed P
Probe & Assistant ur I h
KPI Acceptance at a s
io
n
ü Drive Test KPIs

ü Stationary test KPIs
nNetwork construct
ü Site verification

Recommend test methodology
Test Methodology Pre-launch Acceptance On-going Optimization
RRC connection success rate Drive Test -
Call setup success rate Drive Test Statistic Test
PDP activation success rate Drive Test Statistic Test
CS Call drop rate Drive Test Statistic Test
PS Call drop rate Drive Test Statistic Test
CS Call complete rate - Statistic Test
PS Call Complete rate - Statistic Test
HSPA Call drop rate Stationary Stationary
R99 PS Throughput Stationary Stationary
HSPA Throughput Stationary Stationary
Soft handover success rate Drive Test Statistic Test
Inter-RAT handover success Drive Test Statistic Test

rate

Contents
• UMTS Radio KPI overview

• 3G Radio Network Optimization
• Case Study of KPI Optimization

Optimization throughout Life Cycle
Subs. Number
Drop call • RF adjustment
Congestion • Para. adjustment

• Maintenance and upgrade
Poor quality
• Contingency planning
Access failure
Pre-launch optimization • Network expansion
tio is
……
• …….
s
n
es nal y
olu
a
an lem
Customized and
dr
differentiated
ob
services
Pr
Single site verification
Billing strategies
Investment Return
RF plan review DT & CQT KPI Complaints

analysis
Construction
phase Commercia Booming phase Mature phase Time
l launch Optimizing Balancing
Troubleshooting

Network Optimization Phases
Optimization
preparation
RF optimization
New site integrated Service test and

parameter optimization
Routine drive test and

Single site verification stats. analysis
Acceptance criteria
N satisfied?
80％ sites in the Y
Y
N cluster ready?
Acceptance

RF Optimization Target
n To optimize coverage
n To minimize pilot pollution
n To optimize cell dominance
n To optimize neighbor cell list
n To resolve RF-related drop calls

RF Parameters Optimization
n Engineering parameters adjustment

To adjust antenna down tilt
To adjust antenna azimuth
To adjust antenna location
To adjust antenna height
To replace antenna
To replace site
To add new cell
n Radio part parameters adjustment

To optimize neighbor cell list

Pilot Pollution Minimization
Pilot pollution definition:
n SHO candidates (A) Pilot pollution will result in:
(1) low signal quality
n Active set size (B)
(2) decreased system
n If A>B, pilot pollution exists capacity
(3) Call drops easier
-60
-65 Margin
-70
RSCP (dBm)
Ways to optimize:
-75 (1) Antenna adjustment
-62
-64 -66 (e.g. azimuth or down tilt)
-68 -69
-80
(2) Pilot power optimization
-85 -81
-90
SC1 SC2 SC3 SC4 SC5 SC6
Not
Active Set Pilot Pollution
Pilot Pollution

Pilot Pollution: Example

RF-related Drop Calls
Problems Appearance
n Poor coverage Poor RSCP & Ec/Io
n High interference Poor Ec/Io or RTWP
n Poor UL coverage UE max Tx power
n Poor dominance many SHO events
n Pilot pollution many cells present
n Missing neighbors
Fast change of RF conditions usually

causes drop calls, e.g. turning a corner.

Para. Optimization Target
n To reduce access failures Para. optimization

is an important step
after RF optimization
n To reduce drop calls
n To enhance service quality
Service quality and network resources

utilization will be improved after para.
optimization

Parameters to be Optimized
n CCCH power allocation para.
n RL maximum power para.

Seldom
n Cell re-selection para. adjusted
n Intra-freq. handover para.

An effective way to
n Inter-RAT handover para. reduce drop calls
n Power control para.
n Access power para. The influence caused by the

cell parameters adjustment
n Other related para. should be analyzed carefully.

Intra-freq. Re-selection Para.
Optimize Treselection, Qhysts and Sintrasearch so as to
have minimum ping-pong and minimum camped onto
wrong cell
The black dotted line

Qhyst2 CPICH_Ec/Io is the serving cells.
CPICH_Ec/Io
Qhyst2
Qhyst2
Qhyst2
Qhyst2
The black dotted line

UE doesn’t camp is the serving cells.
onto the best cells. Sintrasearch
UE doesn’t camp
onto the best cells.
Qqualmin
Qqualmin
Treselection Treselection
Treselection Treselection
Treselection Treselection Time
Treselection, Qhyst2, Sintrasearch = 0 Treselection, Qhyst2, Sintrasearch != 0

Contents
• UMTS Radio KPI overview

• 3G Radio Network Optimization
• Case Study of KPI Optimization

Case study from commercial projects
• Example of Accessibility KPI analysis

• Example of Call Drop KPI issue & solution
• Example of Throughput KPI issue analysis

Example of accessibility KPIs issue
Trouble-shooting of RRC
setup and RAB assignment Breakdown of CS RAB failure (Counters)
problems:
VS.RAB.FailEstCS.I VS.RAB.FailEstabCS. VS.RAB.FailEstPS.
• STEP1: Identify the counter with the UB.Band Other.Cell RIPFail
highest number
• STEP2: Identify the Top 10 cells with
Breakdown of CS RRC failure (Counters)
the same problem
VS.RRC.Rej.R VS.RRC.Rej.Cod VS.RRC.Rej.UL.C RRC.FailConnEstab.

Definition of Counters L.Fail e.Cong E.Cong NoReply
l VS.RAB.FailEstPs.IUB.Band: The number of
RABs unsuccessfully established in a cell due
to IUB resource congestion causes. • VS.RAB.FailEstabCS.Other.Cell: • VS.RRC.Rej.UL.CE.Cong: RRC
Pre-admission control module reports setup failure due to lack of UL CE
a resource congestion. resources

Analysis
The “worst” sites (cells) that have been found to have both IUB and CE
congestion issues:
n0109TO (cell id 578/579/580)

n0111TO (3882/3883/3884)
n0070TO (18641/18642/18643)
NodeB UL CE Occupation Rate

Name
2007-02-19 2007-02-20 2007-02-21 2007-02-22
0070TO 120.83% 132.29% 132.29% 171.88%
0109TO 142.71% 175.00% 175.00% 180.21%
0111TO 158.33% 132.29% 132.29% 148.96%

Suggested solution
A comparative analysis shows that, if excluding the problematic sites,
the KPI would improve substantially, say, AMR RAB assignment success
rate from 97.79% to 98.09%:
KPIs (including IUB KPIs (without IUB
Congestion sites) Congestion sites)
RRC Connection Setup Success

99.17%(313992/316615) 99.35%(256449/258126)
Rate (CS)(>98%)
AMR RAB Assignment Success

97.79%(294499/301169)
Suggested action plan:
98.09%(241127/245815)
Rate(>98%)
• CE/IUB expansion
Video Call RAB Assignment
98.31%(3314/3371) 98.67%(2891/2930) • Perform regular neighbour list
Success Rate(>98%)
check to further tune the
PS64 RAB Assignment Success
84.93%(2462/2899) 83.10%(1981/2384)
performance
Rate(>97%)
PS128 RAB Assignment

98.48%(16674/16932) 98.80%(13638/13803)
Success Rate(>97%)
PS384 RAB Assignment

97.53%(58114/59584) 97.81%(48854/49946)
Success Rate(>97%)


• Example of Throughput KPI issue analysis

Example of Call drop rate issues
Drop Call Rate Voice(3G)
AMR12.2 Call Drop Rate Drop Call Rate Video(3G)
Drop Call Rate (2G)
3.5%
3.0%
Voice call drop rate
2.5% changes over a three-
2.0% month optimization
1.5% period
1.0%
0.5%
0.0%
2006-01-16
2006-01-18
2006-01-20
2006-01-22
2006-01-24
2006-01-26
2006-01-28
2006-01-30
2006-02-01
2006-02-03
2006-02-05
2006-02-07
2006-02-09
2006-02-11
2006-02-13
2006-02-15
2006-02-17
2006-02-19
2006-02-21
2006-02-23
2006-02-25
2006-02-27
2006-03-01
2006-03-03
2006-03-05
2006-03-07
2006-03-09
2006-03-11
2006-03-13
2006-03-15
2006-03-17
2006-03-19
Zone1 Zone2
Solving Voice call drop Zone3
rate problems in Top 3
zones

What measures were taken to solve
the call drop problems?
Zone Action time Call drop rate Optimization measures

reduction
Zone 1 Feb. 14-17 1.57%->1.27% ü Scrambling code planning
adjustment
ü System/handover
Zone 2 Feb. 23-25 1.38%->1.21%
parameter tuning
ü Neighbour list optimization
ü RF optimization, etc.
Zone 3 Mar.2-6 1.34%->1.10%


• Example of Throughput issue analysis

Example of throughput KPI issues
45 Huawei sites
provide coverage
for DT route
(Madrid South
East)
Group Service Target Valid calls Successful KPI

I/B PS
FTP application UL > 300 kbps 118 (UL) 118 (UL) 319 (UL)
UL:384
throughput DL > 361 kbps 87 (DL) 87 (DL) 293 (DL)
DL:384
Minimum application
HSDPA > 384 Kbit/s 87 87 280
throughput DL

Analysis: coverage problems
RNC 123
RNC 122
Areas that lack

dominant pilot
Drive test route

involves 3 Huawei
RNCs and 1 Nortel
RNC
RNC 121

The impact of missing neighbours
• DL R99 throughput has been impacted by the interference generated by missing
neighbors, mostly concerning the new sites that had been recently put on air
• Areas with low throughput corresponds to bad Ec/Io figures and HHO to 2G
Low throughput
UE handover to GSM

Other causes
In addition to coverage and missing neighbour causes, the HSDPA
minimum throughput problem is due to:
• DT route crosses the IUR area where HSDPA calls are reconfigured to DCH
(H2D)
• UE moves from a non-hotspot to a hotspot site in HSDPA connected mode
RNC 122
RNC 123 RNC 122
RNC 123
RNC 121 RNC 121

06.April 2006
Thank You
www.huawei.com
www.huawei
.com
HUAWEI TECHNOLOGIES CO., LTD.

Introduction 3G Network KPIs

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Introduction 3G Network KPIs

Uploaded by

Copyright:

Available Formats

06.

Huawei Northwest Africa Region

HUAWEI TECHNOLOGIES CO., LTD.

PDF created with pdfFactory Pro trial version www.pdffactory.com

n UMTS Radio KPI overview

HUAWEI TECHNOLOGIES CO., LTD. Page 2

PDF created with pdfFactory Pro trial version www.pdffactory.com

the KPI has clear and complete definition and

KPIs are measurable by given condition,

all the KPIs should be reachable, it is refer to the

Relevant the KPI can show the subscriber experience

Time-bound the KPI target should be on the base of time-bound

HUAWEI TECHNOLOGIES CO., LTD. Page 3

PDF created with pdfFactory Pro trial version www.pdffactory.com

The example: RRC Connection Successful Rate

The number of “RRC Connection Attempt” is A1 or

HUAWEI TECHNOLOGIES CO., LTD. Page 4

PDF created with pdfFactory Pro trial version www.pdffactory.com

n Field Test -> Drive Test Driver test route is based on

HUAWEI TECHNOLOGIES CO., LTD. Page 5

PDF created with pdfFactory Pro trial version www.pdffactory.com

HUAWEI TECHNOLOGIES CO., LTD. Page 6

PDF created with pdfFactory Pro trial version www.pdffactory.com

Monitoring & analysis

Recommended for security Essential

Pre-Condition for Statistic Test

There must be enough statistic sample, that

HUAWEI TECHNOLOGIES CO., LTD. Page 7

PDF created with pdfFactory Pro trial version www.pdffactory.com

HUAWEI TECHNOLOGIES CO., LTD. Page 8

PDF created with pdfFactory Pro trial version www.pdffactory.com

completion of a End-to-end response The voice and video

Voice, Video Phone, MMS, WAP, Email, FTP, HTTP…

Radio Network KPI

Accessibility Retainability Integrity Mobility Utilization Availability

Statistic / Measurement data

HUAWEI TECHNOLOGIES CO., LTD. Page 9

PDF created with pdfFactory Pro trial version www.pdffactory.com

Accessability Retainability Service Integrity Mobility Delay/Latency Availability

HUAWEI TECHNOLOGIES CO., LTD. Page 10

PDF created with pdfFactory Pro trial version www.pdffactory.com

Network Planning Network Construct Transmission optimization

Coverage Root cause drop-call

Hand Pilot Neighbor

HUAWEI TECHNOLOGIES CO., LTD. Page 11

PDF created with pdfFactory Pro trial version www.pdffactory.com

Huawei KPI comply principle:

Attainable Common target for Mobilis and Huawei Technical

HUAWEI TECHNOLOGIES CO., LTD. Page 12

PDF created with pdfFactory Pro trial version www.pdffactory.com

ü Drive Test KPIs

ü Stationary test KPIs

ü Drive Test KPIs

HUAWEI TECHNOLOGIES CO., LTD. Page 13

PDF created with pdfFactory Pro trial version www.pdffactory.com

Call setup success rate Drive Test Statistic Test

PDP activation success rate Drive Test Statistic Test

CS Call drop rate Drive Test Statistic Test

PS Call drop rate Drive Test Statistic Test

CS Call complete rate - Statistic Test

PS Call Complete rate - Statistic Test

HSPA Call drop rate Stationary Stationary

R99 PS Throughput Stationary Stationary

HSPA Throughput Stationary Stationary