How To Embed Your Kpis.ppt

How to embed your KPIs in Actix
For benchmarking, cluster acceptance, site acceptance
and more

presenter Jim May


How does customer experience translate
to Network KPIs?
Availability KPIs:
Attach set up time
Attach success rate
Detach success rate
Mobility KPIs:
LAU and RAU set up time
LAU and RAU success rate
Cell reselection time
Accessibility KPIs:
PdP Context set up time
PdP Context success rate
DNS and application server access
. . . and many others


How does customer experience translate
to Application KPIs?

Other common indicators:
DNS Lookup Time, TCP Packet Loss, Retransmission and Duplication,
TCP RTT, TCP Connect and Session Completion Rate

Without Actix . . .

The traditional reporting process
Complicated
Time-consuming
Labour-intensive
Repetitive
Error-prone


With Actix KPIs . . .

From complexity to simplicity

Replace a series of complex
steps with a single, automated
process
Radio performance as well as
data services performance
Standardise the process so that
every engineer/vendor/region
works to same benchmark
Easily configure the process to
reflect your business priorities

Start

Implement
Implement

changes
changes

Drive test

Actix Cluster Acceptance
KPI reports

Automated
Troubleshoot
diagnostic aids

Performance
maps

Target met?

Actix
Troubleshooter

No

Yes

Done! Send reports!


Actix’ reporting process

Actix in action

Complex process executed in just a couple of clicks:

Configurable service-performance KPIs
Built-in data service testing
Cluster-wide analysis
Demographic-based reporting
Configurable KPI grooming
Create, embed and standardise your process


Actix in Action

Configurable KPIs to keep
you in control
Cluster Acceptance Details
Engineer

Date

Service performance
Network performance
Your business priorities
Vendor commitments

CS Domain

PS Domain
Target

Pass/Fail

Value

Metric

Overall Call Success Rate (End to End)

95%

Fail

78.2%

Overall PS Success Rate (End to End)

95%

Dropped Rate

2.5%

Fail

6.2%

Dropped Rate

2.5%

Metric

Call Setup Duration (secs)

8

Pass

3.9

Metric

Target

Pass/Fail

Value

Good Eclo – Good RSCP

95%

Pass

91.0%

Target

-15

Pass/Fail

(dB)

95% Percentile of Eclo

-15

Pass

-12.5

Good EcIo
Poor RSCP

95% Percentile of RSCP

-95

Fail

-99

91.0%

Single Server Percentage

80%

Fail

66.7%

-95

7.8%

Pilot Pollution (Location)

5%

Fail

5.2%

(dB)

0.9%

0.4%

Poor EcIo
Poor RSCP

Poor EcIo
Good RSCP

File Overview
Number of files loaded

1

Combined file size (MB)

18.4

Value

Good EcIo
Good RSCP
EcIo

RSCP

EcIo Analysis
16.7%

CS Call Analysis

PS Call Analysis

16.7%

14.0%

100.0%
90.0%
80.0%
70.0%
60.0%
50.0%

40.0%
30.0%
20.0%
10.0%
0.0%

12.0%
10.0%
8.0%
6.0%
4.0%
2.0%
83.3%

83.3%
Call Setup Successful

Call Setup Failure

0.0%

-29
-28
-27
-26
-25
-24
-23
-22
-21

-20
-19
-18
-17
-16
-15
-14
-13
-12
-11
-10
-9
-8
-7
-6
-5
-4
-3
-2
-1
0

Configure KPIs to reflect:

Comments

Cluster Details

Call Setup Successful

Call Setup Failure

EcIo PDF

EcIo CDF


Actix in Action

Fast and efficient data-service testing
“UMTS is about data as well as voice services – it is
critical to have a comprehensive understanding of
the subscriber experience.”

Measure delay, throughput, FTP, HTTP
Provides accurate picture of what’s going on
Automated and standardised
All services and KPIs built into single test
Comprehensive results for entire network


Actix in Action

Cluster-wide analysis for the true picture

Wide area support ensures
one KPI report reflects
entire cluster performance
Configurable filtering of
cluster boundaries for valid

data collection and easy
management
01
02
0403


Actix in Action

Test against demographic plans

Generate demographic-based
KPIs for matching planned
coverage targets
Configure KPI targets for
different demographic areas
e.g. indoor, suburban, rural
RxPwr
RxPwr
RxPwr


Actix in Action

Generate meaningful statistics using
configurable KPI grooming
Faulty logging causes
systematic fault

attached

Remove anomalies that are not cluster related:

Compensate for handset problems
Compensate for network faults
Eliminate outlying data (bottom x% etc)
Eliminate pre-defined locations where
coverage is not required

detached


Actix in Action

Standardise your process

Capture and embed your
unique processes and KPIs
Integrate into your existing
system using either:
 Your own experts
 Actix engineering services
 Or both

Establish consistency
throughout your organisation


Actix KPI reporting
For benchmarking, cluster acceptance, site acceptance

and more…









Highly configured, decisive KPIs means better decisions
Streamlined, efficient process configured to your business
needs
Generate KPI reports in minutes not days
Best-practice process as standard for every engineer, every
vendor, and every region
Reduces process-training and process-management costs