Cisco networkers 2009 session BRKAPP 3006 troubleshooting cisco wide area application services DDU
Bạn đang xem bản rút gọn của tài liệu. Xem và tải ngay bản đầy đủ của tài liệu tại đây (2.48 MB, 104 trang )
Troubleshooting Cisco Wide Area
Application Services
BRKAPP-3006
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
1
Data Center Building Blocks
Applications
Application Networking Services
Application Delivery and Application Optimization
Virtualization
Network, Server, Storage and Management
Transport Infrastructure
Eth, FC, DCE, WAN, MAN
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Compute Infrastructure
OS, Hardware, Firmware
Cisco Public
Storage Infrastructure
SAN, NAS, DAS
2
Application Optimization Infrastructure
Network Classification
Application Scalability
Application Networking
•
•
•
•
•
•
•
•
•
•
•
•
Quality of service
Network-based app recognition
Queuing, policing, shaping
Visibility, monitoring, control
Server load-balancing
Site selection
SSL termination and offload
Video delivery
Message transformation
Protocol transformation
Message-based security
Application visibility
WAN
Application Acceleration
WAN Acceleration
Application Optimization
•
•
•
•
•
•
•
•
•
•
•
•
Latency mitigation
Application data cache
Meta data cache
Local services
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Data redundancy elimination
Window scaling
LZ compression
Adaptive congestion avoidance
Cisco Public
Delta encoding
FlashForward optimization
Application security
Server offload
3
Agenda
Diagnostic Reports
Physical Components
Platform
Transport Optimizations
Application Acceleration
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
4
Wide Area Application Engine (WAE)
Wide Area Application Services (WAAS) Version 4.1
IOS Platform with Services and CLI
CIFS
AO
MAPI
AO
HTTP
AO
SSL
AO
Video
AO
NFS
AO
TCP Proxy with Scheduler Optimizer (SO)
DRE, LZ, TFO
EPM
WoW
Virtual Virtual
Blade Blade
#2
#3
Configuration
Management
System
(CMS)
Virtual Blades
Cisco Linux Kernel
Policy Engine, Filter-Bypass, Egress Method, Directed Mode, Auto-Discovery
Flash
IOS Shell
Linux
BRKAPP-3006_c1
Application
Storage
© 2009 Cisco Systems, Inc. All rights reserved.
Object
Storage
Cisco Public
DRE
Storage
Virtual Blade
Storage
/vbspace
Ethernet
Network
I/O
5
Diagnostic Reports
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
6
Self Diagnostic Tool
A Good Place to Start…
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
7
Self Diagnostic Tool
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
8
Device Alarms
WAE674# show alarms major
Major Alarms:
------------Alarm ID
Module/Submodule
Instance
-------------------- -------------------- -------------------1 core_dump
sysmon
core
WAE674#
WAE674# cd core_dir
WAE674# dir
size
time of last change
-------------- ------------------------0 Thu Jun 19 19:12:18 2008
1074 Thu Jun 19 19:19:11 2008
1216 Thu Jun 19 19:19:11 2008
WAE674#
name
----------core.exec_show_stats…
diagnostic_report.txt
diagnostic_report.xml
Core file causing alarm
Local copy of last diagnostic report
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
9
WAAS System Report
Help Us Help You
The WAAS system report (sysreport) contains a
compressed archive containing all relevant support
and system health information
The sysreport includes the following:
CLI command output, platform configuration and logs, platform
state information, print services configuration and logs,
authentication configuration and logs, logs for internal services
and acceleration, CMS configuration and logs, system logs, etc.
The sysreport can be generated from the WAE
Manager GUI or CLI:
WAE612# copy sysreport <disk | ftp | tftp> ...
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
10
Physical Components
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
11
Wide Area Application Engine (WAE)
Wide Area Application Services (WAAS) Version 4.1
IOS Platform with Services and CLI
CIFS
AO
MAPI
AO
HTTP
AO
SSL
AO
Video
AO
NFS
AO
TCP Proxy with Scheduler Optimizer (SO)
DRE, LZ, TFO
EPM
WoW
Virtual Virtual
Blade Blade
#2
#3
Configuration
Management
System
(CMS)
Virtual Blades
Cisco Linux Kernel
Policy Engine, Filter-Bypass, Egress Method, Directed Mode, Auto-Discovery
Flash
IOS Shell
Linux
BRKAPP-3006_c1
Application
Storage
© 2009 Cisco Systems, Inc. All rights reserved.
Object
Storage
Cisco Public
DRE
Storage
Virtual Blade
Storage
/vbspace
Ethernet
Network
I/O
12
Disk Health and Status
Online
Defunct
Missing
<null>
Rebuilding
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
13
Failed Disk Replacement
Disk failures are automatically detected by the system
Failed disks are automatically removed from service
Not present or not responding (Shutdown) (*)
Administrator can also shutdown disk for scheduled
replacement:
WAE7326(config)# disk disk-name disk01 shutdown
Device maybe busy while going offline ... please wait!
mdadm: set /dev/sdb1 faulty in /dev/md0
mdadm: set /dev/sdb2 faulty in /dev/md1
< snip >
WAE7326(config)#
RAID-1
WAE674# disk disk-name disk01 replace
Controllers found: 1
RAID-5
Command completed successfully.
WAE674#
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
14
Disk Partitions
WAE674# show disks details
RAID Physical disk information:
disk00: Online
disk01: Rebuilding
disk02: Online
J8WM2DTC
J8WMPV9C
J8WMYG6C
286102 MB
286102 MB
286102 MB
RAID Logical drive information:
Drive 1:
RAID-5 Critical
Enabled
(read-cache) Enabled (write-back)
Mounted file systems:
MOUNT POINT
TYPE
/sw
internal
/swstore
internal
/state
internal
/local/local1
SYSFS
.../local1/spool PRINTSPOOL
/obj1
CONTENT
/dre1
CONTENT
/ackq1
internal
/plz1
internal
DEVICE
/dev/sda1
/dev/sda2
/dev/sda3
/dev/sda6
/dev/data1/spool
/dev/data1/obj
/dev/data1/dre
/dev/data1/ackq
/dev/data1/plz
SIZE
991MB
991MB
7935MB
22318MB
991MB
248221MB
248221MB
991MB
2975MB
INUSE
892MB
733MB
176MB
139MB
32MB
130MB
130MB
32MB
64MB
FREE USE%
99MB 90%
258MB 73%
7759MB
2%
22179MB
0%
959MB
3%
248091MB
0%
248091MB
0%
959MB
3%
2911MB
2%
Disk encryption feature is disabled.
WAE674#
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
15
Important Directories and Log Files
The following directories are used by Cisco WAAS
for log files:
/local1—Root directory for all log files
/local1/logs—Service log files (aka “admin” logs)
/local1/errorlog—Service log files (aka “debug” logs)
/local1/core_dir—Process core dump files
File system navigation commands:
cd
pwd
dir
type-tail <filename> <lines> [| | follow]
find-pattern
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
16
Ethernet Interface Errors
WAE7341# show int gi 1/0
Type:Ethernet
Ethernet address:00:14:5E:AC:2D:79
Internet address:10.88.80.135
Broadcast address:10.88.80.255
Netmask:255.255.255.128
Verify Interface
Maximum Transfer Unit Size:1500
Metric:1
for Errors
Packets Received: 14298
Input Errors: 0
Input Packets Dropped: 0
Input Packets Overruns: 0
Input Packets Frames: 0
Packet Sent: 12946
Output Errors: 0
Output Packets Dropped: 0
Output Packets Overruns: 0
Output Packets Carrier: 0
Output Queue Length:1000
Collisions: 64
Interrupts:16
Flags:UP BROADCAST RUNNING MULTICAST
Mode: autoselect, half-duplex, 100baseTX
WAE7341#
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
Statistics
17
Ethernet Interface Speed / Duplex
WAE7341# show int gi 1/0
Type:Ethernet
Ethernet address:00:14:5E:AC:2D:79
Internet address:10.88.80.135
Broadcast address:10.88.80.255
Netmask:255.255.255.128
Maximum Transfer Unit Size:1500
Metric:1
Packets Received: 14298
Input Errors: 0
Input Packets Dropped: 0
Input Packets Overruns: 0
Input Packets Frames: 0
Verify Interface
Packet Sent: 12946
and Duplex
Output Errors: 0
Output Packets Dropped: 0
Output Packets Overruns: 0
Output Packets Carrier: 0
Output Queue Length:1000
Collisions: 64
Interrupts:16
Flags:UP BROADCAST RUNNING MULTICAST
Mode: autoselect, half-duplex, 100baseTX
WAE7341#
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
State, Speed
18
CPU Utilization (Real Time)
WAE612# show processes system count 10 delay 5
< .. >
procs -----------memory---------- ---swap-- -----io---r b
swpd
free
buff cache
si
so
bi
bo
0 0
0 772548 151944 161944
0
0
2
7
1 0
0 772628 151948 161940
0
0
0
15
0 0
0 772436 151956 161932
0
0
0
18
0 0
0 772140 151956 161932
0
0
0
8
Subtract
‘id’
Column
1 0
0 772204 151956 161932
0
0
0
6
100 to
0 0
0 772092 151956from
161932
0 Get
0
0
6
1 0
0 772300
151956 CPU
161932
0
0
0
6
Current
Utilization
0 0
0 772380 151956 161932
0
0
0
8
0 0
0 772652 151960 161996
0
0
0
6
1 0
0 772492 151964 161992
0
0
0
8
WAE612#
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
--system-- ----cpu---in
cs us sy id wa
227
185 1 1 98 0
1010 1518 1 1 98 0
1006 1401 0 0 99 0
1010 1400 1 0 98 0
1009 1421 1 0 98 0
1005 1422 0 0 99 0
1005 1413 0 0 99 0
1003 1578 1 1 98 0
1005 1349 0 0 99 0
1007 1508 0 0 99 0
19
CPU Utilization (Historical)
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
20
Platform
BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
21
Wide Area Application Engine (WAE)
Wide Area Application Services (WAAS) Version 4.1
IOS Platform with Services and CLI
CIFS
AO
MAPI
AO
HTTP
AO
SSL
AO
Video
AO
NFS
AO
TCP Proxy with Scheduler Optimizer (SO)
DRE, LZ, TFO
EPM
WoW
Virtual Virtual
Blade Blade
#2
#3
Configuration
Management
System
(CMS)
Virtual Blades
Cisco Linux Kernel
Policy Engine, Filter-Bypass, Egress Method, Directed Mode, Auto-Discovery
Flash
IOS Shell
Linux
BRKAPP-3006_c1
Application
Storage
© 2009 Cisco Systems, Inc. All rights reserved.
Object
Storage
Cisco Public
DRE
Storage
Virtual Blade
Storage
/vbspace
Ethernet
Network
I/O
22
WCCPv2 Interception
Verification (IOS)
Router# show ip wccp
Global WCCP information:
Router information:
Router Identifier:
Protocol Version:
Client = WAE
10.88.81.242
2.0
Service Identifier: 61
Number of Service Group Clients:
Number of Service Group Routers:
Total Packets s/w Redirected:
Process:
CEF:
Service mode:
Service access-list:
Total Packets Dropped Closed:
Redirect access-list:
Total Packets Denied Redirect:
Total Packets Unassigned:
Group access-list:
Total Messages Denied to Group:
Total Authentication failures:
Total Bypassed Packets Received:
--More-BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
1
1
68755
2
68753
Open
-none0
-none0
0
-none0
0
0
23
WCCPv2 Interception
Verification (IOS)
Router# show ip wccp
Global WCCP information:
Router information:
Router Identifier:
Protocol Version:
10.88.81.242
2.0
Service Identifier: 61
Number of Service Group Clients:
1
Number of Service Group Routers:
1
Total Packets s/w Redirected:
68755
Process:
2
CEF:
68753
Service mode:
Open
Service access-list:
-noneTotal Packets Dropped Closed:
0
Redirect access-list:
-noneVerify
That
Counters Are
Total Packets Denied Redirect:
0
Total Packets Unassigned:
0
Incrementing
on SoftwareGroup access-list:
-noneBased Platforms
Total Messages Denied to Group:
0
Total Authentication failures:
0
Total Bypassed Packets Received:
0
--More-BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
24
WCCPv2 Interception
Verification (IOS)
Router# show ip wccp
Global WCCP information:
Router information:
Router Identifier:
Protocol Version:
10.88.81.242
2.0
Service Identifier: 61
Number of Service Group Clients:
Number of Service Group Routers:
Total Packets s/w Redirected:
Process:
CEF:
Service mode:
Service access-list:
Total Packets Dropped Closed:
Redirect access-list:
Total Packets Denied Redirect:
Total Packets Unassigned:
Group access-list:
Total Messages Denied to Group:
Total Authentication failures:
Total Bypassed Packets Received:
--More-BRKAPP-3006_c1
© 2009 Cisco Systems, Inc. All rights reserved.
Cisco Public
Counter
Will Increment for
1
Packets
That Match
1
68755 Group but Do Not
Service
2
Match
68753 Redirect-List
Open
-none0
-none0
0
-none0
0
0
25
