2009-05-20

Additional charts

Host zm01.stanford.edu: Total CPU

avg(user) = 74.27    avg(sys) = 1.08    avg(idle) = 19.68    avg(iowait) = 4.69    avg(nice) = 0.00    avg(irq) = 0.02    avg(softirq) = 0.24

Host zm01.stanford.edu: Individual CPU user time

avg(cpu0) = 66.23    avg(cpu1) = 69.68    avg(cpu2) = 72.62    avg(cpu3) = 73.06    avg(cpu4) = 78.03    avg(cpu5) = 79.29    avg(cpu6) = 75.51    avg(cpu7) = 79.76

Host zm01.stanford.edu: Individual CPU nice time

avg(cpu0) = 0.00    avg(cpu1) = 0.00    avg(cpu2) = 0.00    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.00    avg(cpu7) = 0.00

Host zm01.stanford.edu: Individual CPU sys time

avg(cpu0) = 1.36    avg(cpu1) = 1.69    avg(cpu2) = 1.51    avg(cpu3) = 0.76    avg(cpu4) = 0.74    avg(cpu5) = 0.70    avg(cpu6) = 1.29    avg(cpu7) = 0.64

Host zm01.stanford.edu: Individual CPU idle time

avg(cpu0) = 28.36    avg(cpu1) = 17.96    avg(cpu2) = 16.68    avg(cpu3) = 24.07    avg(cpu4) = 18.97    avg(cpu5) = 17.90    avg(cpu6) = 15.52    avg(cpu7) = 17.97

Host zm01.stanford.edu: Individual CPU iowait time

avg(cpu0) = 3.05    avg(cpu1) = 10.35    avg(cpu2) = 8.92    avg(cpu3) = 2.02    avg(cpu4) = 2.16    avg(cpu5) = 2.02    avg(cpu6) = 7.45    avg(cpu7) = 1.55

Host zm01.stanford.edu: Individual CPU irq time

avg(cpu0) = 0.06    avg(cpu1) = 0.07    avg(cpu2) = 0.05    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.04    avg(cpu7) = 0.00

Host zm01.stanford.edu: Individual CPU softirq time

avg(cpu0) = 0.95    avg(cpu1) = 0.24    avg(cpu2) = 0.20    avg(cpu3) = 0.08    avg(cpu4) = 0.10    avg(cpu5) = 0.08    avg(cpu6) = 0.18    avg(cpu7) = 0.08

Host zm01.stanford.edu: Process CPU

avg(mailbox) = 71.72    avg(mysql) = 0.71    avg(convertd) = 0.00    avg(stats) = 0.00

Host zm01.stanford.edu: Process Total Memory

avg(mailbox) = 6277.14    avg(mysql) = 18492.41    avg(convertd) = 0.00    avg(stats) = 0.00

Host zm01.stanford.edu: Process Resident Memory

avg(mailbox) = 5597.85    avg(mysql) = 10874.17    avg(convertd) = 0.00    avg(stats) = 0.00

Host zm01.stanford.edu: Swap Activity

avg(swap in) = 0.00    avg(swap out) = 0.00

Host zm01.stanford.edu: Virtual Memory

avg(swapped) = 0.19    avg(free) = 3691.86    avg(active) = 24440.75    avg(inactive) = 3179.91    avg(page cache) = 10442.87

Host zm01.stanford.edu: Context Switches

avg(context switches) = 6747.33

Host zm01.stanford.edu: Run/Blocked Process Queue Size, Load Average

avg(processes waiting for run time) = 12.91    avg(processes waiting for io time) = 9.79    avg(load average (1 min)) = 26.55

Host zm01.stanford.edu: Disk Utilization (Top 10 avg)

avg(sdc) = 8.38    avg(sde) = 9.41    avg(sdf) = 7.54    avg(sdn) = 9.68    avg(sdo) = 7.62    avg(sdq) = 9.22    avg(sdr) = 7.70    avg(dm-0) = 26.11    avg(dm-1) = 33.30    avg(dm-2) = 14.23

Host zm01.stanford.edu: Disk Throughput: /dev/sda

avg(sda read) = 26.15    avg(sda write) = 96.08

Host zm01.stanford.edu: Disk Throughput: /dev/sdb

avg(sdb read) = 26.94    avg(sdb write) = 1.48

Host zm01.stanford.edu: Disk Throughput: /dev/sdc

avg(sdc read) = 658.93    avg(sdc write) = 136.57

Host zm01.stanford.edu: Disk Throughput: /dev/sdd

avg(sdd read) = 53.58    avg(sdd write) = 0.26

Host zm01.stanford.edu: Disk Throughput: /dev/sde

avg(sde read) = 370.77    avg(sde write) = 330.90

Host zm01.stanford.edu: Disk Throughput: /dev/sdf

avg(sdf read) = 636.33    avg(sdf write) = 136.59

Host zm01.stanford.edu: Disk Throughput: /dev/sdg

avg(sdg read) = 1.18    avg(sdg write) = 0.34

Host zm01.stanford.edu: Disk Throughput: /dev/sdh

avg(sdh read) = 5.01    avg(sdh write) = 0.14

Host zm01.stanford.edu: Disk Throughput: /dev/sdi

avg(sdi read) = 31.25    avg(sdi write) = 1.39

Host zm01.stanford.edu: Disk Throughput: /dev/sdj

avg(sdj read) = 250.64    avg(sdj write) = 663.91

Host zm01.stanford.edu: Disk Throughput: /dev/sdk

avg(sdk read) = 3.58    avg(sdk write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdl

avg(sdl read) = 0.03    avg(sdl write) = 0.79

Host zm01.stanford.edu: Disk Throughput: /dev/sdm

avg(sdm read) = 252.41    avg(sdm write) = 663.83

Host zm01.stanford.edu: Disk Throughput: /dev/sdn

avg(sdn read) = 423.28    avg(sdn write) = 330.15

Host zm01.stanford.edu: Disk Throughput: /dev/sdo

avg(sdo read) = 630.79    avg(sdo write) = 136.21

Host zm01.stanford.edu: Disk Throughput: /dev/sdp

avg(sdp read) = 4.07    avg(sdp write) = 0.27

Host zm01.stanford.edu: Disk Throughput: /dev/sdq

avg(sdq read) = 372.87    avg(sdq write) = 332.91

Host zm01.stanford.edu: Disk Throughput: /dev/sdr

avg(sdr read) = 637.10    avg(sdr write) = 136.51

Host zm01.stanford.edu: Disk Throughput: /dev/sds

avg(sds read) = 0.00    avg(sds write) = 0.14

Host zm01.stanford.edu: Disk Throughput: /dev/sdt

avg(sdt read) = 0.73    avg(sdt write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdu

avg(sdu read) = 3.18    avg(sdu write) = 0.27

Host zm01.stanford.edu: Disk Throughput: /dev/sdv

avg(sdv read) = 249.60    avg(sdv write) = 663.81

Host zm01.stanford.edu: Disk Throughput: /dev/sdw

avg(sdw read) = 3.47    avg(sdw write) = 0.05

Host zm01.stanford.edu: Disk Throughput: /dev/sdx

avg(sdx read) = 0.07    avg(sdx write) = 1.72

Host zm01.stanford.edu: Disk Throughput: /dev/sdy

avg(sdy read) = 246.18    avg(sdy write) = 663.79

Host zm01.stanford.edu: Disk Throughput: /dev/dm-0

avg(dm-0 read) = 1017.47    avg(dm-0 write) = 976.91

Host zm01.stanford.edu: Disk Throughput: /dev/dm-1

avg(dm-1 read) = 2489.45    avg(dm-1 write) = 583.39

Host zm01.stanford.edu: Disk Throughput: /dev/dm-2

avg(dm-2 read) = 1145.61    avg(dm-2 write) = 2635.46

Host zm01.stanford.edu: Disk IOPs: /dev/sda

avg(sda read) = 1.46    avg(sda write) = 3.73

Host zm01.stanford.edu: Disk IOPs: /dev/sdb

avg(sdb read) = 1.67    avg(sdb write) = 0.31

Host zm01.stanford.edu: Disk IOPs: /dev/sdc

avg(sdc read) = 26.86    avg(sdc write) = 5.98

Host zm01.stanford.edu: Disk IOPs: /dev/sdd

avg(sdd read) = 0.46    avg(sdd write) = 0.26

Host zm01.stanford.edu: Disk IOPs: /dev/sde

avg(sde read) = 14.22    avg(sde write) = 17.57

Host zm01.stanford.edu: Disk IOPs: /dev/sdf

avg(sdf read) = 26.61    avg(sdf write) = 5.76

Host zm01.stanford.edu: Disk IOPs: /dev/sdg

avg(sdg read) = 0.01    avg(sdg write) = 0.02

Host zm01.stanford.edu: Disk IOPs: /dev/sdh

avg(sdh read) = 0.04    avg(sdh write) = 0.01

Host zm01.stanford.edu: Disk IOPs: /dev/sdi

avg(sdi read) = 1.69    avg(sdi write) = 0.10

Host zm01.stanford.edu: Disk IOPs: /dev/sdj

avg(sdj read) = 2.65    avg(sdj write) = 3.40

Host zm01.stanford.edu: Disk IOPs: /dev/sdk

avg(sdk read) = 0.03    avg(sdk write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdl

avg(sdl read) = 0.00    avg(sdl write) = 0.04

Host zm01.stanford.edu: Disk IOPs: /dev/sdm

avg(sdm read) = 2.68    avg(sdm write) = 3.29

Host zm01.stanford.edu: Disk IOPs: /dev/sdn

avg(sdn read) = 14.77    avg(sdn write) = 17.48

Host zm01.stanford.edu: Disk IOPs: /dev/sdo

avg(sdo read) = 26.68    avg(sdo write) = 5.91

Host zm01.stanford.edu: Disk IOPs: /dev/sdp

avg(sdp read) = 0.03    avg(sdp write) = 0.02

Host zm01.stanford.edu: Disk IOPs: /dev/sdq

avg(sdq read) = 14.22    avg(sdq write) = 17.65

Host zm01.stanford.edu: Disk IOPs: /dev/sdr

avg(sdr read) = 26.61    avg(sdr write) = 5.82

Host zm01.stanford.edu: Disk IOPs: /dev/sds

avg(sds read) = 0.00    avg(sds write) = 0.01

Host zm01.stanford.edu: Disk IOPs: /dev/sdt

avg(sdt read) = 0.01    avg(sdt write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdu

avg(sdu read) = 0.03    avg(sdu write) = 0.02

Host zm01.stanford.edu: Disk IOPs: /dev/sdv

avg(sdv read) = 2.65    avg(sdv write) = 3.39

Host zm01.stanford.edu: Disk IOPs: /dev/sdw

avg(sdw read) = 0.03    avg(sdw write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdx

avg(sdx read) = 0.01    avg(sdx write) = 0.07

Host zm01.stanford.edu: Disk IOPs: /dev/sdy

avg(sdy read) = 2.65    avg(sdy write) = 3.28

Host zm01.stanford.edu: Disk IOPs: /dev/dm-0

avg(dm-0 read) = 38.39    avg(dm-0 write) = 180.70

Host zm01.stanford.edu: Disk IOPs: /dev/dm-1

avg(dm-1 read) = 110.08    avg(dm-1 write) = 139.74

Host zm01.stanford.edu: Disk IOPs: /dev/dm-2

avg(dm-2 read) = 15.41    avg(dm-2 write) = 658.86

Host zm01.stanford.edu: Disk Partition Throughput: /dev/sda1 mounted on /

avg(sda1 read) = 25.45    avg(sda1 write) = 86.90

Host zm01.stanford.edu: Disk Partition Throughput: /dev/sda2 mounted on /usr/vice/cache

avg(sda2 read) = 0.68    avg(sda2 write) = 9.16

Host zm01.stanford.edu: Disk Partition IOPs: /dev/sda1 mounted on /

avg(sda1 tps) = 23.19

Host zm01.stanford.edu: Disk Partition IOPs: /dev/sda2 mounted on /usr/vice/cache

avg(sda2 tps) = 2.36

Host zm01.stanford.edu: Total file descriptors open

avg(file descriptors open) = 5030.74

Host zm01.stanford.edu: SOAP: Invocation Count: Summary (Top 10 max)

max(AuthRequest) = 103.00    max(SearchConvRequest) = 77.00    max(ContactActionRequest.move) = 103.00    max(NoOpRequest) = 163.00    max(GetFolderRequest) = 75.00    max(SyncRequest) = 60.00    max(SearchRequest) = 240.00    max(GetContactsRequest) = 364.00    max(GetInfoRequest) = 84.00    max(MsgActionRequest.delete) = 63.00

Host zm01.stanford.edu: SOAP: Average Call Duration: Summary (Top 10 avg)

avg(SyncGalRequest) = 12270.94    avg(DeleteAccountRequest) = 18630.50    avg(SetAppointmentRequest) = 2345.18    avg(BackupRequest) = 2247199.50    avg(FolderActionRequest.empty) = 12606.55    avg(FolderActionRequest.sync) = 92873.00    avg(SendInviteReplyRequest) = 3516.00    avg(RestoreRequest) = 5057921.00    avg(GetQuotaUsageRequest) = 4026.00    avg(ConvActionRequest.delete) = 2554.10

Host zm01.stanford.edu: MySQL: InnoDB Buffer Pool Pages

avg(pages read) = 553046.53    avg(pages written) = 349077.52

Host zm01.stanford.edu: MySQL: InnoDB Buffer Pool Hit Rate

avg(buffer pool hit rate) = 994.05

Host zm01.stanford.edu: MySQL: Database Connections

avg(connection pool size) = 7.60    avg(threads connected) = 0.00

Host zm01.stanford.edu: MySQL: Tables Open/Opened

avg(open_tables) = 1139.00    avg(opened_tables (cumulative)) = 1252.87

Host zm01.stanford.edu: MySQL: Total Slow Queries Count

avg(slow queries (cumulative)) = 10095.76

Host zm01.stanford.edu: Mailboxd: Connection Pool Get Latency

avg(mysql) = 56.33    avg(ldap) = 93.31

Host zm01.stanford.edu: Mailboxd: Dirty Lucene Index Writers

avg(dirty index writers) = 81.77

Host zm01.stanford.edu: Mailboxd: Lucene IndexWriterCache Hitrate

avg(cache hitrate) = 42.42

Host zm01.stanford.edu: Mailboxd: Lucene IO

avg(Index writes) = 2190.61    avg(Index reads) = 5377.40

Host zm01.stanford.edu: Mailboxd: LMTP Delivery Throughput

avg(received) = 332.13    avg(delivered) = 212.68

Host zm01.stanford.edu: Mailboxd: LMTP Delivery Rate

avg(received msgs) = 1.66    avg(delivered msgs) = 1.51    avg(received x rcpts) = 1.67

Host zm01.stanford.edu: Mailboxd: Mailbox Add Rate (Delivery Rate)

avg(mailbox add rate) = 1.60

Host zm01.stanford.edu: Mailboxd: Mailbox Add Latency (Delivery Speed)

avg(mailbox add latency) = 727.98

Host zm01.stanford.edu: Mailboxd: Request Rate by Client Protocol

avg(SOAP) = 3.53    avg(IMAP) = 43.83    avg(POP) = 9.21

Host zm01.stanford.edu: Mailboxd: Response Time by Client Protocol

avg(SOAP) = 414.05    avg(IMAP) = 78.79    avg(POP) = 181.01

Host zm01.stanford.edu: Mailboxd: Active Connections by Client Protocol

avg(IMAP) = 4.80    avg(IMAP SSL) = 850.09    avg(POP) = 0.44    avg(POP SSL) = 16.86

Host zm01.stanford.edu: Mailboxd: Mailbox Get Count

avg(mailbox get count) = 2419.20

Host zm01.stanford.edu: Mailboxd: Mailbox Get Latency

avg(mailbox get latency) = 25.39

Host zm01.stanford.edu: Mailboxd: Mailbox Cache Hit Rate

avg(mailbox cache hit rate) = 99.49

Host zm01.stanford.edu: Mailboxd: Mailbox Item/Blob Cache Hit Rate

avg(msg blob cache) = 25.21    avg(item metadata cache) = 40.42

Host zm01.stanford.edu: Mailboxd: Minor Garbage Collection Time

avg(minor GC time) = 2.90

Host zm01.stanford.edu: Mailboxd: Major Garbage Collection Time

avg(major GC time) = 0.02

Host zm01.stanford.edu: Mailboxd: Minor Garbage Collection Count

avg(minor GC count) = 77.33

Host zm01.stanford.edu: Mailboxd: Major Garbage Collection Count

avg(major GC count) = 0.47

Host zm01.stanford.edu: Mailboxd: JVM Heap Used

avg(total) = 2827.49    avg(PS Old Gen) = 0.00    avg(CMS Old Gen) = 2808.22    avg(Tenured Gen) = 0.00    avg(Train Gen) = 0.00    avg(PS Eden Space) = 0.00    avg(PS Survivor Space) = 0.00    avg(Par Eden Space) = 19.27    avg(Par Survivor Space) = 0.00    avg(Eden Space) = 0.00    avg(Survivor Space) = 0.00

Host zm01.stanford.edu: Mailboxd: JVM Heap Free

avg(total free) = 1989.93    avg(PS Old Gen free) = 0.00    avg(CMS Old Gen free) = 1967.70    avg(Tenured Gen free) = 0.00    avg(Train Gen free) = 0.00    avg(PS Eden Space free) = 0.00    avg(PS Survivor Space free) = 0.00    avg(Par Eden Space free) = 22.16    avg(Par Survivor Space free) = 0.06    avg(Eden Space free) = 0.00    avg(Survivor Space free) = 0.00

Host zm01.stanford.edu: Mailboxd: JVM Permanent Generation and Code Cache

avg(PS Perm Gen) = 0.00    avg(Perm Gen) = 0.00    avg(CMS Perm Gen) = 61.03    avg(Code Cache) = 31.77    avg(Perm Gen [shared-ro]) = 0.00    avg(Perm Gen [shared-rw]) = 0.00    avg(PS Perm Gen free) = 0.00    avg(Perm Gen free) = 0.00    avg(CMS Perm Gen free) = 40.31    avg(Code Cache free) = 0.10    avg(Perm Gen [shared-ro] free) = 0.00    avg(Perm Gen [shared-rw] free) = 0.00

Summary