2009-04-10

Additional charts

Host zm01.stanford.edu: Total CPU

avg(user) = 38.46    avg(sys) = 1.58    avg(idle) = 51.39    avg(iowait) = 8.16    avg(nice) = 0.00    avg(irq) = 0.04    avg(softirq) = 0.36

Host zm01.stanford.edu: Individual CPU user time

avg(cpu0) = 40.99    avg(cpu1) = 32.50    avg(cpu2) = 35.32    avg(cpu3) = 32.36    avg(cpu4) = 38.92    avg(cpu5) = 42.90    avg(cpu6) = 39.46    avg(cpu7) = 45.21

Host zm01.stanford.edu: Individual CPU nice time

avg(cpu0) = 0.00    avg(cpu1) = 0.00    avg(cpu2) = 0.00    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.00    avg(cpu7) = 0.00

Host zm01.stanford.edu: Individual CPU sys time

avg(cpu0) = 2.17    avg(cpu1) = 2.24    avg(cpu2) = 2.00    avg(cpu3) = 1.20    avg(cpu4) = 1.02    avg(cpu5) = 1.12    avg(cpu6) = 1.76    avg(cpu7) = 1.13

Host zm01.stanford.edu: Individual CPU idle time

avg(cpu0) = 49.46    avg(cpu1) = 45.00    avg(cpu2) = 45.81    avg(cpu3) = 63.78    avg(cpu4) = 57.91    avg(cpu5) = 53.00    avg(cpu6) = 44.75    avg(cpu7) = 51.45

Host zm01.stanford.edu: Individual CPU iowait time

avg(cpu0) = 5.61    avg(cpu1) = 19.85    avg(cpu2) = 16.54    avg(cpu3) = 2.53    avg(cpu4) = 2.03    avg(cpu5) = 2.87    avg(cpu6) = 13.74    avg(cpu7) = 2.11

Host zm01.stanford.edu: Individual CPU irq time

avg(cpu0) = 0.19    avg(cpu1) = 0.09    avg(cpu2) = 0.07    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.06    avg(cpu7) = 0.00

Host zm01.stanford.edu: Individual CPU softirq time

avg(cpu0) = 1.58    avg(cpu1) = 0.31    avg(cpu2) = 0.26    avg(cpu3) = 0.13    avg(cpu4) = 0.11    avg(cpu5) = 0.10    avg(cpu6) = 0.23    avg(cpu7) = 0.09

Host zm01.stanford.edu: Process CPU

avg(mailbox) = 35.04    avg(mysql) = 0.79    avg(convertd) = 0.05    avg(stats) = 0.00

Host zm01.stanford.edu: Process Total Memory

avg(mailbox) = 6169.96    avg(mysql) = 7924.62    avg(convertd) = 652.17    avg(stats) = 0.00

Host zm01.stanford.edu: Process Resident Memory

avg(mailbox) = 5021.85    avg(mysql) = 7263.01    avg(convertd) = 156.48    avg(stats) = 0.00

Host zm01.stanford.edu: Swap Activity

avg(swap in) = 0.01    avg(swap out) = 0.00

Host zm01.stanford.edu: Virtual Memory

avg(swapped) = 18.04    avg(free) = 898.65    avg(active) = 14508.34    avg(inactive) = 816.34    avg(page cache) = 2651.72

Host zm01.stanford.edu: Context Switches

avg(context switches) = 6506.06

Host zm01.stanford.edu: Run/Blocked Process Queue Size, Load Average

avg(processes waiting for run time) = 3.91    avg(processes waiting for io time) = 2.29    avg(load average (1 min)) = 6.38

Host zm01.stanford.edu: Disk Utilization (Top 10 avg)

avg(sdc) = 13.64    avg(sde) = 13.69    avg(sdk) = 13.48    avg(sdm) = 13.47    avg(sdu) = 6.50    avg(sdx) = 6.75    avg(sdy) = 6.61    avg(dm-0) = 23.09    avg(dm-1) = 52.60    avg(dm-2) = 20.93

Host zm01.stanford.edu: Disk Throughput: /dev/sda

avg(sda read) = 29.98    avg(sda write) = 57.57

Host zm01.stanford.edu: Disk Throughput: /dev/sdb

avg(sdb read) = 267.43    avg(sdb write) = 226.90

Host zm01.stanford.edu: Disk Throughput: /dev/sdc

avg(sdc read) = 612.84    avg(sdc write) = 88.71

Host zm01.stanford.edu: Disk Throughput: /dev/sdd

avg(sdd read) = 254.04    avg(sdd write) = 220.85

Host zm01.stanford.edu: Disk Throughput: /dev/sde

avg(sde read) = 630.79    avg(sde write) = 90.87

Host zm01.stanford.edu: Disk Throughput: /dev/sdf

avg(sdf read) = 2.35    avg(sdf write) = 2.58

Host zm01.stanford.edu: Disk Throughput: /dev/sdg

avg(sdg read) = 0.00    avg(sdg write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdh

avg(sdh read) = 0.00    avg(sdh write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdi

avg(sdi read) = 0.00    avg(sdi write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdj

avg(sdj read) = 247.99    avg(sdj write) = 222.31

Host zm01.stanford.edu: Disk Throughput: /dev/sdk

avg(sdk read) = 622.47    avg(sdk write) = 85.29

Host zm01.stanford.edu: Disk Throughput: /dev/sdl

avg(sdl read) = 251.46    avg(sdl write) = 218.18

Host zm01.stanford.edu: Disk Throughput: /dev/sdm

avg(sdm read) = 616.35    avg(sdm write) = 85.68

Host zm01.stanford.edu: Disk Throughput: /dev/sdn

avg(sdn read) = 12.74    avg(sdn write) = 4.60

Host zm01.stanford.edu: Disk Throughput: /dev/sdo

avg(sdo read) = 2.81    avg(sdo write) = 2.53

Host zm01.stanford.edu: Disk Throughput: /dev/sdp

avg(sdp read) = 0.00    avg(sdp write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdq

avg(sdq read) = 12.03    avg(sdq write) = 4.48

Host zm01.stanford.edu: Disk Throughput: /dev/sdr

avg(sdr read) = 0.00    avg(sdr write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sds

avg(sds read) = 0.00    avg(sds write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdt

avg(sdt read) = 777.16    avg(sdt write) = 607.45

Host zm01.stanford.edu: Disk Throughput: /dev/sdu

avg(sdu read) = 790.13    avg(sdu write) = 607.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdv

avg(sdv read) = 0.00    avg(sdv write) = 0.00

Host zm01.stanford.edu: Disk Throughput: /dev/sdw

avg(sdw read) = 50.50    avg(sdw write) = 18.62

Host zm01.stanford.edu: Disk Throughput: /dev/sdx

avg(sdx read) = 797.78    avg(sdx write) = 617.23

Host zm01.stanford.edu: Disk Throughput: /dev/sdy

avg(sdy read) = 794.48    avg(sdy write) = 606.73

Host zm01.stanford.edu: Disk Throughput: /dev/dm-0

avg(dm-0 read) = 1011.33    avg(dm-0 write) = 885.90

Host zm01.stanford.edu: Disk Throughput: /dev/dm-1

avg(dm-1 read) = 2466.90    avg(dm-1 write) = 343.20

Host zm01.stanford.edu: Disk Throughput: /dev/dm-2

avg(dm-2 read) = 3149.37    avg(dm-2 write) = 2428.21

Host zm01.stanford.edu: Disk IOPs: /dev/sda

avg(sda read) = 2.48    avg(sda write) = 3.36

Host zm01.stanford.edu: Disk IOPs: /dev/sdb

avg(sdb read) = 11.61    avg(sdb write) = 13.50

Host zm01.stanford.edu: Disk IOPs: /dev/sdc

avg(sdc read) = 25.18    avg(sdc write) = 4.52

Host zm01.stanford.edu: Disk IOPs: /dev/sdd

avg(sdd read) = 10.77    avg(sdd write) = 13.24

Host zm01.stanford.edu: Disk IOPs: /dev/sde

avg(sde read) = 25.91    avg(sde write) = 4.64

Host zm01.stanford.edu: Disk IOPs: /dev/sdf

avg(sdf read) = 0.17    avg(sdf write) = 0.15

Host zm01.stanford.edu: Disk IOPs: /dev/sdg

avg(sdg read) = 0.00    avg(sdg write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdh

avg(sdh read) = 0.00    avg(sdh write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdi

avg(sdi read) = 0.00    avg(sdi write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdj

avg(sdj read) = 10.71    avg(sdj write) = 13.28

Host zm01.stanford.edu: Disk IOPs: /dev/sdk

avg(sdk read) = 25.22    avg(sdk write) = 4.31

Host zm01.stanford.edu: Disk IOPs: /dev/sdl

avg(sdl read) = 10.71    avg(sdl write) = 13.16

Host zm01.stanford.edu: Disk IOPs: /dev/sdm

avg(sdm read) = 25.13    avg(sdm write) = 4.29

Host zm01.stanford.edu: Disk IOPs: /dev/sdn

avg(sdn read) = 0.87    avg(sdn write) = 0.35

Host zm01.stanford.edu: Disk IOPs: /dev/sdo

avg(sdo read) = 0.18    avg(sdo write) = 0.13

Host zm01.stanford.edu: Disk IOPs: /dev/sdp

avg(sdp read) = 0.00    avg(sdp write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdq

avg(sdq read) = 0.82    avg(sdq write) = 0.36

Host zm01.stanford.edu: Disk IOPs: /dev/sdr

avg(sdr read) = 0.00    avg(sdr write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sds

avg(sds read) = 0.00    avg(sds write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdt

avg(sdt read) = 7.06    avg(sdt write) = 4.34

Host zm01.stanford.edu: Disk IOPs: /dev/sdu

avg(sdu read) = 7.18    avg(sdu write) = 4.16

Host zm01.stanford.edu: Disk IOPs: /dev/sdv

avg(sdv read) = 0.00    avg(sdv write) = 0.00

Host zm01.stanford.edu: Disk IOPs: /dev/sdw

avg(sdw read) = 3.43    avg(sdw write) = 3.37

Host zm01.stanford.edu: Disk IOPs: /dev/sdx

avg(sdx read) = 7.88    avg(sdx write) = 6.96

Host zm01.stanford.edu: Disk IOPs: /dev/sdy

avg(sdy read) = 7.25    avg(sdy write) = 4.12

Host zm01.stanford.edu: Disk IOPs: /dev/dm-0

avg(dm-0 read) = 43.96    avg(dm-0 write) = 136.73

Host zm01.stanford.edu: Disk IOPs: /dev/dm-1

avg(dm-1 read) = 103.41    avg(dm-1 write) = 85.80

Host zm01.stanford.edu: Disk IOPs: /dev/dm-2

avg(dm-2 read) = 28.75    avg(dm-2 write) = 607.05

Host zm01.stanford.edu: Disk Partition Throughput: /dev/sda1 mounted on /

avg(sda1 read) = 29.50    avg(sda1 write) = 51.70

Host zm01.stanford.edu: Disk Partition Throughput: /dev/sda2 mounted on /usr/vice/cache

avg(sda2 read) = 0.47    avg(sda2 write) = 5.86

Host zm01.stanford.edu: Disk Partition IOPs: /dev/sda1 mounted on /

avg(sda1 tps) = 15.42

Host zm01.stanford.edu: Disk Partition IOPs: /dev/sda2 mounted on /usr/vice/cache

avg(sda2 tps) = 1.51

Host zm01.stanford.edu: Total file descriptors open

avg(file descriptors open) = 6629.40

Host zm01.stanford.edu: SOAP: Invocation Count: Summary (Top 10 max)

max(SearchConvRequest) = 88.00    max(MsgActionRequest.move) = 430.00    max(MsgActionRequest.update) = 353.00    max(NoOpRequest) = 179.00    max(GetFolderRequest) = 157.00    max(SyncRequest) = 92.00    max(SearchRequest) = 102.00    max(GetInfoRequest) = 45.00    max(MsgActionRequest.delete) = 524.00    max(ConvActionRequest.trash) = 64.00

Host zm01.stanford.edu: SOAP: Average Call Duration: Summary (Top 10 avg)

avg(SyncGalRequest) = 20782.69    avg(GetFreeBusyRequest) = 2308.63    avg(BackupRequest) = 1274051.00    avg(FolderActionRequest.empty) = 18723.26    avg(ConvActionRequest.!tag) = 13365.00    avg(SendInviteReplyRequest) = 1258.68    avg(BackupQueryRequest) = 1259.80    avg(GetMiniCalRequest) = 1543.41    avg(GetQuotaUsageRequest) = 2983.00    avg(ItemActionRequest.delete) = 2734.93

Host zm01.stanford.edu: MySQL: InnoDB Buffer Pool Pages

avg(pages read) = 22151488.62    avg(pages written) = 13904467.80

Host zm01.stanford.edu: MySQL: InnoDB Buffer Pool Hit Rate

avg(buffer pool hit rate) = 998.70

Host zm01.stanford.edu: MySQL: Database Connections

avg(connection pool size) = 1.37    avg(threads connected) = 0.00

Host zm01.stanford.edu: MySQL: Tables Open/Opened

avg(open_tables) = 1175.04    avg(opened_tables (cumulative)) = 4567.31

Host zm01.stanford.edu: MySQL: Total Slow Queries Count

avg(slow queries (cumulative)) = 150982.19

Host zm01.stanford.edu: Mailboxd: Connection Pool Get Latency

avg(mysql) = 18.82    avg(ldap) = 417.85

Host zm01.stanford.edu: Mailboxd: Dirty Lucene Index Writers

avg(dirty index writers) = 74.66

Host zm01.stanford.edu: Mailboxd: Lucene IndexWriterCache Hitrate

avg(cache hitrate) = 43.32

Host zm01.stanford.edu: Mailboxd: Lucene IO

avg(Index writes) = 1513.43    avg(Index reads) = 3259.99

Host zm01.stanford.edu: Mailboxd: LMTP Delivery Throughput

avg(received) = 227.40    avg(delivered) = 125.40

Host zm01.stanford.edu: Mailboxd: LMTP Delivery Rate

avg(received msgs) = 1.58    avg(delivered msgs) = 1.24    avg(received x rcpts) = 1.58

Host zm01.stanford.edu: Mailboxd: Mailbox Add Rate (Delivery Rate)

avg(mailbox add rate) = 1.32

Host zm01.stanford.edu: Mailboxd: Mailbox Add Latency (Delivery Speed)

avg(mailbox add latency) = 299.94

Host zm01.stanford.edu: Mailboxd: Request Rate by Client Protocol

avg(SOAP) = 3.28    avg(IMAP) = 38.33    avg(POP) = 8.07

Host zm01.stanford.edu: Mailboxd: Response Time by Client Protocol

avg(SOAP) = 288.65    avg(IMAP) = 94.84    avg(POP) = 114.45

Host zm01.stanford.edu: Mailboxd: Active Connections by Client Protocol

avg(IMAP) = 7.42    avg(IMAP SSL) = 783.44    avg(POP) = 0.09    avg(POP SSL) = 10.75

Host zm01.stanford.edu: Mailboxd: Mailbox Get Count

avg(mailbox get count) = 2124.79

Host zm01.stanford.edu: Mailboxd: Mailbox Get Latency

avg(mailbox get latency) = 16.62

Host zm01.stanford.edu: Mailboxd: Mailbox Cache Hit Rate

avg(mailbox cache hit rate) = 99.57

Host zm01.stanford.edu: Mailboxd: Mailbox Item/Blob Cache Hit Rate

avg(msg blob cache) = 0.95    avg(item metadata cache) = 39.98

Host zm01.stanford.edu: Mailboxd: Minor Garbage Collection Time

avg(minor GC time) = 0.57

Host zm01.stanford.edu: Mailboxd: Major Garbage Collection Time

avg(major GC time) = 0.36

Host zm01.stanford.edu: Mailboxd: Minor Garbage Collection Count

avg(minor GC count) = 7.01

Host zm01.stanford.edu: Mailboxd: Major Garbage Collection Count

avg(major GC count) = 0.05

Host zm01.stanford.edu: Mailboxd: JVM Heap Used

avg(total) = 2790.65    avg(PS Old Gen) = 2286.92    avg(CMS Old Gen) = 0.00    avg(Tenured Gen) = 0.00    avg(Train Gen) = 0.00    avg(PS Eden Space) = 459.55    avg(PS Survivor Space) = 44.19    avg(Par Eden Space) = 0.00    avg(Par Survivor Space) = 0.00    avg(Eden Space) = 0.00    avg(Survivor Space) = 0.00

Host zm01.stanford.edu: Mailboxd: JVM Heap Free

avg(total free) = 1410.51    avg(PS Old Gen free) = 907.06    avg(CMS Old Gen free) = 0.00    avg(Tenured Gen free) = 0.00    avg(Train Gen free) = 0.00    avg(PS Eden Space free) = 461.41    avg(PS Survivor Space free) = 42.04    avg(Par Eden Space free) = 0.00    avg(Par Survivor Space free) = 0.00    avg(Eden Space free) = 0.00    avg(Survivor Space free) = 0.00

Host zm01.stanford.edu: Mailboxd: JVM Permanent Generation and Code Cache

avg(PS Perm Gen) = 74.57    avg(Perm Gen) = 0.00    avg(CMS Perm Gen) = 0.00    avg(Code Cache) = 43.40    avg(Perm Gen [shared-ro]) = 0.00    avg(Perm Gen [shared-rw]) = 0.00    avg(PS Perm Gen free) = 1.24    avg(Perm Gen free) = 0.00    avg(CMS Perm Gen free) = 0.00    avg(Code Cache free) = 3.10    avg(Perm Gen [shared-ro] free) = 0.00    avg(Perm Gen [shared-rw] free) = 0.00

Summary