2014-10-13

Additional charts

Host zm08.stanford.edu: Total CPU

avg(user) = 3.98    avg(sys) = 0.65    avg(idle) = 92.80    avg(iowait) = 2.50    avg(nice) = 0.00    avg(irq) = 0.00    avg(softirq) = 0.07

Host zm08.stanford.edu: Individual CPU user time

avg(cpu0) = 11.18    avg(cpu1) = 10.68    avg(cpu2) = 4.85    avg(cpu3) = 4.03    avg(cpu4) = 3.09    avg(cpu5) = 2.56    avg(cpu6) = 2.26    avg(cpu7) = 1.82    avg(cpu8) = 1.66    avg(cpu9) = 1.27    avg(cpu10) = 8.01    avg(cpu11) = 1.12    avg(cpu12) = 2.98    avg(cpu13) = 3.25    avg(cpu14) = 4.37    avg(cpu15) = 4.44    avg(cpu16) = 3.98    avg(cpu17) = 3.93    avg(cpu18) = 10.91    avg(cpu19) = 2.90    avg(cpu20) = 2.64    avg(cpu21) = 1.02    avg(cpu22) = 1.84    avg(cpu23) = 0.86

Host zm08.stanford.edu: Individual CPU nice time

avg(cpu0) = 0.00    avg(cpu1) = 0.00    avg(cpu2) = 0.00    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.00    avg(cpu7) = 0.00    avg(cpu8) = 0.00    avg(cpu9) = 0.00    avg(cpu10) = 0.00    avg(cpu11) = 0.00    avg(cpu12) = 0.00    avg(cpu13) = 0.00    avg(cpu14) = 0.00    avg(cpu15) = 0.00    avg(cpu16) = 0.00    avg(cpu17) = 0.00    avg(cpu18) = 0.00    avg(cpu19) = 0.00    avg(cpu20) = 0.00    avg(cpu21) = 0.00    avg(cpu22) = 0.00    avg(cpu23) = 0.00

Host zm08.stanford.edu: Individual CPU sys time

avg(cpu0) = 1.39    avg(cpu1) = 1.42    avg(cpu2) = 0.86    avg(cpu3) = 0.77    avg(cpu4) = 0.63    avg(cpu5) = 0.56    avg(cpu6) = 0.44    avg(cpu7) = 0.38    avg(cpu8) = 0.32    avg(cpu9) = 0.26    avg(cpu10) = 0.93    avg(cpu11) = 0.21    avg(cpu12) = 0.54    avg(cpu13) = 0.60    avg(cpu14) = 0.95    avg(cpu15) = 1.00    avg(cpu16) = 0.69    avg(cpu17) = 0.80    avg(cpu18) = 0.88    avg(cpu19) = 0.52    avg(cpu20) = 0.47    avg(cpu21) = 0.24    avg(cpu22) = 0.39    avg(cpu23) = 0.21

Host zm08.stanford.edu: Individual CPU idle time

avg(cpu0) = 72.82    avg(cpu1) = 68.59    avg(cpu2) = 93.01    avg(cpu3) = 94.30    avg(cpu4) = 95.87    avg(cpu5) = 96.47    avg(cpu6) = 97.10    avg(cpu7) = 97.62    avg(cpu8) = 97.93    avg(cpu9) = 98.40    avg(cpu10) = 75.77    avg(cpu11) = 98.60    avg(cpu12) = 94.85    avg(cpu13) = 92.94    avg(cpu14) = 94.24    avg(cpu15) = 94.20    avg(cpu16) = 94.89    avg(cpu17) = 94.54    avg(cpu18) = 87.93    avg(cpu19) = 96.32    avg(cpu20) = 96.66    avg(cpu21) = 98.70    avg(cpu22) = 96.27    avg(cpu23) = 98.90

Host zm08.stanford.edu: Individual CPU iowait time

avg(cpu0) = 14.41    avg(cpu1) = 19.00    avg(cpu2) = 1.15    avg(cpu3) = 0.79    avg(cpu4) = 0.33    avg(cpu5) = 0.35    avg(cpu6) = 0.16    avg(cpu7) = 0.13    avg(cpu8) = 0.07    avg(cpu9) = 0.05    avg(cpu10) = 15.16    avg(cpu11) = 0.06    avg(cpu12) = 1.58    avg(cpu13) = 3.17    avg(cpu14) = 0.36    avg(cpu15) = 0.28    avg(cpu16) = 0.37    avg(cpu17) = 0.67    avg(cpu18) = 0.15    avg(cpu19) = 0.20    avg(cpu20) = 0.17    avg(cpu21) = 0.03    avg(cpu22) = 1.48    avg(cpu23) = 0.02

Host zm08.stanford.edu: Individual CPU irq time

avg(cpu0) = 0.00    avg(cpu1) = 0.00    avg(cpu2) = 0.00    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.00    avg(cpu7) = 0.00    avg(cpu8) = 0.00    avg(cpu9) = 0.00    avg(cpu10) = 0.00    avg(cpu11) = 0.00    avg(cpu12) = 0.00    avg(cpu13) = 0.00    avg(cpu14) = 0.00    avg(cpu15) = 0.00    avg(cpu16) = 0.00    avg(cpu17) = 0.00    avg(cpu18) = 0.00    avg(cpu19) = 0.00    avg(cpu20) = 0.00    avg(cpu21) = 0.00    avg(cpu22) = 0.00    avg(cpu23) = 0.00

Host zm08.stanford.edu: Individual CPU softirq time

avg(cpu0) = 0.19    avg(cpu1) = 0.29    avg(cpu2) = 0.11    avg(cpu3) = 0.09    avg(cpu4) = 0.07    avg(cpu5) = 0.05    avg(cpu6) = 0.03    avg(cpu7) = 0.02    avg(cpu8) = 0.02    avg(cpu9) = 0.01    avg(cpu10) = 0.11    avg(cpu11) = 0.00    avg(cpu12) = 0.03    avg(cpu13) = 0.03    avg(cpu14) = 0.07    avg(cpu15) = 0.06    avg(cpu16) = 0.06    avg(cpu17) = 0.06    avg(cpu18) = 0.11    avg(cpu19) = 0.05    avg(cpu20) = 0.05    avg(cpu21) = 0.00    avg(cpu22) = 0.01    avg(cpu23) = 0.00

Host zm08.stanford.edu: Process CPU

avg(mailbox) = 3.05    avg(mysql) = 0.62    avg(stats) = 0.00

Host zm08.stanford.edu: Process Total Memory

avg(mailbox) = 21378.64    avg(mysql) = 18139.90    avg(stats) = 0.00

Host zm08.stanford.edu: Process Resident Memory

avg(mailbox) = 8034.57    avg(mysql) = 17844.67    avg(stats) = 0.00

Host zm08.stanford.edu: Swap Activity

avg(swap in) = 0.00    avg(swap out) = 0.00

Host zm08.stanford.edu: Virtual Memory

avg(swapped) = 31.85    avg(free) = 884.38    avg(active) = 38698.65    avg(inactive) = 22875.94    avg(page cache) = 31639.47

Host zm08.stanford.edu: Context Switches

avg(context switches) = 9527.64

Host zm08.stanford.edu: Run/Blocked Process Queue Size, Load Average

avg(processes waiting for run time) = 1.62    avg(processes waiting for io time) = 0.93    avg(load average (1 min)) = 2.54

Host zm08.stanford.edu: Disk Utilization (Top 10 avg)

avg(sde) = 16.97    avg(sdf) = 11.60    avg(sdk) = 11.59    avg(sdj) = 16.97    avg(dm-0) = 4.08    avg(sdg) = 14.31    avg(dm-1) = 14.87    avg(dm-2) = 27.60    avg(sdl) = 14.29    avg(dm-3) = 19.04

Host zm08.stanford.edu: Disk Throughput: /dev/sde

avg(sde read) = 524.28    avg(sde write) = 806.23

Host zm08.stanford.edu: Disk Throughput: /dev/sdf

avg(sdf read) = 663.63    avg(sdf write) = 384.21

Host zm08.stanford.edu: Disk Throughput: /dev/sda

avg(sda read) = 0.19    avg(sda write) = 0.00

Host zm08.stanford.edu: Disk Throughput: /dev/sdk

avg(sdk read) = 663.98    avg(sdk write) = 384.67

Host zm08.stanford.edu: Disk Throughput: /dev/sdq

avg(sdq read) = 0.19    avg(sdq write) = 0.00

Host zm08.stanford.edu: Disk Throughput: /dev/sdj

avg(sdj read) = 524.34    avg(sdj write) = 804.47

Host zm08.stanford.edu: Disk Throughput: /dev/dm-0

avg(dm-0 read) = 425.69    avg(dm-0 write) = 1031.75

Host zm08.stanford.edu: Disk Throughput: /dev/sdg

avg(sdg read) = 1198.51    avg(sdg write) = 93.54

Host zm08.stanford.edu: Disk Throughput: /dev/dm-1

avg(dm-1 read) = 1327.21    avg(dm-1 write) = 768.88

Host zm08.stanford.edu: Disk Throughput: /dev/dm-2

avg(dm-2 read) = 1048.22    avg(dm-2 write) = 1610.70

Host zm08.stanford.edu: Disk Throughput: /dev/sdl

avg(sdl read) = 1198.40    avg(sdl write) = 93.91

Host zm08.stanford.edu: Disk Throughput: /dev/sdc

avg(sdc read) = 0.19    avg(sdc write) = 0.00

Host zm08.stanford.edu: Disk Throughput: /dev/sdi

avg(sdi read) = 19.29    avg(sdi write) = 31.01

Host zm08.stanford.edu: Disk Throughput: /dev/sdh

avg(sdh read) = 213.01    avg(sdh write) = 517.58

Host zm08.stanford.edu: Disk Throughput: /dev/sdb

avg(sdb read) = 0.19    avg(sdb write) = 0.00

Host zm08.stanford.edu: Disk Throughput: /dev/dm-3

avg(dm-3 read) = 2396.52    avg(dm-3 write) = 187.45

Host zm08.stanford.edu: Disk Throughput: /dev/sdm

avg(sdm read) = 213.08    avg(sdm write) = 514.17

Host zm08.stanford.edu: Disk Throughput: /dev/sdp

avg(sdp read) = 0.19    avg(sdp write) = 0.00

Host zm08.stanford.edu: Disk Throughput: /dev/sdn

avg(sdn read) = 0.19    avg(sdn write) = 0.00

Host zm08.stanford.edu: Disk Throughput: /dev/sdd

avg(sdd read) = 0.19    avg(sdd write) = 0.00

Host zm08.stanford.edu: Disk Throughput: /dev/sdo

avg(sdo read) = 0.19    avg(sdo write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/sde

avg(sde read) = 35.81    avg(sde write) = 35.25

Host zm08.stanford.edu: Disk IOPs: /dev/sdf

avg(sdf read) = 50.10    avg(sdf write) = 33.29

Host zm08.stanford.edu: Disk IOPs: /dev/sda

avg(sda read) = 0.05    avg(sda write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/sdk

avg(sdk read) = 50.10    avg(sdk write) = 33.29

Host zm08.stanford.edu: Disk IOPs: /dev/sdq

avg(sdq read) = 0.05    avg(sdq write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/sdj

avg(sdj read) = 35.81    avg(sdj write) = 35.25

Host zm08.stanford.edu: Disk IOPs: /dev/dm-0

avg(dm-0 read) = 9.44    avg(dm-0 write) = 41.07

Host zm08.stanford.edu: Disk IOPs: /dev/sdg

avg(sdg read) = 26.42    avg(sdg write) = 0.75

Host zm08.stanford.edu: Disk IOPs: /dev/dm-1

avg(dm-1 read) = 100.11    avg(dm-1 write) = 66.58

Host zm08.stanford.edu: Disk IOPs: /dev/dm-2

avg(dm-2 read) = 71.52    avg(dm-2 write) = 70.50

Host zm08.stanford.edu: Disk IOPs: /dev/sdl

avg(sdl read) = 26.42    avg(sdl write) = 0.75

Host zm08.stanford.edu: Disk IOPs: /dev/sdc

avg(sdc read) = 0.05    avg(sdc write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/sdi

avg(sdi read) = 0.76    avg(sdi write) = 1.64

Host zm08.stanford.edu: Disk IOPs: /dev/sdh

avg(sdh read) = 4.77    avg(sdh write) = 20.54

Host zm08.stanford.edu: Disk IOPs: /dev/sdb

avg(sdb read) = 0.05    avg(sdb write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/dm-3

avg(dm-3 read) = 52.73    avg(dm-3 write) = 1.50

Host zm08.stanford.edu: Disk IOPs: /dev/sdm

avg(sdm read) = 4.77    avg(sdm write) = 20.54

Host zm08.stanford.edu: Disk IOPs: /dev/sdp

avg(sdp read) = 0.05    avg(sdp write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/sdn

avg(sdn read) = 0.05    avg(sdn write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/sdd

avg(sdd read) = 0.05    avg(sdd write) = 0.00

Host zm08.stanford.edu: Disk IOPs: /dev/sdo

avg(sdo read) = 0.05    avg(sdo write) = 0.00

Host zm08.stanford.edu: Disk Usage

avg(/usr/vice/cache) = 13.00    avg(/opt/zimbra/store) = 58.54    avg(/opt/zimbra) = 61.50    avg(/opt/zimbra/hsm1) = 81.00    avg(/) = 8.00    avg(/opt/zimbra/redolog) = 16.72

Host zm08.stanford.edu: Open file descriptor count

avg(total system file descriptors open) = 7721.08    avg(mailboxd file descriptors open) = 4283.66

Host zm08.stanford.edu: Process CPU Time (Top 10 avg)

avg(tripwire) = 1991.00    avg(java) = 2204.87    avg(gzip) = 2698.97    avg(mysqld) = 451.62    avg(yum) = 183.00    avg(perl) = 40.71    avg(mysqldump) = 163.54    avg(zmmailboxd) = 2195.81    avg(horsewatcher-fe) = 48.43    avg(zmcompresslogs) = 1032.22

Host zm08.stanford.edu: SOAP: Invocation Count: Summary (Top 10 max)

max(MsgActionRequest.move) = 891.00    max(MsgActionRequest.delete) = 1785.00    max(NoOpRequest) = 390.00    max(MsgActionRequest.update) = 148.00    max(WaitSetRequest) = 244.00    max(GetFolderRequest) = 444.00    max(SyncRequest) = 411.00    max(GetEffectiveFolderPermsRequest) = 152.00    max(GetConvRequest) = 672.00    max(GetAppointmentRequest) = 1025.00

Host zm08.stanford.edu: SOAP: Average Call Duration: Summary (Top 10 avg)

avg(FolderActionRequest.sync) = 4125.00    avg(SendMsgRequest) = 377.47    avg(CounterAppointmentRequest) = 454.00    avg(BackupQueryRequest) = 426.60    avg(GetAggregateQuotaUsageOnServerRequest) = 1099.00    avg(WaitSetRequest) = 269.56    avg(FolderActionRequest.read) = 290.18    avg(SendInviteReplyRequest) = 389.04    avg(FolderActionRequest.empty) = 848.26    avg(GetQuotaUsageRequest) = 1156.00

Host zm08.stanford.edu: MySQL: InnoDB Buffer Pool Pages

avg(pages read) = 244883918.47    avg(pages written) = 96417091.13

Host zm08.stanford.edu: MySQL: InnoDB Buffer Pool Hit Rate

avg(buffer pool hit rate) = 999.19

Host zm08.stanford.edu: MySQL: Database Connections In Use

avg(connections in use) = 0.50

Host zm08.stanford.edu: MySQL: Tables Open/Opened

avg(open_tables) = 1193.15    avg(opened_tables (cumulative)) = 342161.32

Host zm08.stanford.edu: MySQL: Total Slow Queries Count

avg(slow queries (cumulative)) = 1036025.98

Host zm08.stanford.edu: Mailboxd: Connection Pool Get Latency

avg(mysql) = 0.21    avg(ldap) = 0.19

Host zm08.stanford.edu: Mailboxd: Lucene IO

avg(Index writes) = 114.92    avg(Index reads) = 478.69

Host zm08.stanford.edu: Mailboxd: LMTP Delivery Throughput

avg(received) = 146.02    avg(delivered) = 207.28

Host zm08.stanford.edu: Mailboxd: LMTP Delivery Rate

avg(received msgs) = 1.15    avg(delivered msgs) = 1.42    avg(received x rcpts) = 1.42

Host zm08.stanford.edu: Mailboxd: Mailbox Add Rate (Delivery Rate)

avg(mailbox add rate) = 3.13

Host zm08.stanford.edu: Mailboxd: Mailbox Add Latency (Delivery Speed)

avg(mailbox add latency) = 38.26

Host zm08.stanford.edu: Mailboxd: Request Rate by Client Protocol

avg(SOAP) = 15.21    avg(IMAP) = 96.65    avg(POP) = 4.61

Host zm08.stanford.edu: Mailboxd: Response Time by Client Protocol

avg(SOAP) = 229.22    avg(IMAP) = 20.59    avg(POP) = 53.49

Host zm08.stanford.edu: Mailboxd: Active Connections by Client Protocol

avg(IMAP) = 203.88    avg(IMAP SSL) = 964.13    avg(POP) = 0.02    avg(POP SSL) = 1.66    avg(SOAP sessions) = 873.78

Host zm08.stanford.edu: Mailboxd: Mailbox Get Count

avg(mailbox get count) = 6416.60

Host zm08.stanford.edu: Mailboxd: Mailbox Get Latency

avg(mailbox get latency) = 0.01

Host zm08.stanford.edu: Mailboxd: Mailbox Cache Hit Rate

avg(mailbox cache hit rate) = 99.93

Host zm08.stanford.edu: Mailboxd: Mailbox Item/Blob Cache Hit Rate

avg(msg blob cache) = 43.24    avg(item metadata cache) = 35.95

Host zm08.stanford.edu: Mailboxd: Minor Garbage Collection Time

avg(minor GC time) = 0.57

Host zm08.stanford.edu: Mailboxd: Major Garbage Collection Time

avg(major GC time) = 0.02

Host zm08.stanford.edu: Mailboxd: Minor Garbage Collection Count

avg(minor GC count) = 7.77

Host zm08.stanford.edu: Mailboxd: Major Garbage Collection Count

avg(major GC count) = 0.02

Host zm08.stanford.edu: Mailboxd: JVM Heap Used

avg(total) = 4151.37    avg(PS Old Gen) = 0.00    avg(CMS Old Gen) = 3245.50    avg(Tenured Gen) = 0.00    avg(Train Gen) = 0.00    avg(PS Eden Space) = 0.00    avg(PS Survivor Space) = 0.00    avg(Par Eden Space) = 802.05    avg(Par Survivor Space) = 103.83    avg(Eden Space) = 0.00    avg(Survivor Space) = 0.00

Host zm08.stanford.edu: Mailboxd: JVM Heap Free

avg(total free) = 3675.94    avg(PS Old Gen free) = 0.00    avg(CMS Old Gen free) = 2775.50    avg(Tenured Gen free) = 0.00    avg(Train Gen free) = 0.00    avg(PS Eden Space free) = 0.00    avg(PS Survivor Space free) = 0.00    avg(Par Eden Space free) = 803.58    avg(Par Survivor Space free) = 96.86    avg(Eden Space free) = 0.00    avg(Survivor Space free) = 0.00

Host zm08.stanford.edu: Mailboxd: JVM Permanent Generation and Code Cache

avg(PS Perm Gen) = 0.00    avg(Perm Gen) = 0.00    avg(CMS Perm Gen) = 123.94    avg(Code Cache) = 38.26    avg(Perm Gen [shared-ro]) = 0.00    avg(Perm Gen [shared-rw]) = 0.00    avg(PS Perm Gen free) = 0.00    avg(Perm Gen free) = 0.00    avg(CMS Perm Gen free) = 89.36    avg(Code Cache free) = 2.90    avg(Perm Gen [shared-ro] free) = 0.00    avg(Perm Gen [shared-rw] free) = 0.00

Host zm08.stanford.edu: convertd: CPU time used

avg(total cputime) = 0.24    avg(user time) = 0.23    avg(system time) = 0.02

Host zm08.stanford.edu: convertd: Resident Memory

avg(convertd rss) = 167.62

Host zm08.stanford.edu: convertd: Processes and Threads

avg(processes) = 6.00    avg(threads) = 6.01

No data available for the following charts:

Host zm08.stanford.edu: Disk Throughput: /dev/dm-7 Host zm08.stanford.edu: Disk Throughput: /dev/sdx Host zm08.stanford.edu: Disk Throughput: /dev/sdab Host zm08.stanford.edu: Disk Throughput: /dev/sdaa Host zm08.stanford.edu: Disk Throughput: /dev/sdt Host zm08.stanford.edu: Disk Throughput: /dev/sdad Host zm08.stanford.edu: Disk Throughput: /dev/sdag Host zm08.stanford.edu: Disk Throughput: /dev/sdr Host zm08.stanford.edu: Disk Throughput: /dev/sds Host zm08.stanford.edu: Disk Throughput: /dev/sdaf Host zm08.stanford.edu: Disk Throughput: /dev/sdy Host zm08.stanford.edu: Disk Throughput: /dev/sdv Host zm08.stanford.edu: Disk Throughput: /dev/sdac Host zm08.stanford.edu: Disk Throughput: /dev/dm-5 Host zm08.stanford.edu: Disk Throughput: /dev/dm-4 Host zm08.stanford.edu: Disk Throughput: /dev/sdw Host zm08.stanford.edu: Disk Throughput: /dev/sdae Host zm08.stanford.edu: Disk Throughput: /dev/dm-6 Host zm08.stanford.edu: Disk Throughput: /dev/sdu Host zm08.stanford.edu: Disk Throughput: /dev/sdz Host zm08.stanford.edu: Disk IOPs: /dev/dm-7 Host zm08.stanford.edu: Disk IOPs: /dev/sdx Host zm08.stanford.edu: Disk IOPs: /dev/sdab Host zm08.stanford.edu: Disk IOPs: /dev/sdaa Host zm08.stanford.edu: Disk IOPs: /dev/sdt Host zm08.stanford.edu: Disk IOPs: /dev/sdad Host zm08.stanford.edu: Disk IOPs: /dev/sdag Host zm08.stanford.edu: Disk IOPs: /dev/sdr Host zm08.stanford.edu: Disk IOPs: /dev/sds Host zm08.stanford.edu: Disk IOPs: /dev/sdaf Host zm08.stanford.edu: Disk IOPs: /dev/sdy Host zm08.stanford.edu: Disk IOPs: /dev/sdv Host zm08.stanford.edu: Disk IOPs: /dev/sdac Host zm08.stanford.edu: Disk IOPs: /dev/dm-5 Host zm08.stanford.edu: Disk IOPs: /dev/dm-4 Host zm08.stanford.edu: Disk IOPs: /dev/sdw Host zm08.stanford.edu: Disk IOPs: /dev/sdae Host zm08.stanford.edu: Disk IOPs: /dev/dm-6 Host zm08.stanford.edu: Disk IOPs: /dev/sdu Host zm08.stanford.edu: Disk IOPs: /dev/sdz Host zm08.stanford.edu: Mailboxd: Dirty Lucene Index Writers Host zm08.stanford.edu: Mailboxd: Lucene IndexWriterCache Hitrate Host zm08.stanford.edu: nginx: CPU time used Host zm08.stanford.edu: nginx: Resident Memory Host zm08.stanford.edu: nginx: Processes and Threads

Summary