2009-12-04

Additional charts

Host zm03.stanford.edu: Total CPU

avg(user) = 11.53    avg(sys) = 1.38    avg(idle) = 78.94    avg(iowait) = 7.67    avg(nice) = 0.00    avg(irq) = 0.04    avg(softirq) = 0.44

Host zm03.stanford.edu: Individual CPU user time

avg(cpu0) = 26.05    avg(cpu1) = 11.31    avg(cpu2) = 10.00    avg(cpu3) = 8.96    avg(cpu4) = 7.38    avg(cpu5) = 8.64    avg(cpu6) = 10.46    avg(cpu7) = 9.43

Host zm03.stanford.edu: Individual CPU nice time

avg(cpu0) = 0.00    avg(cpu1) = 0.00    avg(cpu2) = 0.00    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.00    avg(cpu7) = 0.00

Host zm03.stanford.edu: Individual CPU sys time

avg(cpu0) = 2.22    avg(cpu1) = 2.11    avg(cpu2) = 1.76    avg(cpu3) = 0.94    avg(cpu4) = 0.76    avg(cpu5) = 0.85    avg(cpu6) = 1.53    avg(cpu7) = 0.83

Host zm03.stanford.edu: Individual CPU idle time

avg(cpu0) = 60.18    avg(cpu1) = 69.76    avg(cpu2) = 74.61    avg(cpu3) = 87.39    avg(cpu4) = 89.75    avg(cpu5) = 87.31    avg(cpu6) = 75.72    avg(cpu7) = 86.77

Host zm03.stanford.edu: Individual CPU iowait time

avg(cpu0) = 9.66    avg(cpu1) = 16.31    avg(cpu2) = 13.21    avg(cpu3) = 2.52    avg(cpu4) = 1.94    avg(cpu5) = 3.03    avg(cpu6) = 11.92    avg(cpu7) = 2.78

Host zm03.stanford.edu: Individual CPU irq time

avg(cpu0) = 0.16    avg(cpu1) = 0.09    avg(cpu2) = 0.07    avg(cpu3) = 0.00    avg(cpu4) = 0.00    avg(cpu5) = 0.00    avg(cpu6) = 0.06    avg(cpu7) = 0.00

Host zm03.stanford.edu: Individual CPU softirq time

avg(cpu0) = 1.72    avg(cpu1) = 0.41    avg(cpu2) = 0.34    avg(cpu3) = 0.18    avg(cpu4) = 0.16    avg(cpu5) = 0.17    avg(cpu6) = 0.31    avg(cpu7) = 0.19

Host zm03.stanford.edu: Process CPU

avg(mailbox) = 7.91    avg(mysql) = 0.82    avg(convertd) = 0.00    avg(stats) = 0.00

Host zm03.stanford.edu: Process Total Memory

avg(mailbox) = 7934.01    avg(mysql) = 18452.88    avg(convertd) = 0.00    avg(stats) = 0.00

Host zm03.stanford.edu: Process Resident Memory

avg(mailbox) = 7170.78    avg(mysql) = 17453.44    avg(convertd) = 0.00    avg(stats) = 0.00

Host zm03.stanford.edu: Swap Activity

avg(swap in) = 0.00    avg(swap out) = 0.00

Host zm03.stanford.edu: Virtual Memory

avg(swapped) = 0.24    avg(free) = 1516.00    avg(active) = 28692.12    avg(inactive) = 1301.14    avg(page cache) = 4222.59

Host zm03.stanford.edu: Context Switches

avg(context switches) = 6549.63

Host zm03.stanford.edu: Run/Blocked Process Queue Size, Load Average

avg(processes waiting for run time) = 1.21    avg(processes waiting for io time) = 1.52    avg(load average (1 min)) = 2.96

Host zm03.stanford.edu: Disk Utilization (Top 10 avg)

avg(sdc) = 9.45    avg(sdf) = 9.40    avg(sdj) = 10.80    avg(sdm) = 11.79    avg(sdo) = 9.43    avg(sdv) = 10.74    avg(sdy) = 11.75    avg(dm-0) = 32.67    avg(dm-1) = 26.75    avg(dm-2) = 24.11

Host zm03.stanford.edu: Disk Throughput: /dev/sda

avg(sda read) = 25.61    avg(sda write) = 72.93

Host zm03.stanford.edu: Disk Throughput: /dev/sdb

avg(sdb read) = 0.00    avg(sdb write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdc

avg(sdc read) = 761.72    avg(sdc write) = 61.18

Host zm03.stanford.edu: Disk Throughput: /dev/sdd

avg(sdd read) = 0.00    avg(sdd write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sde

avg(sde read) = 187.90    avg(sde write) = 256.70

Host zm03.stanford.edu: Disk Throughput: /dev/sdf

avg(sdf read) = 759.92    avg(sdf write) = 61.04

Host zm03.stanford.edu: Disk Throughput: /dev/sdg

avg(sdg read) = 0.00    avg(sdg write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdh

avg(sdh read) = 0.00    avg(sdh write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdi

avg(sdi read) = 0.00    avg(sdi write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdj

avg(sdj read) = 633.88    avg(sdj write) = 718.22

Host zm03.stanford.edu: Disk Throughput: /dev/sdk

avg(sdk read) = 0.00    avg(sdk write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdl

avg(sdl read) = 0.00    avg(sdl write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdm

avg(sdm read) = 637.72    avg(sdm write) = 718.09

Host zm03.stanford.edu: Disk Throughput: /dev/sdn

avg(sdn read) = 184.62    avg(sdn write) = 257.45

Host zm03.stanford.edu: Disk Throughput: /dev/sdo

avg(sdo read) = 764.88    avg(sdo write) = 60.90

Host zm03.stanford.edu: Disk Throughput: /dev/sdp

avg(sdp read) = 0.00    avg(sdp write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdq

avg(sdq read) = 188.47    avg(sdq write) = 257.34

Host zm03.stanford.edu: Disk Throughput: /dev/sdr

avg(sdr read) = 764.50    avg(sdr write) = 61.17

Host zm03.stanford.edu: Disk Throughput: /dev/sds

avg(sds read) = 0.00    avg(sds write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdt

avg(sdt read) = 0.00    avg(sdt write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdu

avg(sdu read) = 0.00    avg(sdu write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdv

avg(sdv read) = 622.99    avg(sdv write) = 718.58

Host zm03.stanford.edu: Disk Throughput: /dev/sdw

avg(sdw read) = 0.00    avg(sdw write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdx

avg(sdx read) = 0.00    avg(sdx write) = 0.00

Host zm03.stanford.edu: Disk Throughput: /dev/sdy

avg(sdy read) = 625.43    avg(sdy write) = 718.49

Host zm03.stanford.edu: Disk Throughput: /dev/dm-0

avg(dm-0 read) = 3051.02    avg(dm-0 write) = 244.29

Host zm03.stanford.edu: Disk Throughput: /dev/dm-1

avg(dm-1 read) = 2520.02    avg(dm-1 write) = 2873.37

Host zm03.stanford.edu: Disk Throughput: /dev/dm-2

avg(dm-2 read) = 560.99    avg(dm-2 write) = 771.49

Host zm03.stanford.edu: Disk IOPs: /dev/sda

avg(sda read) = 2.07    avg(sda write) = 3.67

Host zm03.stanford.edu: Disk IOPs: /dev/sdb

avg(sdb read) = 0.00    avg(sdb write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdc

avg(sdc read) = 34.86    avg(sdc write) = 3.77

Host zm03.stanford.edu: Disk IOPs: /dev/sdd

avg(sdd read) = 0.00    avg(sdd write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sde

avg(sde read) = 11.64    avg(sde write) = 17.97

Host zm03.stanford.edu: Disk IOPs: /dev/sdf

avg(sdf read) = 34.89    avg(sdf write) = 3.74

Host zm03.stanford.edu: Disk IOPs: /dev/sdg

avg(sdg read) = 0.00    avg(sdg write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdh

avg(sdh read) = 0.00    avg(sdh write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdi

avg(sdi read) = 0.00    avg(sdi write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdj

avg(sdj read) = 6.21    avg(sdj write) = 5.44

Host zm03.stanford.edu: Disk IOPs: /dev/sdk

avg(sdk read) = 0.00    avg(sdk write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdl

avg(sdl read) = 0.00    avg(sdl write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdm

avg(sdm read) = 6.24    avg(sdm write) = 5.41

Host zm03.stanford.edu: Disk IOPs: /dev/sdn

avg(sdn read) = 11.69    avg(sdn write) = 17.96

Host zm03.stanford.edu: Disk IOPs: /dev/sdo

avg(sdo read) = 34.92    avg(sdo write) = 3.76

Host zm03.stanford.edu: Disk IOPs: /dev/sdp

avg(sdp read) = 0.00    avg(sdp write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdq

avg(sdq read) = 11.65    avg(sdq write) = 17.99

Host zm03.stanford.edu: Disk IOPs: /dev/sdr

avg(sdr read) = 34.85    avg(sdr write) = 3.71

Host zm03.stanford.edu: Disk IOPs: /dev/sds

avg(sds read) = 0.00    avg(sds write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdt

avg(sdt read) = 0.00    avg(sdt write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdu

avg(sdu read) = 0.00    avg(sdu write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdv

avg(sdv read) = 6.12    avg(sdv write) = 5.46

Host zm03.stanford.edu: Disk IOPs: /dev/sdw

avg(sdw read) = 0.00    avg(sdw write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdx

avg(sdx read) = 0.00    avg(sdx write) = 0.00

Host zm03.stanford.edu: Disk IOPs: /dev/sdy

avg(sdy read) = 6.15    avg(sdy write) = 5.41

Host zm03.stanford.edu: Disk IOPs: /dev/dm-0

avg(dm-0 read) = 142.72    avg(dm-0 write) = 61.07

Host zm03.stanford.edu: Disk IOPs: /dev/dm-1

avg(dm-1 read) = 24.81    avg(dm-1 write) = 718.34

Host zm03.stanford.edu: Disk IOPs: /dev/dm-2

avg(dm-2 read) = 35.67    avg(dm-2 write) = 120.52

Host zm03.stanford.edu: Disk Partition Throughput: /dev/sda1 mounted on /

avg(sda1 read) = 24.97    avg(sda1 write) = 66.96

Host zm03.stanford.edu: Disk Partition Throughput: /dev/sda2 mounted on /usr/vice/cache

avg(sda2 read) = 0.64    avg(sda2 write) = 5.94

Host zm03.stanford.edu: Disk Partition IOPs: /dev/sda1 mounted on /

avg(sda1 tps) = 5.49

Host zm03.stanford.edu: Disk Partition IOPs: /dev/sda2 mounted on /usr/vice/cache

avg(sda2 tps) = 0.24

Host zm03.stanford.edu: Total file descriptors open

avg(file descriptors open) = 4983.95

Host zm03.stanford.edu: SOAP: Invocation Count: Summary (Top 10 max)

max(AuthRequest) = 171.00    max(MsgActionRequest.update) = 420.00    max(NoOpRequest) = 164.00    max(GetFolderRequest) = 607.00    max(SyncRequest) = 390.00    max(GetMsgRequest) = 2487.00    max(GetAppointmentRequest) = 2380.00    max(SearchRequest) = 855.00    max(GetInfoRequest) = 172.00    max(MsgActionRequest.delete) = 362.00

Host zm03.stanford.edu: SOAP: Average Call Duration: Summary (Top 10 avg)

avg(SyncGalRequest) = 1189.72    avg(BrowseRequest) = 468.00    avg(DeleteAccountRequest) = 19647.33    avg(BackupRequest) = 485792.00    avg(FolderActionRequest.empty) = 2113.65    avg(SendInviteReplyRequest) = 419.19    avg(BackupQueryRequest) = 855.60    avg(GetQuotaUsageRequest) = 3241.00    avg(ConvActionRequest.delete) = 779.71    avg(SendMsgRequest) = 377.97

Host zm03.stanford.edu: MySQL: InnoDB Buffer Pool Pages

avg(pages read) = 4655982.27    avg(pages written) = 57352428.52

Host zm03.stanford.edu: MySQL: InnoDB Buffer Pool Hit Rate

avg(buffer pool hit rate) = 996.96

Host zm03.stanford.edu: MySQL: Database Connections

avg(connection pool size) = 0.89    avg(threads connected) = 0.00

Host zm03.stanford.edu: MySQL: Tables Open/Opened

avg(open_tables) = 406.37    avg(opened_tables (cumulative)) = 423014.19

Host zm03.stanford.edu: MySQL: Total Slow Queries Count

avg(slow queries (cumulative)) = 728199.57

Host zm03.stanford.edu: Mailboxd: Connection Pool Get Latency

avg(mysql) = 11.00    avg(ldap) = 0.24

Host zm03.stanford.edu: Mailboxd: Dirty Lucene Index Writers

avg(dirty index writers) = 76.37

Host zm03.stanford.edu: Mailboxd: Lucene IndexWriterCache Hitrate

avg(cache hitrate) = 41.43

Host zm03.stanford.edu: Mailboxd: Lucene IO

avg(Index writes) = 1470.83    avg(Index reads) = 5011.59

Host zm03.stanford.edu: Mailboxd: LMTP Delivery Throughput

avg(received) = 110.58    avg(delivered) = 162.25

Host zm03.stanford.edu: Mailboxd: LMTP Delivery Rate

avg(received msgs) = 0.74    avg(delivered msgs) = 1.05    avg(received x rcpts) = 1.19

Host zm03.stanford.edu: Mailboxd: Mailbox Add Rate (Delivery Rate)

avg(mailbox add rate) = 1.20

Host zm03.stanford.edu: Mailboxd: Mailbox Add Latency (Delivery Speed)

avg(mailbox add latency) = 186.40

Host zm03.stanford.edu: Mailboxd: Request Rate by Client Protocol

avg(SOAP) = 10.13    avg(IMAP) = 37.25    avg(POP) = 7.43

Host zm03.stanford.edu: Mailboxd: Response Time by Client Protocol

avg(SOAP) = 92.87    avg(IMAP) = 26.43    avg(POP) = 81.65

Host zm03.stanford.edu: Mailboxd: Active Connections by Client Protocol

avg(IMAP) = 4.81    avg(IMAP SSL) = 844.76    avg(POP) = 0.23    avg(POP SSL) = 10.10

Host zm03.stanford.edu: Mailboxd: Mailbox Get Count

avg(mailbox get count) = 3514.33

Host zm03.stanford.edu: Mailboxd: Mailbox Get Latency

avg(mailbox get latency) = 8.69

Host zm03.stanford.edu: Mailboxd: Mailbox Cache Hit Rate

avg(mailbox cache hit rate) = 99.52

Host zm03.stanford.edu: Mailboxd: Mailbox Item/Blob Cache Hit Rate

avg(msg blob cache) = 1.93    avg(item metadata cache) = 39.52

Host zm03.stanford.edu: Mailboxd: Garbage Collection Time

avg(minor GC time) = 2.24    avg(major GC time) = 0.02

Host zm03.stanford.edu: Mailboxd: Garbage Collection Count

avg(minor GC count) = 64.73    avg(major GC count) = 0.60

Host zm03.stanford.edu: Mailboxd: JVM Heap Used

avg(total) = 2955.12    avg(PS Old Gen) = 0.00    avg(CMS Old Gen) = 2934.91    avg(Tenured Gen) = 0.00    avg(Train Gen) = 0.00    avg(PS Eden Space) = 0.00    avg(PS Survivor Space) = 0.00    avg(Par Eden Space) = 20.21    avg(Par Survivor Space) = 0.00    avg(Eden Space) = 0.00    avg(Survivor Space) = 0.00

Host zm03.stanford.edu: Mailboxd: JVM Heap Free

avg(total free) = 1870.76    avg(PS Old Gen free) = 0.00    avg(CMS Old Gen free) = 1849.47    avg(Tenured Gen free) = 0.00    avg(Train Gen free) = 0.00    avg(PS Eden Space free) = 0.00    avg(PS Survivor Space free) = 0.00    avg(Par Eden Space free) = 21.23    avg(Par Survivor Space free) = 0.06    avg(Eden Space free) = 0.00    avg(Survivor Space free) = 0.00

Host zm03.stanford.edu: Mailboxd: JVM Permanent Generation and Code Cache

avg(PS Perm Gen) = 0.00    avg(Perm Gen) = 0.00    avg(CMS Perm Gen) = 81.52    avg(Code Cache) = 40.88    avg(Perm Gen [shared-ro]) = 0.00    avg(Perm Gen [shared-rw]) = 0.00    avg(PS Perm Gen free) = 0.00    avg(Perm Gen free) = 0.00    avg(CMS Perm Gen free) = 54.20    avg(Code Cache free) = 4.97    avg(Perm Gen [shared-ro] free) = 0.00    avg(Perm Gen [shared-rw] free) = 0.00

Host zm03.stanford.edu: convertd: CPU time used

avg(total cputime) = 0.14    avg(user time) = 0.12    avg(system time) = 0.02

Host zm03.stanford.edu: convertd: Resident Memory

avg(convertd rss) = 24.35

Host zm03.stanford.edu: convertd: Processes and Threads

avg(processes) = 5.41    avg(threads) = 5.41

Summary