Swap:Benchmarking

small file testing 2/4/10

Small file testing on a two-node filegroup on app13 & 14. 10,000 file requests with 16 threads.

over 1700 requests per second!

ab -n 10000 -c 16 http://naraapp13:8080/get/web/test//chronopolis/Chronopolis-Reporter/build/web/WEB-INF/classes/edu/umiacs/chronopolis/Index.class

Test 1: pull file that exists on the requested node.

Server Software:        
Server Hostname:        naraapp13
Server Port:            8080

Document Path:          /get/web/test//chronopolis/Chronopolis-Reporter/build/web/WEB-INF/classes/edu/umiacs/chronopolis/Index.class
Document Length:        5954 bytes

Concurrency Level:      16
Time taken for tests:   5.785794 seconds
Complete requests:      10000
Failed requests:        0
Write errors:           0
Total transferred:      60910000 bytes
HTML transferred:       59540000 bytes
Requests per second:    1728.37 [#/sec] (mean)
Time per request:       9.257 [ms] (mean)
Time per request:       0.579 [ms] (mean, across all concurrent requests)
Transfer rate:          10280.70 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       3
Processing:     4    8   2.7      8      56
Waiting:        4    8   2.6      8      56
Total:          4    8   2.7      8      56

Percentage of the requests served within a certain time (ms)
  50%      8
  66%      9
  75%      9
  80%     10
  90%     11
  95%     13
  98%     16
  99%     18
 100%     56 (longest request)

Test 2: return a 302 redirect when hitting wrong node.

Server Software:        
Server Hostname:        naraapp14
Server Port:            8080

Document Path:          /get/web/test//chronopolis/Chronopolis-Reporter/build/web/WEB-INF/classes/edu/umiacs/chronopolis/Index.class
Document Length:        0 bytes

Concurrency Level:      16
Time taken for tests:   4.419558 seconds
Complete requests:      10000
Failed requests:        0
Write errors:           0
Non-2xx responses:      10000
Total transferred:      2570000 bytes
HTML transferred:       0 bytes
Requests per second:    2262.67 [#/sec] (mean)
Time per request:       7.071 [ms] (mean)
Time per request:       0.442 [ms] (mean, across all concurrent requests)
Transfer rate:          567.70 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0       3
Processing:     1    6   1.8      6      19
Waiting:        1    6   1.8      6      18
Total:          1    6   1.8      6      19

Percentage of the requests served within a certain time (ms)
  50%      6
  66%      7
  75%      7
  80%      8
  90%      9
  95%     10
  98%     12
  99%     13
 100%     19 (longest request)

Large File testing

same two node cluster, moving a 600mb iso image. We managed to completely saturate the gig link to the server once the file was cached in memory.

ab -n 16 -c 8 http://naraapp13:8080/get/web/test/fc6/FC-6-i386-disc2.iso

...
...
Server Software:        
Server Hostname:        naraapp13
Server Port:            8080

Document Path:          /get/web/test/fc6/FC-6-i386-disc2.iso
Document Length:        714240000 bytes

Concurrency Level:      8
Time taken for tests:   97.736743 seconds
Complete requests:      16
Failed requests:        0
Write errors:           0
Total transferred:      11427842272 bytes
HTML transferred:       11427840000 bytes
Requests per second:    0.16 [#/sec] (mean)
Time per request:       48868.371 [ms] (mean)
Time per request:       6108.546 [ms] (mean, across all concurrent requests)
Transfer rate:          114184.30 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0 1689 3628.1      2    9002
Processing: 29984 40419 12455.8  32967   61889
Waiting:        5 11539 13202.5   2694   30351
Total:      29984 42108 14256.1  32969   62093

Percentage of the requests served within a certain time (ms)
  50%  32969
  66%  57069
  75%  59084
  80%  59084
  90%  61889
  95%  62093
  98%  62093
  99%  62093
 100%  62093 (longest request)

Arc File Testing

[toaster@loach ~]$ ab -n 10000 -c 16 http://naraapp14.umiacs.umd.edu:8080/arc/webarc/iraq2004/iraq10/data/IQ04-CRAWL-09-20040901085321-00252-crawling003.archive.org.arc.gz\?offset=218126\&contentonly=true
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking naraapp14.umiacs.umd.edu (be patient)
Completed 1000 requests
Completed 2000 requests
Completed 3000 requests
Completed 4000 requests
Completed 5000 requests
Completed 6000 requests
Completed 7000 requests
Completed 8000 requests
Completed 9000 requests
Finished 10000 requests


Server Software:        
Server Hostname:        naraapp14.umiacs.umd.edu
Server Port:            8080

Document Path:          /arc/webarc/iraq2004/iraq10/data/IQ04-CRAWL-09-20040901085321-00252-crawling003.archive.org.arc.gz?offset=218126&contentonly=true
Document Length:        13934 bytes

Concurrency Level:      16
Time taken for tests:   15.387210 seconds
Complete requests:      10000
Failed requests:        0
Write errors:           0
Total transferred:      140350000 bytes
HTML transferred:       139340000 bytes
Requests per second:    649.89 [#/sec] (mean)
Time per request:       24.620 [ms] (mean)
Time per request:       1.539 [ms] (mean, across all concurrent requests)
Transfer rate:          8907.40 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       3
Processing:     7   24  11.8     22     155
Waiting:        6   23  11.8     21     155
Total:          7   24  11.8     22     155

Percentage of the requests served within a certain time (ms)
  50%     22
  66%     25
  75%     28
  80%     30
  90%     37
  95%     46
  98%     59
  99%     69
 100%    155 (longest request)