Benchmarking of Aida/Web 5.4 on Swazoo 2.0 with WAPT tool

Using WAPT Load Testing Tool

Goal: to compare Aida performance to Seaside and Ruby on Rails, as Jim Robertson is doing, see his blog here, here and here.

AidaCounterExample was made, which is as close as possible to Seaside counter example, which is a base for Jim's benchmarks

  • Test: WAPT Capacity/Overral Performance test with default setup for 20 concurrent users, except of Runtime which is increased to 5 min.
  • Test scenario: open a counter example, increment it to 4, decrement it back to 0 (together 9 page requests)

Test results and comparison

Platform Pages Avg Sessions/sec Avg Pages/sec Starting Pages/sec Ending Pages/secCPU

Aida 5.4, VW7.5, LAN

 32.838 6,41 109 111 107 25%

Aida 5.4, VW7.5, local

28.608
 5,57
 95 94
 93
 22%
Aida 5.4, Squeak 3.9,LAN 30.384
 5,93
 101
100
 101
 85%
Aida 5.4, Squeak 3.9, local
 27.751
 5,42
 92 92 88 80%
       
Seaside 2.8, VW7.6, LAN
 12.433 4,57 41 40 42 
Seaside 2.8, VW7.6, local
 17.573 6,46 59 58 58 
Seaside 2.8, VW7.6 tuned, LAN
 19.300 3,76 64 77 49 22%
Seaside 2.8, VW7.6 tuned, local 16.719 3,24 56 104 31 26%

Test notes

  • local = WAPT running on the same machine as test target, on VMWare Windows XP
  • LAN = WAPT running on Win XP notebook, connected via ethernet to 100M router/access point Lynksys and then to test machine
  • tuned = VW memory tuned (ObjectMemory sizesAtStartup: #(10.0 10.0 5.0 10.0 5.0 5.0 5.0) as Jim Robertson did
  • tuning for Aida didn't cause noticeable difference, so Aida tests are run on non-tuned image
  • test machine: 3.2GHz P4, 2GB RAM, on Linux (OpenSuse 10.0)
  • each test is run from complete reinstall on a fresh image, to ensure the same starting conditions (memory etc)