Benchmarking
from Performance Testing Guidance for Web Applications
在建立完performance baseline之後, 接下來要做的事情便是benchmarking. 什麼是benchmarking呢? Benchmarking就是一個在比較目前系統的速度, 和baseline或是業界標準速度的程序
如果你有baseline, 你就要必須確認你的執行條件, 和所要收集的資料, 要和baseline相同. 這樣你們之間才可以比較, 比較的結果才會有意義.
在做Benchmarking時, 以下幾點是你要考慮的
(1) 你必須遵守遊戲規則.
- A benchmark is achieved by working with industry specifications or by porting an existing implementation to meet such standards.
- Benchmarking entails identifying all of the necessary components that will run together, the market where the product exists, and the specific metrics to be measured.
(2) 因為你遵守遊戲規則, 所以你的結果是一目了然
- Benchmarking results can be published to the outside world.
- Since comparisons may be produced by your competitors, you will want to employ a strict set of standard approaches for testing and data to ensure reliable results.
(3) 你利用不同的指標來表達你的結果
- Performance metrics may involve load time, number of transactions processed per unit of time, Web pages accessed per unit of time, processor usage, memory usage, search times, and so on.
留言列表
