Test System and Methodology
We utilize a new approach to HDD and SSD storage testing for our Enterprise Test Bench, designed specifically to target long-term performance with a high level of granularity.
Many testing methods record peak and average measurements during the test period. These average values give a basic understanding of performance, but fall short in providing the clearest view possible of I/O QoS (Quality of Service).
'Average' results do little to indicate the performance variability experienced during actual deployment. The degree of variability is especially pertinent, as many applications can hang or lag as they wait for I/O requests to complete. This testing methodology illustrates performance variability, and includes average measurements, during the measurement window.
While under load, all storage solutions deliver variable levels of performance. While this fluctuation is normal, the degree of variability is what separates enterprise storage solutions from typical client-side hardware. Providing ongoing measurements from our workloads with one-second reporting intervals illustrates product differentiation in relation to I/O QOS. Scatter charts give readers a basic understanding of I/O latency distribution without directly observing numerous graphs.
Consistent latency is the goal of every storage solution, and measurements such as Maximum Latency only illuminate the single longest I/O received during testing. This can be misleading, as a single 'outlying I/O' can skew the view of an otherwise superb solution. Standard Deviation measurements take latency distribution into consideration, but do not always effectively illustrate I/O distribution with enough granularity to provide a clear picture of system performance. We use histograms to illuminate the latency of every single I/O issued during our test runs.
Our testing regimen follows SNIA principles to ensure consistent, repeatable testing. We attain steady state through a process that brings the device within a performance level that does not range more than 20% during the measurement window. Forcing the device to perform a read-write-modify procedure for new I/O triggers all garbage collection and housekeeping algorithms, highlighting the real performance of the solution.
We measure power consumption during precondition runs. This provides measurements in time-based fashion, with results every second, to illuminate the behavior of power consumption in steady state conditions. Power consumption can cost more over the life of the device than the initial acquisition price of the hardware itself. This significantly affects the TCO of the storage solution. We also present IOPS-to-Watts measurements to highlight the efficiency of the storage solution.
For LSI SandForce-powered SSDs we conduct all preconditioning, and the following workloads, with 50% compressible data. This is the result of industry feedback, and the middle ground provides a picture of performance that is neither too critical, nor too favorable. Readers must bear in mind that there is varying performance with LSI SandForce processors due to its internal compression engine. Incompressible data will score much lower than the results presented in these tests, and fully compressible data will score much higher. It is important for administrators to know their workload and select the storage solution accordingly.
Our test pool features SSDs of varying capacity, so it is important to bear this in mind when viewing results. The first page of results will provide the 'key' to understanding and interpreting our new test methodology.
PRICING: You can find products similar to this one for sale below.
United States: Find other tech and computer products like this over at Amazon's website.
United Kingdom: Find other tech and computer products like this over at Amazon UK's website.
Canada: Find other tech and computer products like this over at Amazon Canada's website.
Recommended for You
- We at TweakTown openly invite the companies who provide us with review samples / who are mentioned or discussed to express their opinion of our content. If any company representative wishes to respond, we will publish the response here.
Latest News Posts
- AMD Radeon RX Vega could be priced at up to $850
- Ryzen ThreadRipper delidded: half its CPU dies disabled
- EA made more on live services than games in Q1'17
- Xiaomi Mi 6 special edition available in only 100 units
- Samsung to launch Note8 Emperor Edition with 8GB/256GB?
- ASUS GeForce GTX 1060 Dual 3G: Mid-Range On The Cheap
- AMD Ryzen 3 1300X and Ryzen 3 1200 CPU Review
- Lian-Li PC-O5SW...Watercooling and dimensions
- Toshiba XG5 1TB OEM M.2 NVMe PCIe SSD Review
- Toshiba N300 8TB High-Reliability HDD Review
- Toshiba introduces TR200 SATA retail SSD series with 64-layer 3D flash memory
- Need for Speed Payback takes cars from scrap to stock to supercar in new trailer
- Visbit releases Unity SDK and web VR player for its all-in-one VR streaming service, bringing high quality VR streaming to the masses
- GWENT Gamescom 2017 tournament announced
- Toshiba NVMe SSDs now available with Lenovo's new ThinkSystem and ThinkAgile servers