Introducing PC System Benchmarks
PC system benchmarks are a good method to identify potential bottlenecks in your computing performance and choose effective system upgrades. As there are several types of different PC system benchmarks, our focus has always been on those that provide scripted test scenarios inspired from real world use cases.
In March of 2015 we set off to test what various software products were doing to our computers. In this study, 133 products were tested. The inclusion process was simple and straightforward: few software download sites were manually scanned for any products claiming to make your computer faster by cleaning it or by fixing system errors.
In October of 2016 we tested the top ten registry cleaners. The products tested were chosen simply with a Google search of Windows registry cleaners and the top ten results were picked.
In January of 2017 PC system benchmarks were performed to determine the best registry cleaner from a selection of the top three which previously ranked best.
This week, as we have just released jv16 PowerTools 2017 version 18.104.22.1688, our interest for PC system benchmarks was reborn.Why this test now?
Today is supposed that PCMark 10 will be released for public use.
As it has been quite a while since PCMark 8 has been the standard in PC system benchmarking, we wish to celebrate the upcoming public release of PCMark 10 this week with a Windows 10 benchmarking test report done using PCMark 8, before and after using popular PC system utilities.
Since PCMark 8 is not necessarily fully compatible with Windows 10 benchmarking methods, we expect surprising results and some enticing conclusions that may lead us to further test cases for next week’s lab report.
Once PCMark 10 will be released, the conclusions of this micro test will be used to compose the test cases for a much wider study involving more software products that promise to clean and speed-up your computer.
If at the time of reading this report PCMark 10 has been already released, then you can freely benchmark your computer using this software for free in the same way that we did in our lab with PCMark 8.
To start, we looked at the top competitor (according to Google.com search results for “registry cleaner”) and decided to see the PC system benchmarks score impact (if any) before and after using the said product: CCleaner.
In order to learn the most from this experience, we downloaded the free, professional trial of CCleaner in order to evaluate this software from the best angle possible.
As far as we know, this version is supposed to be fully featured, including an active background system monitoring service – which may or may not have an impact on the overall PC system benchmarks score given by PCMark 8 – to be determined.
Test Cases involving PC System Benchmarks
The objective of this test was set to record the virtual PC system benchmarks score given by PCMark 8 on Windows 10 with some of the most common 3rd party applications installed:
- Before installing and using any of the tested PC system utilities
- After installing and using CCleaner – Professional
- After installing and using jv16 PowerTools 2017
PC System Benchmarks Test Environment
The current benchmark test was performed using an Oracle VirtualBox (version: 5.1.22 r115126) virtual environment running Windows 10 with 4 CPU cores and 8 GB of RAM assigned.
In order to ensure that no system updates or other updates are downloaded during the testing procedure, the system was disconnected from the Internet before starting each PC system benchmarks test set.
The virtual machine was run on a host computer running Ubuntu Linux 17.04 LTS (64 bit) with an Intel-i5 processor, 20 GB of DDR3 virtual memory and a SSD system disk.
Such an ordinary test environment was created and used in order to simulate the easiest conditions that can be reproduced by any consumer to verify the validity of these tests.
Using high-end hardware or complex distributed system may result in more professional test methods but may also return test results that are only applicable in an uncommon environment (test lab which does not reflect a real world use case).
For the future, we will also approach this from the ISO point of view. For now, trying to keep it simple while educating consumers about their options is our primary objective.
PC System Benchmarks: Verifiability
All of the past and current test results are accompanied by screenshots and video recordings which have been saved during various testing phases in order to address some of the most common test result credibility concerns for this type of studies.
Test Case #1: Summary
In the first test case we measured the PCMark 8 PC system benchmarks score for a virtual Windows 10 system that was freshly installed and updated for this purpose.
In this environment, we installed the most common software used today, according to ninite.com. This wonderful tool allows you to quickly install or update multiple commonly used software at the same time, either on a local end-point or even across the network.
Once all the software has been installed, the virtual machine state was saved and we used this state of the operating system as a benchmark point of comparison (without any PC system utilities installed or used on the machine before measuring its baseline PC Mark 8 score).In order to measure baseline performance, we run the free, conventional test offered by PCMark 8. This test is advertised as being the standard for common home computing tests.Video recording of the PC system benchmarks done on Windows 10.
Test Case #2: Summary
In the second test case, the previously saved Windows 10 snapshot (with most common 3rd party software installed) has been cleaned and optimized using this week’s tested PC system utilities. scl-shortcode-cleaner-clean-content-end--> scl-shortcode-cleaner-clean-content-end-->
PC System Benchmarks (micro testing): conclusions lead to wider tests
After cleaning the Windows 10 operating system with either CCleaner – Professional Edition or jv16 PowerTools 2017, the PCMark 8 PC system benchmark score was lower than before using any PC system utilities to clean the operating system in the first place.
This result is not surprising for us at all, considering that both of the tested registry cleaners attach a resident process to the system in order to monitor the operating system’s health and overall performance.
How can the operating system get a lower PCMark 8 benchmark score after it has been cleaned?
Most likely, the reason for the lower score obtained by the operating system after being cleaned with each of the tested products in comparison to the baseline test score is because of an extra running background process in both cases, however, this is just an assumption at this level.
In order to clarify this assumption, more extensive tests will be carried out in the near future, with and without background monitoring services enabled for either jv16 PowerTools and any other similar interest software product that we can easily find using a simple search on Google.com
With PCMark 10 pending release later today, we wish to do a similar test case scenario next week and hopefully compare the results between PCMark 8 and PCMark 10.
Results should vary as PCMark 10 has been specifically designed to become the industry standard for benchmarking Windows 10 operating systems, as PCMark 8 has been for a long time in regards to Windows 8 and Windows 8.1.
What do we expect to see in the next PC system benchmarks done on Windows 10 with PCMark 10?
First of all, we expect PCMark 10 to be far more compatible and capable to measure small differences of Windows 10 performance before and after certain actions have been performed in the test environment.
As PCMark 8 was not necessarily designed to manage Windows 10 after its latest updates, we expect this to improve with the latest release of PCMark later today.
For the start of the next week, our weekly software testing report will most likely include a preview of PCMark 10 and the scores obtained by a Windows 10 virtual environment before and after cleaning it with popular pc system utilities.
Related weekly benchmark test reports:
- PC System Utilities – Software Testing Weekly #1
- PC System Benchmarks – Software Testing Weekly #2
- PCMark 10 Benchmark Alternatives – Software Testing Weekly #3
- Anti-Exploit Kit Benchmark – Software Testing Weekly #4
- Scan Speed Benchmark – Software Testing Weekly #5
Other historical benchmark test reports:
Since February of 2009 (when the first test of this kind was done in our lab), Macecraft Software has published a total of seven registry cleaner product comparison studies:
- Registry Cleaner Review and Performance Comparison Study – February, 2009
- In-Depth Review of 31 The Most Popular Registry Cleaner Products – April, 2009
- Comparison of 176 Registry Cleaner Products – October, 2010
- Registry Cleaner Benchmark Study – September, 2013
- Benchmark Report of 133 Windows Optimization Software Products – March, 2015
- Registry Cleaner Performance Comparison Study – October, 2016
- Benchmark of Top Three Windows Registry Cleaners – January, 2017