VB100 Comparative Review on Windows Server 2012 R2

John Hawes

Virus Bulletin

Copyright © 2016 Virus Bulletin 


 

Introduction

This VB100 test looks at the range of products available to users and admins of Microsoft's Windows 2012 Server. Our server tests usually see a somewhat reduced field of participants compared with desktop tests, since some consumer-oriented vendors don't support server platforms. From a testing perspective this is generally a double win, as not only do we have fewer products to wrestle with, but server-based products also tend to be more stable, and less prone to unwanted surprises. This month's field of participants consisted almost entirely of products which take part regularly in our comparatives, most of which routinely perform well, so we looked forward to a relatively trouble‑free test.

Platform and test sets

Windows 2012 Server has been around for a few years and has yet to be superseded by the forthcoming 2016 edition, which is due for release later this year. With the platform having appeared in several of our tests already, minimal preparation work was required – it was simply a matter of our lab team digging out and dusting off the test system images used in previous comparatives, with a few minor tweaks and updates to ensure all was working smoothly.

This allowed us a little extra time to focus on decluttering and expanding our clean test sets, which are due for a full‑scale overhaul fairly soon but which, for now, continue to combine swathes of items added immediately before each comparative, with the most prevalent and widely deployed items from the last few years. The other part of our certification set was based on version 4.027 of the WildList, which was released some time prior to the test deadline thanks to there having been some labour problems with the company that maintains the list (which, thankfully, were resolved swiftly). There were few changes to our performance tests, thus allowing reasonably close comparison of these results with those of previous tests on similar platforms, and the sample sets used for the RAP detection scores were gathered in the usual manner, combining the most common items in widespread distribution among researchers in the few days prior to testing.

With preparations completed, we moved on to the testing phase.

 

Results

Avast Business Security

Main version: 11.1.2510
Update versions: 160427-0, 11.2.2511/160509-0, 160516-1, 160523-0
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 11 passed, 1 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif Avast-0616.gif

Avast's recent test record is pretty exemplary, with just a single fail almost falling off the end of our two‑year history listing. This month, stability was reasonable with only minor problems, performance was good, with an acceptable slowdown of our set of tasks, and detection was generally pretty strong. With a clear run through the certification sets, Avast gets this test off to a good start with a VB100 award.

 

AVG AntiVirus Business Edition

Main version: 16.61.7539
Update versions: 45631/12098, 4568/12198, 4568/12241, 4568/12282
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

06-16.gif AVG-0616.gif

AVG can boast a flawless record in our tests in the last couple of years, and this month it also notched up a perfect stability score. With strong detection rates and fairly light performance impact, a good performance in the certification sets rounds off another strong month for AVG.

 

Avira Antivirus Server

Main version: 15.0.17.273
Update versions: 8.12.83.224, 8.12.89.34, 8.12.91.56, 8.12.93.58
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 9 passed, 0 failed, 3 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif Avira-0616.gif

Avira's recent test record is also strong, with only a few tests skipped around the time of the Windows 10 launch and no fails in the last several years. This month once again we saw reasonable performance impact and decent detection rates. Stability issues were minimal too, with the app crashing – fairly gracefully and only once – after a very heavy scan job. With no problems in the certification sets, a VB100 award is comfortably earned by Avira.

 

Bitdefender Endpoint Security

Main version: 6.2.9.751
Update versions: 7.65333/6465228, 7.65509/6627012, 7.65382/6652494, 7.65654/6683016
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

06-16.gif Bitdefender-0616.gif

Bitdefender can also be proud of a perfect record in VB100 tests in the last two years, with an unbroken record stretching back quite some way further. This month all was well once again, with another perfect stability score, decent detection levels, and pleasingly low performance impact. An impeccable job in the certification sets means there is yet another VB100 award for Bitdefender.

 

CYREN Command Anti-Malware

Main version: 5.1.38
Update Versions: 5.4.25
Last 6 tests: 3 passed, 2 failed, 1 no entry
Last 12 tests: 4 passed, 6 failed, 2 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif CYREN-0616.gif

CYREN's venerable Command product has picked up a good few passes in the last couple of years, interspersed with sporadic false positive issues. This month it did well again, with good stability (only a single incident of a large scan crashing out), strong detection rates and low resource usage, although as on previous occasions, our set of activities exhibited a significant slowdown. The certification sets were dealt with properly once again though, and another VB100 award goes to CYREN.

 

Emsisoft Anti-Malware

Main version: 11.6.2.6338
Update versions: 3.5.0.656/11.0.1.12, 11.7.0.6394
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

06-16.gif Emsisoft-0616.gif

Another product that has not failed a VB100 test in the last two years, and which has only skipped our annual visits to Linux, Emsisoft also pulled off a perfect stability rating, along with good detection and fairly low performance impact. A similarly strong showing in the certification sets means there is another VB100 award for Emsisoft.

 

eScan ISS Server Edition

Main version: 14.0.1400.1789
Update versions: 14.0.1400.1879, 14.0.1400.1849, 14.0.1400.1879
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif eScan-06016.gif

Another vendor joining the ranks of those with a perfect 12 out of 12 in the last two years of VB100 testing, eScan put in another creditable showing this month, with decent stability, light performance impact and reasonable detection rates. The core certification sets were handled well, and eScan's run of success continues with another VB100 award.

 

ESET Endpoint Antivirus

Main version: 6.3.2016.0
Update versions: 13398, 13466, 13495, 13538
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif ESET-0616.gif

Although far from the only product this month to boast a recent record of 12 passes from 12 tests, ESET's run of excellence stretches back significantly further than that, with all tests entered and passed for many years now. This time all was pretty splendid once again, with a good showing in all parts of the test and decent stability. With yet another flawless run over the certification sets, ESET's tally of VB100 awards increases still further.

 

ESTsoft ALYac

Main version: 3.0.1.1
Update versions: 16.2.22.1/589613.2016042717/7.65325/6450540.20160427, 16.2.22.1/590797.2016051116/7.65509/6627012.20160511, 16.2.22.1/591498.2016051817/7.65580/6653493.20160518, 16.2.22.1/592362.2016052516/7.65653/6681104.20160525
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Solid

06-16.gif ESTsoft-0616.gif

Just missing out on a perfect record thanks to the lack of a Linux product to enter into our Linux tests, ESTsoft can be proud of a very strong chain of passes in the last few years. This month all was in order, with impeccable stability, low resource usage, reasonable impact on our set of activities, and another good showing in the core sets, all of which earns ALYac another VB100 award.

 

Fortinet FortiClient

Main version: 5.0.9.1349
Update versions: 5.223/34.269, 5.233/35.105, 34.701, 34.865
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif Fortinet-0616.gif

Fortinet's desktop product is another strong performer in our tests, and once again put in a good performance this month with just a few fairly minor stability issues, decent detection rates, low use of RAM while CPU use was a little on the high side, and a reasonable hit on the speed of our set of common tasks. The certification sets presented no difficulties, and Fortinet adds another VB100 award to its collection.

 

G Data Business

Main version: N/A
Update versions: N/A, 13.2.0.257/AVA 25.6855/GD 25.7011, AVA 25.6787/GD 25.6971, AVA 25.6707/GD 25.6937
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Stable

06-16.gif

G Data's business product generally appears in our server tests, putting in similarly strong performances to the consumer versions we see in desktop comparatives. This month was no different, with another excellent set of detection numbers in the reactive sets; some issues at submission time meant we were not able to collect proactive/offline figures. Stability was good, with just a single scan crash, performance impact was pretty high with a fairly serious slowdown of our set of activities, but with awesome coverage and a perfect run through the certification sets, a VB100 award is earned comfortably.

 

Ikarus anti.virus

Main version: 2.9.26
Update versions: 98177, 98220, 98241, 98260
Last 6 tests: 4 passed, 1 failed, 1 no entry
Last 12 tests: 8 passed, 1 failed, 3 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Solid

06-16.gif Ikarus-0616.gif

Ikarus generally puts in good performances in our tests, and this month did well once again with a perfect stability rating. Detection was strong, performance impact pretty reasonable, and with another perfect run through our certification sets, another VB100 award is easily earned.

 

iSheriff Security from the Cloud

Main version: 5.8.3.000
Update versions: 3.71, 5.8.2.0.506/3.71, 5.8.2.0515/3.71, 5.8.3.0000/3.71
Last 6 tests: 3 passed, 2 failed, 1 no entry
Last 12 tests: 8 passed, 2 failed, 2 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Solid

06-16.gif iSheriff-0616.gif

The iSheriff solution has had some wobbles in recent tests, with a couple of short-lived bursts of false positives, but otherwise it usually does well. Another perfect stability rating was notched up this month, alongside some good detection rates and minimal performance drag. The core certification sets were covered well, with help from the Bitdefender engine, and a VB100 award is earned.

 

K7 Total Security

Main version: 15.1.0291
Update versions: 9.223.19443, 9.224.19552, 9.225.19604, 15.1.0292/9.226.19682
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif K7-0616.gif

K7's Total Security product has become familiar over the last few years, with its rugged looks reflecting the general stability of the product, which routinely scores well in our stability measures. This month stability was not quite as good as we're used to, although the only issue we encountered – a complaint about a memory error shortly after installation – did not seem to cause any discernible problems. Elsewhere detection was good and performance impact light. A clear run through the core sets earns K7 another VB100 award.

 

Kaspersky Small Office Security 4

Main version: 15.0.2.361(c)
Update versions: 15.0.2.361(e), 15.0.2.361(e), 15.02361(f)
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 9 passed, 0 failed, 3 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

06-16.gif  

Kaspersky Lab's Small Office solution appears in many, if not all of our tests, and this month caused our testers minimal trouble with no stability problems to interrupt the flow. Performance impact was not excessive. There are no RAP detection figures to report, but a clean sweep in the certification sets earns Kaspersky another VB100 award.

 

Microsoft System Center Endpoint Protection

Main version: 4.9.219.0
Update versions: 1.1.12706.0/1.219.0.0, 1.219.1356.0, 1.219.1973.0, 1.1.128040/1.221.397.0
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 9 passed, 0 failed, 3 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

06-16.gif Microsoft-0616.gif

Microsoft's System Center products, essentially the business cousins of the default Defender solution for home users, routinely put in dependable performances in our tests. This month we saw another perfect round in terms of stability, coupled with acceptable detection levels and average system impact. The certification sets presented no problems, and a VB100 award is duly granted.

 

Qihoo 360

Main version: 5.0.20.6221
Update versions: N/A
Last 6 tests: 3 passed, 0 failed, 3 no entry
Last 12 tests: 6 passed, 0 failed, 6 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

06-16.gif Qihoo-0616.gif

Back on form after a brief absence from our tests, Qihoo's 360 line continues to do well. Stability this month was decent, with just one minor glitch during an update and another which froze a browser during a speed test. Detection was strong and performance impact negligible, with our set of activities running through very rapidly indeed. The certification sets presented no problems, and a VB100 award is easily earned.

 

Tencent PC Manager

Main version: 11(11.4.26179.901)
Update versions: 11(11.4.26183.901), 11(11.4.26190.901), 11(11.4.26194.901)
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 8 passed, 0 failed, 4 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

06-16.gif Tencent-0616.gif

Our other regular from China, Tencent managed to record no stability issues at all this month, alongside decent detection and light impact on system performance. The core certification sets were handled well, earning Tencent another VB100 award.

 

TrustPort Antivirus 2016

Main version: 2016(16.0.0.5668)
Update versions: N/A
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 7 passed, 0 failed, 5 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

06-16.gif TrustPort-0616.gif

The final product this month is TrustPort, which regularly achieves excellent detection levels. Things were no different this month with very high scores in all sets, coupled with impeccable stability and reasonably light impact on performance. With no problems to report in the certification sets, TrustPort also earns a VB100 award.

 

Results tables

certification-table.jpg

 

info-table.jpg

 

archive-1.jpg

 

archive-2.jpg

 

performance-table2.jpg

 

performance-graph.jpg

 

OD-thru-table-901.jpg

 

OD-thru-graph.jpg

 

OA-lag-table-897.jpg

 

OA-lag-graph.jpg

 

RAP-table.jpg

 

RAP-chart.jpg

 

2-Perf-v-Resp-chart.jpg

 

Conclusions

As mentioned in the introduction to this report, the products we see submitted for server tests tend to be more reliable and higher quality on average, and this month's line-up proves this rule – with all participating products achieving certification. We also saw minimal stability issues, with no participant rated lower than 'stable'. The high pass mark does not imply any reduction in the rigour of the VB100 process, but rather a better effort on the part of the participants – by design, the certification components of our test should be achievable on a regular basis by all respectable anti-malware solutions, and a single pass should be considered far less significant an event than a fail. To get a clear picture of how a product performs in the long term, it is important for readers to consider the history data we record in these reports, as well as in more detail on our website (www.virusbulletin.com).

While the small and stable group of participants made for a pleasingly painless month for the test team, there were, as always, plenty of things to keep us busy, contributing to the late distribution and rather curtailed nature of this report. To combat these issues, and free up more time for the lab team to work on the development of new and more demanding tests, we are investigating several proposals, including further simplification of the VB100 process and a shift to a more settled pattern of test platforms, as well as the separating out of the performance tests to their own standalone setup, with results published more frequently. As always, we welcome thoughts, comments and feedback from our readers – contact us on vbtest@virusbulletin.com.

 

Test environment: All tests were run on identical systems with AMD A6-3670K Quad Core 2.7GHz processors, 4GB DUAL DDR3 1600MHz RAM, dual 500GB and 1TB SATA hard drives and gigabit networking, running Microsoft Windows Server 2012 R2 Update.

Download PDF

twitter.png
fb.png
linkedin.png
googleplus.png
reddit.png

 

Latest reviews:

VB100 Comparative Review - December 2017

At the end of this, the last VB100 test of 2017, 31 products from 27 vendors were able to add a VB100 award to their tallies.

VBSpam Comparative Review - December 2017

In the 50th VBSpam test, 14 full solutions were lined up on the Virus Bulletin test bench. No fewer than eight products achieved a VBSpam+ award, while five other products achieved a VBSpam award.

VBWeb comparative review Autumn 2017

In this VBWeb test, products blocked between 90 and 100 per cent of both exploit kits and direct malware downloads.

VB100 Comparative Review October 2017

In this month's VB100 test, we tested 32 products from 27 vendors, with some new names appearing in addition to many of the regular ones, showing that the anti-virus market remains very much alive. Twenty eight of the products achieved the VB100…

VBSpam Comparative Review - September 2017

In this VBSpam test 14 full solutions were put through their paces, with four products achieving a VBSpam award, and nine products achieving a VBSpam+ award. Catch rates for most products were very close to 100%, with only three products generating…