VB100 Comparative Review on Windows Server 2016

John Hawes

Virus Bulletin

Copyright © 2016 Virus Bulletin


 

Introduction

It was an all-new platform for this month's VB100 comparative, with our first look at Microsoft's latest server‑grade operating system variant, Windows Server 2016. Although the platform was officially released only shortly before the test got under way, previews had been available for some time, and being largely similar to the widely deployed desktop equivalent Windows 10, we hoped that security developers would have had plenty of time to ensure their products supported the new environment to the full. However, any new setup will inevitably bring some surprises, so we were more than usually keen to see just how well products would perform this month.

Platform and test sets

Installation, as usual using standard install media acquired through the MSDN programme, proved fairly simple, and the preparation of our test systems, including the addition of our standard selection of common tools, went smoothly too. Trials of our test automation systems, such as our performance measurement tools, brought up nothing untoward either, with all necessary tweaks already having been made for Windows 10 testing. However, one major change in the platform was clear from the start: for the first time on a Windows Server platform, the built-in Windows Defender anti-malware solution was enabled by default. With many of our regular participants having warned us to watch out for this, alerting us to the fact that many of them had not been provided with suitable means of disabling the protection automatically, and that there had been numerous reports of disabled setups reverting unexpectedly to an enabled state, we opted to shut Defender down for ourselves and monitor its status closely throughout testing.

As is our standard approach for speed and performance measures, baselines were taken with the system in its default state, which in this case meant with Defender enabled. The aim of this approach is to enable users to judge how much of an impact each solution has on the speed of a standard system compared to a basic, unmodified installation. This time, however, we quickly noticed something of a problem – almost every product appeared to be running much faster than the baseline times, with significantly lower resource usage too.

The resulting flood of negative numbers made our usual speed graphs rather difficult to read, and after some analysis and consideration we eventually decided to break from our standard practice and rebuild the baseline measures using unprotected, bare systems rather than the default setup for the chosen platform. This gave us a much more easily consumed set of speed data for this report. To give some indication of how Windows Defender fits into the picture, we've included for reference in the main performance and on-access lag time charts the performance numbers that were originally intended to be baselines, although as Defender was not officially submitted for testing, no full set of detection data is available.

The test deadline was set for 2 November, a little later than usual due to the VB conference having taken up a lot of our time in October. Our sample sets were frozen on 2 November and we used the latest WildList available at the time, v4.033. As always, our clean sets were updated and tidied in preparation for the test, with the latest version comprising around 850,000 files and 180GB of data.

With all preparations complete, we settled down to find out how the products would fare on the new platform.

Results

AhnLab V3Net for Windows Server

Main version: 9.0.22.7 build 919
Update versions: 2016.11.02.01, 2016.06.25.00, 2016.11.23.05, 2016.11.29.04
Last 6 tests: 1 passed, 0 failed, 5 no entry
Last 12 tests: 3 passed, 0 failed, 9 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 AhnLab-1216.gif


AhnLab's products tend to pop up in our tests at fairly random intervals, but generally put in decent performances. The latest server edition looks slick and glossy with a clean and clear layout, and proved to run pretty smoothly on Windows Server 2016 with only a single incident of the product GUI crashing out. Our performance measures showed pretty low use of resources and a fairly sizeable slowdown of our set of standard tasks, although they still ran through a good bit faster than with Windows Defender operational. File read times were also a little slow on first encounter of items, but again mostly better than with Defender enabled, and they sped up considerably on repeat runs. Scanning speeds looked decent too, particularly over the local system partition.

Detection was strong in the response sets, dropping off fairly considerably in the offline reactive sets. The core certification sets were handled nicely though, and AhnLab kicks off this month's test with a VB100 award.

 

Avast Business Security

Main version: 12.3.2515 build 12.3.3154.0
Update versions: 161102-0, build 12.3.3154.23/161116-0, 161122-0, 161128-0
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 Avast-1216.gif


Avast is a much more regular participant in our tests, with a 100% pass rate in recent years. The vendor's business edition has a slick and attractive appearance that is similar to that of its home‑user offerings, with simplicity on the surface and a wealth of configuration options available. The product demonstrated good stability for the most part – the only issue noted occurred at the end of the offline RAP test, when the entire machine froze and required a reboot. This was not reproducible however, and occurred at a time of high stress, so didn't dent the stability rating too heavily.

Speeds were not the fastest on demand, but on-access lag times were light, especially in the warm runs. RAM usage was low, CPU use a little high, and our set of tasks ran through a touch slowly. Detection was strong in the response sets, tailing off somewhat in the offline part of the sets. The certification sets presented no difficulties though, and Avast maintains its clean run of passes.

 

Avira Antivirus Server

Main version: 15.0.23.58
Update versions: 8.12.131.62, 8.12.134.48, 8.12.136.252, 8.12.138.86
Last 6 tests: 3 passed, 1 failed, 2 no entry
Last 12 tests: 7 passed, 1 failed, 4 no entry
ItW on demand: 100.00%
ItW on access: 99.68%
False positives: 0
Stability: Solid

VB100-fail.jpg Avira-1216.gif


Avira's products show up in most of our tests and generally put in strong performances. The server version has the usual simple, angular appearance with a strong set of controls under the covers, and this month held up well under the pressure of testing with no stability problems noted. Scanning speeds were decent, while file read times look fast thanks to there being limited scanning on-read by default. Performance measures show slightly elevated resource usage and a noticeable but not too heavy impact on our set of activities.

Detection was decent too, and there were no issues in the clean sets. There was a clean run over the WildList sets on demand, but on access we noted a couple of items that were not being alerted on; further checking revealed a detection was being prevented by the cloud lookup system, a problem Avira picked up on rapidly and fixed without intervention from us. Nevertheless, it was enough to deny Avira a VB100 award this month, despite another good showing.

 

Bitdefender Endpoint Security

Main version: 6.2.10.832
Update versions: 7.67876, 7.68036, 7.68137, 7.68262
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 Bitdefender-1216.gif


One of the very few vendors maintaining a perfect score card over the last two years, Bitdefender's business product has a minimalist appearance, with large fonts and clear messaging making up for minimal controls (most of which are provided in a separate management system). Stability was for the most part very good indeed, although during one large scan job we did note the PC freezing up and needing a restart, an incident which was not repeated and only occurred during unusually heavy usage.

Scanning speeds were pretty decent to start with and blasted through in no time on repeat runs, while file read lags were low and resource consumption also nominal, with a low impact on our set of activities. Detection was very strong indeed, dropping off a little into the proactive sets, and with a flawless run through the certification sets another VB100 award is well earned by Bitdefender.

 

CYREN Command Anti-Malware

Main version: 5.1.38
Update versions: 5.4.25/201611021006, 201611171229, 201611230923, 201611282121
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 6 passed, 4 failed, 2 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability:
Stable

VB100 Dec 2016 CYREN-1216.gif


CYREN's venerable Command product has picked up a good string of passes of late, its earlier, long-running issues with false positives seemingly now in the past, although the product remains the unchallenged title holder in the 'most retro interface' category. Stability was reasonable in everyday use, although scanning unusually large sets of malware seemed like a fairly sure-fire way to crash the GUI. Scanning speeds were sluggish, file read lags pretty hefty, and our set of activities took a long time to complete, with low resource usage figures more a reflection of the long period over which the numbers were averaged out rather than any particular efficiency.

Detection was very strong in the reactive sets, distinctly lower in the proactive tests where the product had no access to cloud lookups, and the WildList was nicely covered. The clean sets were once again handled without issues, and another VB100 award goes to CYREN.

 

Defenx Security Suite

Main version: 15.0.0106
Update versions: 9.244.21362, 15.1.0103/9.245.21537, 9.245.21583, 9.245.21644
Last 6 tests: 1 passed, 0 failed, 5 no entry
Last 12 tests: 6 passed, 0 failed, 6 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Solid

VB100 Dec 2016 Defenx-1216.gif


Defenx seems to be back in our regular lineup after a brief absence, having replaced its previous technology provider with K7. The product interface is clean and clear with good controls and plenty of information available, and seemed to brush off any attempt to stress it, earning top marks for stability. Scanning speeds were decent with some good optimization in the warm runs, while file read times weren't slowed down too much and our set of tasks completed in good time too, with minimal resource usage.

Detection was a little lower than most this month, but within acceptable bounds, and with another clean run over the certification sets a VB100 award is easily won by Defenx.

 

eScan Internet Security Suite Server Edition

Main version: 14.0.1400.1948 DB
Update versions: N/A
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 eScan-1216.gif


Another member of the 12/12 club with a perfect pass record in recent years, eScan's server edition has a very bright and colourful tiled main screen, with other areas including the ample set of configuration options looking a little less slick, but generally working well. We noted a single GUI crash, during normal usage, as well as a single problem with logging not behaving as expected, but nothing too serious. Scanning speeds were impressive, file access lags pretty light for the most part, and our set of activities wasn't hit too hard, with reasonable resource consumption.

Detection, assisted by the Bitdefender engine, was strong with a slight drop into the proactive sets, and a good showing in the core sets earns eScan another VB100 award.

 

ESET Endpoint Antivirus

Main version: 6.4.2014.0
Update versions: 14376, 14453, 14485, 14517
Last 6 tests: 6 passed, 0 failed, 0 no entry
Last 12 tests: 12 passed, 0 failed, 0 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

VB100 Dec 2016 ESET-1216.gif


Fresh from celebrating an epic 100th VB100 pass, ESET returns this month to extend that splendid record of passes still further. The product is highly polished and professional-looking with plenty of data displayed and easy access to a comprehensive set of configuration options. Stability was impeccable once again with no wobbles even under seriously heavy loads, and speeds were good too, with fast scan times, light slowdown of file reads and a pretty reasonable impact on our sets of activities; resource use wasn't excessive either.
Detection was excellent with good scores even into the offline proactive sets, and yet another perfect run through the certification sets easily earns ESET its 101st VB100 award.

 

ESTsoft ALYac

Main version: 3.0.1.3
Update versions: 16.7.12.1/606898.2016110222/7.67876/7724183.20161102, N/A 16.7.12.1/611979.2016112322/7.68135/7323290.20161123, 16.7.12.1/613740.2016113019/7.68254/7398571.20161130
Last 6 tests: 4 passed, 1 failed, 1 no entry
Last 12 tests: 9 passed, 1 failed, 2 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 ESTsoft-1216.gif


ESTsoft has a pretty decent record in our tests, with some good runs of passes over the last few years. The current product is pleasant to look at overall, with decent controls available, although fonts look a little wonky in places. Stability was good, with only a single issue noted, related to log exporting. Scanning speeds were fairly fast, file read lag times mostly very low, although executables were held up rather longer than other file types, at least on first visit, with warm times much better. Our set of tasks was slowed down a little but not too much, with resource consumption barely detectable.

Using the Bitdefender engine, detection was, as expected, very solid indeed, and with no problems in the certification sets another VB100 award is comfortably earned by ESTsoft.

 

Fortinet FortiClient

Main version: 5.4.1.0840
Update versions: 5.00233/40.00475, 40.00789, 40.00945, 41.00070
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Fair

VB100 Dec 2016 Fortinet-1216.gif


Fortinet's FortiClient is another extremely reliable participant in out tests, with passes in all Windows comparatives in the last few years. The product interface is fairly basic with minimal options provided and styling pared down for maximum simplicity. It proved mostly reliable, although a few update attempts failed and had to be re-run and we did see a couple of unexpected restarts. Scanning speeds were fairly slow, on-access lags a little high but showing some improvement on repeat visits to the same files, and our set of tasks was somewhat slowed down with resource consumption a little elevated at busy times.

Detection was very strong in the response sets, dropping considerably into the offline proactive sets, and the core certification sets were dealt with very tidily, earning Fortinet another VB100 award.

 

G DATA Antivirus Business

Main version: 14.0.1.122
Update versions: AVA 25.8921/GD 25.8081, AVA 25.9066/GD 25.8184, AVA 25.9174/GD 25.8237, AVA 25.9311/GD 25.8290
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Solid

VB100 Dec 2016 GData-1216.gif


G DATA's business solution is a proper corporate offering with an MMC console to provide deployment and central control, and a local agent with limited configuration to keep the user informed of any issues. As usual, deployment and operation proved a little more involved than with straightforward monolithic solutions, but it seemed to work pretty well with some practice, and proved robustly resistant to the stresses of the test, earning a perfect rating for stability. Scanning speeds were reasonable initially and very fast indeed in the warm runs, with file read lags showing a similar improvement on repeat visits. Our set of activities was distinctly slower than the baseline measures, with pretty heavy use of resources too.

Detection was very strong as usual, with good scores across the sets, and another perfect showing in the core sets earns G DATA another VB100 award.

 

IKARUS anti.virus

Main version: 2.13.19
Update versions: 98759, 98804, 98822, 98841
Last 6 tests: 3 passed, 2 failed, 1 no entry
Last 12 tests: 7 passed, 2 failed, 3 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

VB100 Dec 2016 Ikarus-1216.gif


Ikarus seems slightly more prone to false positives than most, but has managed to pick up a decent scattering of passes of late. This month the product looked much the same as ever, the interface somewhat blocky and clunky but reasonably usable, and it proved impressively stable with no problems noted at all.

Scanning speeds started out decent and became excellent on repeat runs, while file lags were fairly significant on first seeing things but again improved impressively after initial settling in. Our set of tasks completed in very good time.

Detection was solid, with a sharpish drop into the proactive sets, and a good job handling the certification sets earns Ikarus another VB100 award.

 

K7 Total Security

Main version: 15.1.0330
Update versions: 9.244.21382, 9.245.21527, 9.245.21582, 9.245.21644
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 10 passed, 0 failed, 2 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 K7-1216.gif


K7's history in our tests shows an impressive run of success of late, with passes in all Windows comparatives in the last couple of years. The product has a rugged appeal with a good set of controls within easy reach, and proved pretty stable once again with only a single glitch – a fairly minor one where an update failed to complete first time but got the job done without difficulty on re-running. Scanning speeds were slow to start with but a lot quicker on second attempt, while file read lag times were a little high, improving somewhat in the warm runs. Our set of tasks wasn't slowed down too much though, and resource usage was low.

Detection was reasonable, a little lower than the bulk of participants but still respectable, and the core certification sets were handled accurately, earning K7 a VB100 award.

 

Kaspersky Security 10 for Windows Server

Main version: 10.0.0.486
Update versions: N/A
Last 6 tests: 1 passed, 0 failed, 5 no entry
Last 12 tests: 6 passed, 0 failed, 6 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

VB100 Dec 2016  


Kaspersky's history in our tests is complicated somewhat by the vendor's large number of product lines, which appear in differing combinations depending on the test. The server solution is a full enterprise offering leveraging the MMC system for its main interface and controls, which are provided in the comprehensive depth one would expect and seem fairly simple to navigate and operate. There were no stability problems noted, earning the product a 'Solid' rating. Scanning speeds were not the fastest, and overheads seemed a little heavy too, with a long time taken to complete our set of tasks and fairly high use of RAM and CPU cycles.

The certification sets were nicely covered though, earning Kaspersky another VB100 award.

 

NANO Antivirus Pro

Main version: 1.0.46.78415 Pro
Update versions: 0.14.26.8452, 1.0.46.78415 Pro/0.14.26.8560, 1.0.70.78864 Pro /0.14.26.8596, 1.0.70.78864 Pro/0.14.26.8630
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 4 passed, 2 failed, 6 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability:
Solid

VB100 Dec 2016 NANO-1216.gif


A relative newcomer to VB100 testing, NANO has accumulated a nice little set of passes. The product looks clean and simple, and managed to complete all tests without the slightest sign of instability. Scanning speeds were steady and not too slow, while file read lags were slow over archives but not bad elsewhere. Our set of tasks was somewhat slowed down, and resource usage was also noticeable, but not too heavy.

Detection still lags behind the leaders somewhat but continues to improve steadily, and with a good run through the certification sets, another VB100 award goes to NANO.

 

PC Pitstop PC Matic Home Security

Main version: 2.0.0.6
Update versions: 2.0.0.6, 2.0.0.7
Last 6 tests: 0 passed, 4 failed, 2 no entry
Last 12 tests: 0 passed, 7 failed, 5 no entry
ItW on demand: 98.95%
ItW on access: 85.72%
False positives: 2174
Stability: Buggy

VB100-fail.jpg PCPitstop-1216.gif


PC Pitstop's unusual whitelisting-heavy approach has earned it some stellar detection rates of late, although a tendency to false alarm has meant no certification for a while. The interface is focused on software vulnerabilities with some information on malware protection and basic configuration controls. The GUI itself remained reasonably stable, but we saw a number of fatal blue-screen incidents at all stages of the test (to be fair, we should note that the product is mainly geared towards the consumer market and not intended for use on server platforms). With so many issues noted no speed or performance data could be gathered, but we at least managed to complete all the detection tests, which showed once again some superb detection rates in the RAP sets, but a high FP rate and some issues with the WildList too, meaning there is no VB100 award for PC Pitstop once again.

 

Quick Heal AntiVirus Server Edition

Main version: 17.00 (1.0.0.4.3) 64bit
Update versions: N/A
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 8 passed, 0 failed, 4 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability:
Stable

VB100 Dec 2016 QuickHeal-AV-1216.gif


Quick Heal's server version has a stark black-and-white colour scheme, leavened only occasionally with touches of green or red, and a clean, pared-down layout which nevertheless manages to provide a decent set of configuration options. Stability was good, with just a single incident observed of the scanner snagging. Scanning speeds were slowish, overheads not too bad to start with and barely discernible on repeat visits, while our set of activities wasn't too badly slowed down but resource consumption was on the high side.

Detection was strong, with a steady but not too steep decline through the sets, and the certification sets were nicely dealt with, earning Quick Heal a VB100 award.

 

Quick Heal Seqrite Antivirus Server Edition

Main version: 17.00 (10.0.5.3) 64bit
Update versions: N/A
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 8 passed, 0 failed, 4 no entry
ItW on demand: 100.00%
ItW on access:
100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 QuickHeal-Seqrite-1216.gif


Quick Heal's Seqrite product line is aimed at the larger enterprise, but the main interface closely resembles other Quick Heal products, once again using a monochrome look to lend gravitas. Stability was good again, with just that single file tripping up the scanner and, this time, an update attempt returning an error on first try. Scanning speeds and file access lag times were acceptable, with a fairly large hit on our set of activities and somewhat elevated resource consumption.

Detection was pretty decent across the board, including in the certification sets where no issues were noted, duly earning Quick Heal's Seqrite another VB100 award.

 

Tencent PC Manager

Main version: 11.6.26315.901
Update versions: 11.6.26322.901, 12.1.26326.901, 12.1.26328.901
Last 6 tests: 4 passed, 0 failed, 2 no entry
Last 12 tests: 7 passed, 0 failed, 5 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 Tencent-1216.gif


Chinese giant Tencent continues to build a steady run of passes in our tests. The latest edition looks bright and glossy with clear controls and a decent set of configuration options provided. Stability was dented only by an incident on one install where the on-access protection seemed to take rather a long time to kick in. Scanning speeds were on the slow side, and with minimal protection on-read our file access measures show low impact. Detection was strong, and with another good run through the certification sets, Tencent picks up another VB100 award.

 

Tencent PC Manager – TAV

Main version: 11.6.26311.901
Update versions: 11.6.26321.901, 12.1.26325.901, 12.1.26327.901
Last 6 tests: 3 passed, 0 failed, 3 no entry
Last 12 tests: 3 passed, 0 failed, 9 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Solid

VB100 Dec 2016
The 'TAV' edition of Tencent's PC Manager uses only in-house technology without the third-party engine that is enabled in the standard edition, and has been achieving certification fairly reliably over the last year or so. In look and feel it's not much different, with the same shiny, colourful interface. Stability this time was perfect, with no problems observed. Scanning speeds were a little faster than the mainline product, while once again on-read protection was largely absent. Our set of activities was minimally impacted, and resource use was low.

Detection figures are absent thanks to the developers requesting to be excluded from the RAP test, but the core certification sets were handled properly and a VB100 award is earned.

 

TrustPort Antivirus 2016

Main version: 16.02.5698
Update versions: 16.0.2.5705
Last 6 tests: 5 passed, 0 failed, 1 no entry
Last 12 tests: 9 passed, 0 failed, 3 no entry
ItW on demand: 100.00%
ItW on access: 100.00%
False positives: 0
Stability: Stable

VB100 Dec 2016 TrustPort-1216.gif


TrustPort's products have been stalwarts of our tests for many years now and can usually be relied upon to produce excellent detection levels thanks to their multi-engine approach. This month, the GUI came in a fairly attractive pale blue, with some nice clear information on the surface and a good set of options under the hood.

Stability was dented by a single incident while scanning some clean files, bringing up an API error message but not apparently affecting the actual scan. Scanning speeds were a little slow, file read overheads fairly high at first but showing some serious improvement later on. Detection was excellent, with a little drop into the proactive sets, and another perfect run through the certification sets earns TrustPort a VB100 award.

 

Results tables

Certification tests On demand On access Clean sets  VB100
Standard WildList Standard WildList FPs Warnings
AhnLab V3Net for Windows Server 100.00% 100.00%     vbantivirus-pass.gif
Avast Business Security 100.00% 100.00%   3 VB100 Pass
Avira Antivirus Server 100.00% 99.68%     vbantivirus-fail.gif
Bitdefender Endpoint Security 100.00% 100.00%    
CYREN Command Anti-Malware 100.00% 100.00%    
Defenx Security Suite 100.00% 100.00%    
eScan Internet Security Suite Server Edition 100.00% 100.00%    
ESET Endpoint Antivirus 100.00% 100.00%    
ESTsoft ALYac 100.00% 100.00%    
Fortinet FortiClient 100.00% 100.00%    
G DATA Antivirus Business 100.00% 100.00%    
Ikarus anti.virus 100.00% 100.00%     vbantivirus-pass.gif
K7 Total Security 100.00% 100.00%    
Kaspersky Security 10 for Windows Server 100.00% 100.00%    
NANO Antivirus Pro 100.00% 100.00%    
PC Pitstop PC Matic Home Security 98.95% 85.72% 2174   vbantivirus-fail.gif
Quick Heal AntiVirus Server Edition 100.00% 100.00%    
Quick Heal Seqrite Antivirus Server Edition 100.00% 100.00%    
Tencent PC Manager 100.00% 100.00%    
Tencent PC Manager - TAV 100.00% 100.00%    
TrustPort Antivirus 2016 100.00% 100.00%    

 

Product information Install time (m)* Reboot required Fully 64-bit Third-party engine technology§ Stability score Stability rating
AhnLab V3Net for Windows Server 5:45 √   X   1 Stable 
Avast Business Security 5:15 √  √    2.5  Stable  
Avira Antivirus Server  6:45    Solid 
Bitdefender Endpoint Security  7:00  √    2.5  Stable   
CYREN Command Anti-Malware  3:30  √    4.0  Stable 
Defenx Security Suite  3:00  √  K7  Solid 
eScan Internet Security Suite Server Edition  11:45  Bitdefender  Stable 
ESET Endpoint Antivirus  4:45  √    Solid 
ESTsoft ALYac  13:00  √  Bitdefender  Stable 
Fortinet FortiClient  4:30    Fair 
G DATA Antivirus Business  48:45  Bitdefender  Solid 
Ikarus anti.virus  2:00    Solid 
K7 Total Security  1:30    Stable 
Kaspersky Security 10 for Windows Server  4:15    Solid 
NANO Antivirus Pro  11:15    Solid 
PC Pitstop PC Matic Home Security  3:30    20  Buggy 
Quick Heal AntiVirus Server Edition  28:15  √    Stable 
Quick Heal Seqrite Antivirus Server Edition  26:00  √    Stable 
Tencent PC Manager  19:00  Bitdefender  Stable 
Tencent PC Manager - TAV  2:45    Solid 
TrustPort Antivirus 2016  11:45  √  Bitdefender  Stable 

0 = Solid 0.1 – 4.9 = Stable 5 – 14.9 = Fair 15 – 29.9 = Buggy 30+ = Flaky
* Install time includes initial updates and time to enable on-access protection (assuming reasonable typing speed and familiarity with product operation)
§ Only records presence of third-party scanning engines, most products will include additional in-house technologies

 

Archive scanning   ACE CAB EXE-RAR EXE-ZIP JAR LZH RAR TGZ ZIP 7z TBZ2 ZIPX EXT*
AhnLab V3Net for Windows Server OD 1 5 X X 5 X 1 2 √ 
OA X X X X X X X X √ 
Avast Business Security  OD  √                        
OA X/  X/  1/  X/  X/ X/  X/  X/  X/  X/  X/  X/  X/ 
Avira Antivirus Server   OD √                         
OA X/  X/  X/  X/  X/  X/  X/  X/  X/  X/  X/  X/  X/ 
Bitdefender Endpoint Security   OD √                         
OA  
CYREN Command Anti-Malware   OD √  √ 
OA 2/4  2/4  2/4  2/4  2/4  √  2/4  1/2  2/4  1/1  1/2  2/4  √ 
Defenx Security Suite   OD √  √  √  √       X    
OA  
eScan Internet Security Suite Server Edition   OD √  X/  5/8  5/8  7/  X/  X/  5/8  1/  X/  X/8   
OA   X/  X/  X/    X/  X/  X/  1/  X/  X/  X/ 
ESET Endpoint Antivirus   OD                          
OA  
ESTsoft ALYac   OD          
OA        
Fortinet FortiClient   OD                          
OA              
G DATA Antivirus Business   OD                          
OA 3/  2/      2/  3/  3/  1/8  2/  2/  1/8  2/   
Ikarus anti.virus   OD                          
OA                          
K7 Total Security  OD                    
OA
Kaspersky Security 10 for Windows Server   OD                          
OA X/  X/      X/  X/  X/  X/  X/  X/  X/  X/   
NANO Antivirus Pro   OD 8/  8/  4/  4/  8/  8/  4/  8/  8/  4/  8/   
OA  
PC Pitstop PC Matic Home Security   OD    
OA  
Quick Heal AntiVirus Server Edition   OD 2/5  X/5  2/2  2/2  2/5  3/6  2/5  X/2  2/5  2/5  X/2  2/5   
OA  
Quick Heal Seqrite Antivirus Server Edition   OD 2/5  X/5  2/2  2/2  2/5  3/6  2/5  X/2  2/5  2/5  X/2  2/5   
OA  
Tencent PC Manager   OD     7              
OA X/2  X/2  X/1  X/1  X/2  X/2  X/2  X/1  X/2  X/2  X/1  X/2  1/ 
Tencent PC Manager - TAV   OD                      
OA X/  X/  X/  X/  X/  X/  X/  X/  X/  X/  1/√ 
TrustPort Antivirus 2016   OD                          
OA     7/  8/  1/        1/      1/   

Key:
√ - Detection of EICAR test file up to ten levels of nesting
X - No detection of EICAR test file
X/√ - default settings/all files
1-9 - Detection of EICAR test file up to specified nesting level
If just z-exe detection in ext, then X
*Detection of EICAR test file with randomly chosen file extension

 

Performance measures Idle RAM usage increase Busy RAM usage increase Busy CPU usage increase Standard activities - time increase
AhnLab V3Net for Windows Server 9.52% 1.45% 11.26%  74.17% 
Avast Business Security  7.16%  0.31%  32.84%  65..52% 
Avira Antivirus Server  14.90%  8.32%  24.89%  65.88% 
Bitdefender Endpoint Security  4.78%  0.34%  -6.56%  30.02% 
CYREN Command Anti-Malware  4.72%  -3.97%  23.40%  523.69% 
Defenx Security Suite 3.41%  2.75% 0.62%  26.84% 
eScan Internet Security Suite Server Edition  13.27%  7.31%  18.09%  47.64% 
ESET Endpoint Antivirus 7.75%  6.86%  15.90%  29.84% 
ESTsoft ALYac  0.49%  -0.42%  5.10%  48.23% 
Fortinet FortiClient  11.38%  6.70%  13.24%  43.42% 
G DATA Antivirus Business  32.47%  27.82%  76.70%  93.38% 
Ikarus anti.virus  12.65%  10.64%  -0.19%  20.84% 
K7 Total Security  4.78%  2.71%  1.22%  25.87% 
Kaspersky Security 10 for Windows Server  16.37%  8.31%  34.22% 80.13% 
NANO Antivirus Pro  13.26%  10.06%  30.88%  47.93% 
PC Pitstop PC Matic Home Security  N/T  N/T  N/T  N/T 
Quick Heal AntiVirus Server Edition  29.28%  21.62%  105.07%  48.54% 
Quick Heal Seqrite Antivirus Server Edition  30.53%  20.59%  17.49%  74.68% 
Tencent PC Manager  8.84%  7.69%  5.69%  14.88% 
Tencent PC Manager - TAV  5.65%  4.19%  9.48%  7.82% 
TrustPort Antivirus 2016  5.24%  6.65%  2.44%  67.44% 
Microsoft Windows Defender* 11.99%  6.65%  10.83%  53.85% 

*Product not fully tested, only speed and performance data available. N/T = Not tested. 

 

Performance-graph.jpg

 

On-demand throughput (MB/s) System drive* Archive files Binaries and system files Media and documents Other file types
Default (cold) Default (warm) All files Default (cold) Default (warm) All files Default (cold) Default (warm) All files Default (cold) Default (warm) All files
AhnLab V3Net for Windows Server 97.62  7.78  5.47  N/A  6.69  9.70  6.69  14.16  14.16  14.16  11.12  15.54  11.12 
Avast Business Security 10.88  2.30  2.39  2.30  3.18  2.98  3.18  11.30  11.08 11.30  8.83  7.58  8.83 
Avira Antivirus Server  8.15  9.15  7.32  9.15  4.21  4.34  4.21  8.94  10.03  8.94  7.83  8.20  7.83 
Bitdefender Endpoint Security  38.17  13.49  1366.06  13.49  9.51  3157.44  9.51 13.95  1429.88  13.95  15.19  1906.56  15.19 
CYREN Command Anti-Malware  3.87  3.56  3.35  3.56  1.57  2.15  1.57  4.17  6.51  4.17  4.46  6.17  4.46 
Defenx Security Suite  24.56  8.88  546.34  8.88  3.88  420.99  3.88  8.41  268.12  8.41  5.34  224.30  5.34
eScan Internet Security Suite  13.74  44.41  86.71 14.57  8.08  36.15  7.61 9.83  31.66  12.33  9.12  25.71  12.38
ESET Endpoint Antivirus  98.43  15.43  35.24  15.43  16.36  32.33  16.36  14.52  214.49  14.52 14.72  381.31  14.72 
ESTsoft ALYac  5.62  2.09  53.56  23.35  7.23 11.15  10.79  5.42 13.32  14.67  5.00  10.85  11.18 
Fortinet FortiClient  5.68  8.67  9.53  8.67  1.61  1.99  1.61 11.63  11.95  11.63  6.24  5.91  6.24 
G DATA Antivirus Business  9.61  7.92  42.35  7.92  5.25  120.67  5.25  9.73  56.07  9.73  11.05  95.33  11.05 
Ikarus anti.virus  35.87  12.39  780.52  12.39  6.07  291.47  6.07  12.71  295.86  12.71  9.26  381.31  9.26 
K7 Total Security  22.86  1.73  606.99  1.73  5.33  462.09  5.33  9.17  268.12  9.17  5.13  309.18  5.13 
Kaspersky Security 10 for Windows Server   5.39 1.71  1.73  1.71  2.72  12.30  2.72  6.89  39.17  6.89  5.83  75.26  5.83 
NANO Antivirus Pro  17.36  9.95  9.93  9.95  5.19  5.12  5.19  0.90  0.91  0.90  15.56  17.07  15.56 
PC Pitstop PC Matic Home Security N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T 
Quick Heal AntiVirus Server Edition  5.71  9.10  12.79  1.31  4.26  3.87  2.71  6.23  6.83  6.36  6.74  4.43  3.68 
Quick Heal Seqrite Antivirus Server Edition  5.81  12.91  11.43  1.21  2.55  2.93  3.10  5.05  5.53  5.54  2.36  4.33 3.56
Tencent PC Manager  4.61  2.39  2.41  2.39  2.85  2.38  2.85  8.80  8.79  8.80  7.94  8.21  7.94 
Tencent PC Manager - TAV  13.47  14.23  14.34  14.23  4.73  8.43  4.73  9.05  9.63  9.05  10.06  12.05  10.06 
TrustPort Antivirus 2016   2.24 3.37  5.40  3.37  1.84  1.40  1.84  7.13  7.19  7.13  2.17  3.04  2.17 

*System drive size measured before product installation. N/T = Not tested.

 

OD-thruput-graph.jpg

 

On-access lag time (s/GB) System
drive
Archive files Binaries and system files Media and documents Other file types
Default (cold) Default (warm) All files Default (cold) Default (warm) All files Default (cold) Default (warm) All files Default (cold) Default (warm) All files
AhnLab V3Net for Windows Server  71.11  17.78  13.02  N/A  455.32  91.01  455.32  67.76  58.68  67.76  253.37  54.52 253.37 
Avast Business Security  13.74  54.64  13.09  211.81 65.72  62.98  293.15  37.82  36.32 92.78  47.15 46.29  133.43 
Avira Antivirus Server  6.33  0.07  0.11  0.14  11.74  13.05 6.75  7.85  7.81  4.89  6.97  6.26  5.75 
Bitdefender Endpoint Security  14.50  153.65  9.66 N/A 77.26  27.69  77.26  41.57  10.09 41.57 26.19 10.57  26.19 
CYREN Command Anti-Malware  172.46  309.04  197.07 186.95  349.60  347.57  353.76  141.35 139.10  140.21  123.11 122.52  122.96 
Defenx Security Suite  28.64  10.10  0.62  N/A  174.18  9.01  174.18  38.75  35.82  38.75 82.38 35.99  82.38 
eScan Internet Security Suite  19.21 7.65  0.91  44.59  166.86  7.31 15.41 101.97  6.38  34.46 92.88  5.03  15.42
ESET Endpoint Antivirus  17.24  6.92  6.90  N/A  74.49  41.56  74.49  26.17  25.43  26.17  19.44  19.29 19.44 
ESTsoft ALYac  47.06  31.84  0.81  N/A  390.78  7.87  390.78  36.67  8.08  36.67  62.77  8.57  62.77 
Fortinet FortiClient  30.84  21.16  9.52  21.16  288.66 73.97  288.66 52.64  37.52  52.64  98.15 48.32  98.15 
G DATA Antivirus Business  264.98  215.52  15.34 9.82  357.89  48.38  58.13  115.40  26.20  23.86  132.89  23.62  20.70 
Ikarus anti.virus  43.37 155.38  7.99  155.38  236.75  17.75  236.75  84.24  16.15 84.24  49.03  15.43  49.03 
K7 Total Security  29.90 13.30  30.30  N/A  215.14  136.32  215.14  75.02  40.28  75.02  129.44  77.16  129.44 
Kaspersky Security 10 for Windows Server  87.76  28.46  20.54  148.22 294.26  43.26  229.31  106.15  46.46  115.33  129.48  37.93  113.15 
NANO Antivirus Pro  145.91  6.63  6.37  N/A  452.63  393.04 452.63  71.16  60.11  71.16  52.64  47.98  52.64 
PC Pitstop PC Matic Home Security  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T  N/T 
Quick Heal AntiVirus  47.04  4.78  1.72  N/A  184.54  19.56  184.54  67.50  23.77 67.50  81.73  19.59  81.73 
Quick Heal Seqrite Antivirus  50.02  10.69  6.03  N/A  222.79  27.23  222.79  75.84  31.36  75.84  100.46  22.73  100.46 
Tencent PC Manager  11.23  1.77  1.96  3.67  7.41  6.44  5.27  5.84  5.44  4.85  5.61  5.69  4.27 
Tencent PC Manager - TAV  6.13  3.57  0.83  4.57  19.88  15.25  6.68  10.12  10.32  5.51  10.07  9.50  5.57 
TrustPort Antivirus 2016  59.94  52.71  0.79  182.98  422.79  23.85  432.71  113.41  20.02  127.59  148.39  17.55  156.50 
Microsoft Windows Defender*  32.55 44.63 46.40 N/T 396.08 347.58 N/T 86.90 85.19 N/T 158.16 153.58 N/T

System drive size measured before product installation.
*Product not fully tested, only speed and performance data available.
N/T = Not tested. N/A = Not applicable (e.g. product does not have an applicable option).

 

 

OA-lag-graph.jpg

 

Reactive and Proactive (RAP) tests  VB100  Reactive  Proactive  Reactive average  Proactive average  Weighted average 
Set 1* Set 2* Set 1§ Set 2§
AhnLab V3Net for Windows Server 93.3%  91.1%  54.5%   48.3% 92.2%  51.4%  78.6% 
Avast Business Security  96.2%  93.7% 62.0%   55.2% 94.9%   58.6% 82.8% 
Avira Antivirus Server  vbantivirus-fail.gif 88.8%  86.5%  62.5%  59.6%  87.6%   61.1% 78.8% 
Bitdefender Endpoint Security  95.7%  92.6%  69.3%  66.6%  94.1%   67.9%  85.4%
CYREN Command Anti-Malware 98.6%  95.8%  59.8%  56.8%  97.2%  58.3%  84.2% 
Defenx Security Suite  79.5%  77.6%  52.4%  46.4%  78.5%  49.4%   68.8%
eScan Internet Security Suite Server Edition  94.9% 91.9%  69.0%   65.9% 93.4%  67.4%   84.8%
ESET Endpoint Antivirus  95.8%  94.9%  77.9%  70.3%  95.3%  74.1%  88.2% 
ESTsoft ALYac  97.3%  95.3%  69.5%  66.7%  96.3%   68.1% 86.9% 
Fortinet FortiClient  95.4%  92.7%  62.5%  56.4%  94.0%  59.4%   82.5%
G DATA Antivirus Business  98.5%   96.8% 76.2%  68.4%  97.7%  72.3%   89.2%
Ikarus anti.virus   94.9% 93.4%  63.4%  60.7%  94.1%   62.0% 83.4% 
K7 Total Security  84.7%   78.3% 55.6%  51.2%  81.5%   53.4%  72.1%
Kaspersky Security 10 for Windows Server   N/T N/T  N/T  N/T  N/T  N/T  N/T 
NANO Antivirus Pro  82.1%  62.4%  47.3%  43.2%  72.3%  45.2%  63.3% 
PC Pitstop PC Matic Home Security  vbantivirus-fail.gif 99.9%  99.9%  99.98%  99.97%   99.91% 99.97%  99.9% 
Quick Heal AntiVirus Server Edition  93.6%  89.3%  69.1%  67.3%  91.4%  68.2%  83.7% 
Quick Heal Seqrite Antivirus Server Edition  93.5%  89.3%  69.1%  67.3%  91.4%  68.2%  83.7% 
Tencent PC Manager  95.5%   91.9% 68.4%  66.6%   93.7% 67.5%  85.0% 
Tencent PC Manager - TAV  N/T  N/T  N/T  N/T  N/T  N/T  N/T 
TrustPort Antivirus 2016  98.8%  99.0%  71.4%  68.9%  98.9%  70.2%  89.3% 

*Set -1 = Samples discovered 1 to 5 days before testing; Set -2 = Samples discovered 6 to 10 days before testing.
§Set +1 = Samples discovered 1 to 5 days after updates frozen; Set +2 = Samples discovered 6 to 10 days after updates frozen.
Weighted average gives equal emphasis to the two reactive weeks and the whole proactive part. N/T = Not tested.

 

RAP-Dec16.jpg

 

Perf-Resp-chart.jpg

 

Conclusions

Another VB100 comparative completed, and once again pass rates were pleasingly high with most products reaching the standard required for certification. Of those that didn't make it, one was hit by a freak error of the sort that hits everyone from time to time, while the other provides a rather different approach to protection which doesn't fit too well with the rigid requirements of the VB100 scheme.

Elsewhere, detection rates were mostly good and stability was impressive too, with most products rated higher than 'Fair'. Our speed measures proved something of a headache this month thanks to the newness of the platform, but hopefully still provided some fairly clear and actionable data for admins and purchasers.
We return next time with our annual visit to Linux, generally a far smaller field of products but always an interesting experience for the test team.

Technical details

All tests were run on identical systems with AMD A6-3670K Quad Core 2.7GHz processors, 4GB DUAL DDR3 1600MHz RAM, dual 500GB and 1TB SATA hard drives and gigabit networking, running Microsoft Windows Server 2016, Standard edition.

Download PDF

twitter.png
fb.png
linkedin.png
googleplus.png
reddit.png

 

Latest reviews:

VB100 Comparative Review Windows Server 2016

It was an all-new platform for this month’s VB100 comparative, with the test team's first look at Microsoft’s latest server‑grade operating system variant, Windows Server 2016.

VB100 Comparative Review Windows Server 2016

It was an all-new platform for this month’s VB100 comparative, with the test team's first look at Microsoft’s latest server‑grade operating system variant, Windows Server 2016.

VBWeb Comparative Review February 2017

One important thing all businesses can do to make their users more secure is to install a web security product. Virus Bulletin’s VBWeb tests measure how effective such products are at blocking malicious web traffic - in this report we look at the…

VBSpam Comparative Review

All of the products in this month's VBSpam test reached the benchmark required for VBSpam certification, and six of them performed well enough to earn the VBSpam+ accolade. This month, the VB test team also reported on products' ability to block spam…

VB100 Comparative Review on Windows 7 Pro x64

The VB test team saw a pleasingly smooth run, with a minimum of stability issues and a high pass rate in this month's VB100 comparative review on Windows 7 Pro x64.