11 out of 26 anti-virus products fail VB100 certification

Posted by   Virus Bulletin on   Oct 9, 2009

VB reveals which products failed to meet VB100 certification criteria, and updated 'RAP quadrant' showing Reactive And Proactive detection abilities.

Virus Bulletin has revealed the results of its latest VB100 certification test on Windows Server 2008.

Of the 26 products tested 11 failed to achieve VB100 certification, all of the failures being at least in part due to incomplete detection of one or both of a pair of highly complex polymorphic file-infecting viruses.

The results of the RAP ('Reactive And Proactive') tests conducted at the same time showed a continuation of the trends and patterns seen in recent tests, with dual-engine products from Trustport and G Data showing particularly remarkable scores.

Virus Bulletin's Test Director John Hawes said: "This month's test was a real challenge for the products, with two separate variants of a particularly tricky polymorphic virus included in our core WildList set. We used large numbers of samples of each to thoroughly measure accuracy of detection, and showed that many products continue to have trouble with these nasties."

Hawes continued: "On a brighter note, there were some quite impressive scores in our RAP test, showing that some vendors are doing a good job handling the large volumes of new malware appearing every day. Looking at the long-term picture, we can also see some products achieving high levels of consistency month on month, which is also a good indicator of a solid, well-run lab. We're looking forward to seeing if these trends continue with a wider range of products in our first comparative on Windows 7, due soon."

VB's cumulative RAP quadrant gives a quick visual reference as to products' reactive and proactive detection rates - with the better performing products placed in the top right-hand corner:

Virus Bulletin's RAP testing measures products' detection rates across four distinct sets of malware samples. The first three test sets comprise malware first seen in each of the three weeks prior to product submission. These measure how quickly product developers and labs react to the steady flood of new malware. A fourth test set consists of malware samples first seen in the week after product submission. This test set is used to gauge products' ability to detect new and unknown samples proactively, using heuristic and generic techniques.

The results of the October 2009 VB100 certification review can be seen here.

The full review, including detailed results tables, is available to Virus Bulletin subscribers here or in PDF format here.

A full description of the RAP testing methodology can be seen here .

Posted on 09 October 2009 by Virus Bulletin

twitter.png
fb.png
linkedin.png
hackernews.png
reddit.png

 

Latest posts:

VB2018 paper: Lazarus Group: a mahjong game played with different sets of tiles

The Lazarus Group, generally linked to the North Korean government, is one of the most notorious threat groups seen in recent years. At VB2018 ESET researchers Peter Kálnai and Michal Poslušný presented a paper looking at the group's various…

Book your VB2019 ticket now for a chance to win a ticket for BSides London

Virus Bulletin is proud to sponsor this year's BSides London conference, which will take place next week, and we have a number of tickets to give away.

First 11 partners of VB2019 announced

We are excited to announce the first 11 companies to partner with VB2019, whose support will help ensure a great event.

VB2018 paper: Fake News, Inc.

A former reporter by profession, Andrew Brandt's curiosity was piqued when he came across what appeared at first glance to be the website of a small-town newspaper based in Illinois, but under scrutiny, things didn’t add up. At VB2018 he presented a…

Paper: Alternative communication channel over NTP

In a new paper published today, independent researcher Nikolaos Tsapakis writes about the possibilities of malware using NTP as a covert communication channel and how to stop this.

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.