A third of anti-malware products fail to secure Vista Business Edition, Virus Bulletin reveals

Posted by   Virus Bulletin on   Aug 12, 2010

VB urges industry to work harder at quality assurance.

One third of products failed to meet the standard required for VB100 certification Virus Bulletin has revealed that, out of 54 anti-malware products tested, 19 failed to reach the standard required for VB100 certification in its recent test on Windows Vista Business Edition SP2.

Stumbling blocks for the products in this test included failure to detect a number of viruses known to be circulating in the wild and false alarms produced on clean files from major software houses including Corel, Roxio and Adobe. But alongside these issues, the test team also encountered problems with product design and stability.

"Once again we have looked at a huge range of products, and found a wide variation in performance and effectiveness. Most notable this month, though, has been the remarkable level of instability under pressure noted in many of the products - while our tests do put unusual strain on products, it is clearly important that security software should continue to function under pressure, and should not crumble in the face of heavy attack," said John Hawes, Virus Bulletin's Anti-Malware Test Director. "Flaky behaviour will certainly not instill a sense of security in users, and developers need to ensure their quality control is thorough and comprehensive, to keep their users properly protected at all times."

The review provides a wealth of data that gives insight into how the various solutions stack up against each other in a wide range of ways, including some detailed performance analysis as well as detection rates and the testing team's thoughts on the user experience.

Virus Bulletin has been testing and certifying anti-malware products for more than ten years in the VB100 certification scheme. The stringent VB100 tests pit anti-malware products against a test set of malware from the WildList - a publicly available up-to-date list of the malware that is known to be circulating on computers around the world. To earn VB100 certification, products must be able to detect 100% of the malware contained in the WildList test set and must not generate any false alarms when scanning a set of clean files.

The results of the August 2010 VB comparative review can be seen here [registration required - free of charge].

VB's cumulative RAP ('Reactive And Proactive') quadrant, which gives a quick visual reference as to products' reactive and proactive detection rates over a six-month period, is shown below:

The full Windows Vista Business Edition review, including detailed results tables, is available to Virus Bulletin subscribers here (with details on how to become a subscriber here).

A full description of the RAP testing methodology can be seen here [registration required - free of charge].

Posted on 12 August 2010 by Virus Bulletin



Latest posts:

VB2018 paper: Internet balkanization: why are we raising borders online?

At VB2018 in Montreal, Ixia researcher Stefan Tanase presented a thought-provoking paper on the current state of the Internet and the worrying tendency towards raising borders and restricting the flow of information. Today we publish both his paper…

The malspam security products miss: banking and email phishing, Emotet and Bushaloader

The set-up of the VBSpam test lab gives us a unique insight into the kinds of emails that are more likely to bypass email filters. This week we look at the malspam that was missed: banking and email phishing, Emotet and Bushaloader.

VB2018 paper: Where have all the good hires gone?

The cybersecurity skills gap has been described as one of the biggest challenges facing IT leaders today. At VB2018 in Montreal, ESET's Lysa Myers outlined some of the things the industry can do to help address the problem. Today we publish Lysa's…

Preview: Nullcon 2019

We look forward the Nullcon 2019 conference in Goa, India, at which VB Editor Martijn Grooten will give a talk on the state of malware.

From Amazon to Emotet: a look at those phishing and malware emails that bypassed email security products

We see a lot of spam in the VBSpam test lab, and we also see how well such emails are being blocked by email security products. Recently some of the emails that bypassed security products included a broken Amazon phishing campaign, a large fake UPS…

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.