VB100 update

Posted by   Virus Bulletin on   Aug 16, 2010

Adjustments to test scores affect Kaspersky, VirusBuster.

In the wake of the recent VB100 comparative, covering a massive 54 products on Windows Vista SP2, further double-checking of results has unveiled some anomalies which require correction. These changes affect products from Kaspersky Lab and VirusBuster.

The issue affecting Kaspersky Lab was first observed when the developers queried why their new, enhanced 2011 edition appeared to have fared less well than the older version 6 in some of our tests. Further analysis showed a simple explanation - the results for the two products were reversed, thanks to the vagaries of alphabetical order in different operating systems. Our apologies are extended to Kaspersky for the mix up, the online results will be adjusted and corrected as soon as possible.

We also noted in post-test analysis that in the previous comparative, on Windows Server 2008, the scores for Kaspersky's latest solution for that platform were not fully recorded, thanks to the program silently crashing during the initial test. As the VB100 rules currently allow for products to be retried in the event of a problem, up to three times on different hardware, the product was re-run and no repeat of the crashing was observed; detection rates over the complete set of test samples are thus higher than initially reported. These results will also be corrected, and included in the cumulative RAP averages diagram.

A similar situation emerged with the scores for VirusBuster in this month's comparative, when the developers queried the disparity between their own results and those of their sister product from Central Command. Further analysis and a re-run of the test showed that there was a problem, as yet undiagnosed, in the initial gathering or processing of results, and a second set of figures show scores almost identical to those of Vexira, as expected by the developers. Further investigations are being carried out into anomalies in the detection scores of other products using the VirusBuster engine. Again we extend our apologies for the error, and will correct the online version of the report as soon as possible.

None of these changes affect qualification for VB100 certification. The next round of VB100 testing will run next month on the Windows Server 2003 platform, deadlines for the submission of products will be announced shortly.

Posted on 16 August 2010 by Virus Bulletin

twitter.png
fb.png
linkedin.png
hackernews.png
reddit.png

 

Latest posts:

VB2018 paper: From Hacking Team to hacked team to…?

Today we publish the VB2018 paper and video by ESET researcher Filip Kafka, who looked at the new malware by Hacking Team, after the company had recovered from the 2015 breach.

The spam that is hardest to block is often the most damaging

We see a lot of spam in the VBSpam test lab, and we also see how well such emails are being blocked by email security products. Worryingly, it is often the emails with a malicious attachment or a phishing link that are most likely to be missed.

Throwback Thursday: We're all doomed

Mydoom turns 15 this month, and is still being seen in email attachments. This Throwback Thursday we look back to March 2004, when Gabor Szappanos tracked the rise of W32/Mydoom.

VB2019 call for papers - now open!

Have you analysed a new online threat? Do you know a new way to defend against such threats? Are you tasked with securing systems and fending off attacks? The call for papers for VB2019 is now open and we want to hear from you!

VB2018 paper: Unpacking the packed unpacker: reversing an Android anti-analysis library

Today, we publish a VB2018 paper by Google researcher Maddie Stone in which she looks at one of the most interesting anti-analysis native libraries in the Android ecosystem. We also release the recording of Maddie's presentation.

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.