Latest VBSpam test results show drop in spam catch rates again

Posted by   Virus Bulletin on   Jul 31, 2012

Downward trend in performance continues.

In the latest VBSpam comparative test of anti-spam products, 21 anti-spam solutions achieved a VBSpam award, but for the majority of products the spam catch rate showed a continuing decline.

We first reported this drop in March, and catch rates barely bounced back in May. The results of the July test showed another decline in most products' spam catch rates.

This perhaps becomes most clear when looking at the false negative rates (the measure of spam messages that were not blocked). We saw that, in March, the average false negative rate was about one in 700 spam messages. In July, this had decreased to one in 167 messages. (To avoid outliers influencing these averages, the highest and lowest scores were excluded from the calculation of the average.)

Over the last few years, botnet takedowns and policy changes at ISPs have seen the global volume of spam drop significantly. This is undoubtedly a good thing. But it has also forced spammers to look for other ways to make money from the emails they send - and improving their delivery rates is one thing they appear to have done.

It is important to realise that we haven't suddenly lost the war against spammers. We are still a very long away from the scenario of email accounts becoming unusable because of the vast amount of spam. Indeed, many products performed well in the recent test - and SpamTitan earned a 'VBSpam+' award by achieving a very high spam catch rate without missing a single legitimate email.

However, spammers have won an important battle and it is up to the anti-spam community to make sure this trend doesn't continue and, ideally, is reversed.

For Virus Bulletin subscribers the full test report is available here. Non-subscribers can purchase the standalone review ($19.95) here.

More on the VBSpam tests, including historical performance of the participating products, can be found here.

Posted on 31 July 2012 by Martijn Grooten

twitter.png
fb.png
linkedin.png
hackernews.png
reddit.png

 

Latest posts:

VB2019 conference programme announced

VB is excited to reveal the details of an interesting and diverse programme for VB2019, the 29th Virus Bulletin International Conference, which takes place 2-4 October in London, UK.

VB2018 paper: Under the hood - the automotive challenge

Car hacking has become a hot subject in recent years, and at VB2018 in Montreal, Argus Cyber Security's Inbar Raz presented a paper that provides an introduction to the subject, looking at the complex problem, examples of car hacks, and the…

VB2018 paper and video: Android app deobfuscation using static-dynamic cooperation

Static analysis and dynamic analysis each have their shortcomings as methods for analysing potentially malicious files. Today, we publish a VB2018 paper by Check Point researchers Yoni Moses and Yaniv Mordekhay, in which they describe a method that…

VB2019 call for papers closes this weekend

The call for papers for VB2019 closes on 17 March, and while we've already received many great submissions, we still want more!

Registration open for VB2019 ─ book your ticket now!

Registration for VB2019, the 29th Virus Bulletin International Conference, is now open, with an early bird rate available until 1 July.

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.