Latest spam filter test sees significant drop in catch rates

Posted by   Virus Bulletin on   Jun 26, 2015

Despite a drop in catch rates, 15 products earn a VBSpam award, with four earning a VBSpam+ award.

Spam is notoriously volatile and thus, while we like to make the news headlines with our tests as much as anyone, we would warn against reading too much into the fact that the percentage of spam missed by spam filters almost doubled in the most recent VBSpam test.

In the test, which ran for 16 days in April and May, filters missed an average of 0.4% of emails — up from 0.18% in February. Though these numbers might not appear all that worrying, very low delivery rates are part of spammers' business models. With a lot of spam containing or linking to malware, lower catch rates aren't just a nuisance.

Nevertheless, despite the lower catch rates, most products continued to do a good job of mitigating the spam problem. Fifteen out of 16 products achieved a VBSpam award in this test and four of them — Kaspersky, IBM, ESET and SpamTitan — achieved a VBSpam+ award for blocking more than 99.5% of spam, while blocking no legitimate emails and very few newsletters.

  The VBSpam quadrant sets the spam catch rate against the rate at which legitimate emails are being blocked. Click here for a larger version of the graph.

The full VBSpam report can be downloaded here in HTML-format or here as a PDF.

Are you providing an email security solution whose performance you'd like to be measured by Virus Bulletin? Do not hesitate to email VB Editor Martijn Grooten at martijn.grooten@virusbtn.com or check out the details of our consulting services.

Posted on 26 June 2015 by Martijn Grooten

twitter.png
fb.png
linkedin.png
hackernews.png
reddit.png

 

Latest posts:

VB2018 paper: From Hacking Team to hacked team to…?

Today we publish the VB2018 paper and video by ESET researcher Filip Kafka, who looked at the new malware by Hacking Team, after the company had recovered from the 2015 breach.

The spam that is hardest to block is often the most damaging

We see a lot of spam in the VBSpam test lab, and we also see how well such emails are being blocked by email security products. Worryingly, it is often the emails with a malicious attachment or a phishing link that are most likely to be missed.

Throwback Thursday: We're all doomed

Mydoom turns 15 this month, and is still being seen in email attachments. This Throwback Thursday we look back to March 2004, when Gabor Szappanos tracked the rise of W32/Mydoom.

VB2019 call for papers - now open!

Have you analysed a new online threat? Do you know a new way to defend against such threats? Are you tasked with securing systems and fending off attacks? The call for papers for VB2019 is now open and we want to hear from you!

VB2018 paper: Unpacking the packed unpacker: reversing an Android anti-analysis library

Today, we publish a VB2018 paper by Google researcher Maddie Stone in which she looks at one of the most interesting anti-analysis native libraries in the Android ecosystem. We also release the recording of Maddie's presentation.

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.