Full house in VB's latest spam filter test

Posted by   Virus Bulletin on   Nov 5, 2015

All participating full solutions earn VBSpam certification, while little delay is observed in spam filters.

There is good news for those who rely on spam filters — which means everyone who uses email — as for the first time since July 2014, all participating full anti-spam solutions achieved a VBSpam award in VB's latest comparative spam filter tests.

Moreover, with an average spam catch rate of 99.84%, we can see that the spam problem continues to be very well mitigated.

Five solutions — Bitdefender, IBM, Libra Esva, OnlyMyEmail and SpamTitan — earned a VBSpam+ award for blocking more than 99.5% of spam, while blocking no legitimate emails and very few newsletters.

The VBSpam report can be downloaded here in HTML-format or here as a PDF.

Speed of filtering

Spam filtering happens almost entirely reactively: emails are blocked because they look like previously sent spam, because they are sent from IP addresses that have sent spam, because they contain links to known spam sites, or because they have other characteristics previously seen in spam. Often, rules for blocking spam are added automatically, based on end-user reports and detections by spam traps.

Therefore, a spam filter could artificially improve its performance by holding onto emails until rules have been updated, thus being able to catch more spam. As email is expected to work in real time, few people would want to use a mail server that adds significant delay to the delivery of emails.

Although in our tests we have always made sure no product 'cheated' in this way, we have decided to start publishing the details of how long it takes each product to filter legitimate emails. For each product we ordered the legitimate emails by the time it took for them to be returned to us and showed whether the delay for the emails at the 10th, 50th, 95th and 98th percentiles was less than 30 seconds (green), less than 2 minutes (yellow), less than ten minutes (orange) or more than ten minutes (red).

As one can see, the table is mostly green, with only some small delays added by some products due to a small minority of issues. Although ideally all emails are returned immediately, we believe these small delays are not especially worrying as they may be caused by external factors.



Posted on 05 November 2015 by Martijn Grooten

twitter.png
fb.png
linkedin.png
hackernews.png
reddit.png

 

Latest posts:

VB2019 paper: APT cases exploiting vulnerabilities in region-specific software

At VB2019, JPCERT/CC's Shusei Tomonaga and Tomoaki Tani presented a paper on attacks that exploit vulnerabilities in software used only in Japan, using malware that is unique to Japan. Today we publish both their paper and the recording of their…

New paper: Detection of vulnerabilities in web applications by validating parameter integrity and data flow graphs

In a follow-up to a paper presented at VB2019, Prismo Systems researchers Abhishek Singh and Ramesh Mani detail algorithms that can be used to detect SQL injection in stored procedures, persistent cross-site scripting (XSS), and server‑side request…

VB2020 programme announced

VB is pleased to reveal the details of an interesting and diverse programme for VB2020, the 30th Virus Bulletin International Conference.

VB2019 paper: Cyber espionage in the Middle East: unravelling OSX.WindTail

At VB2019 in London, Jamf's Patrick Wardle analysed the WindTail macOS malware used by the WindShift APT group, active in the Middle East. Today we publish both Patrick's paper and the recording of his presentation.

VB2019 paper: 2,000 reactions to a malware attack – accidental study

At VB2019 cybercrime journalist and researcher Adam Haertlé presented an analysis of almost 2000 unsolicited responses sent by victims of a malicious email campaign. Today we publish both his paper and the recording of his presentation.

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.