VBWeb review: Trustwave Secure Web Gateway

Martijn Grooten & Adrian Luca

Virus Bulletin

Copyright © Virus Bulletin 2016



Rig, Angler, Nuclear, Magnitude. Few people outside security circles will have heard of them, yet they are behind what is possibly the worst large-scale malware plague ever: encryption ransomware. In particular, these are exploit kits which, when embedded into websites (often through compromised ads), check your browser for vulnerabilities and exploit them to push malicious software onto your computer.

Indeed, when, during our tests, we made requests to websites serving exploit kits, we found our test machines infected with ransomware such as Locky, Teslacrypt and Cerber, as well as other kinds of malware, including Bedep and Zbot variants. Many individuals and organizations have found themselves infected with malware in this way, and many have ended up paying hefty ransoms to attackers to get their files back.


Nuclear traffic followed by Locky traffic.

Patching remains a great way to reduce the chances of being infected, but in decades of IT security we've learned that users often don't do what's best for them or their employer. As a result, many organizations rely on web security products that run on the gateway and filter web content for malicious responses.

In Virus Bulletin's VBWeb tests we measure how effective products are at blocking malicious web traffic. In this report we focus on one particular product: Trustwave's Secure Web Gateway.

The Test Methodology

During the test period, which ran from 1 to 11 April 2016, we used a number of public sources, combined with the results of our own research, to open URLs that we had reason to believe could serve a malicious response in one of our test browsers, selected at random. When our systems deemed the response likely enough to fit one of various definitions of 'malicious', we made the same request in the same browser a number of times, each time with one of the participating products in front of it. The traffic to the filters was replayed from our cache. Note that we did not need to know at this point whether the response was actually malicious, meaning that our test didn't depend on instances already known to the industry or community. During the review of the corpus days later, we analysed the responses and only included cases in which the traffic was indeed malicious.

While we registered various types of malicious responses, including spam/scam sites and phishing pages, we decided to concentrate only on drive-by downloads, where the URL was an HTML page that forced the browser to download and/or install malware in the background. This is by far the biggest threat at the moment and makes unprotected web browsing more dangerous than ever.

In this test, we checked products against 439 cases, including 105 drive-by downloads (exploit kits) and 100 direct malware downloads that were all served in real time, while the malicious server was live. We also checked the product against 234 URLs that we call 'potentially malicious'. These are URLs for which we have strong evidence that they would serve a malicious response in some cases, but they didn't when we requested it. There could be a number of reasons for this, from server‑side randomness to our test lab being detected by anti-analysis tools.

The test focused on unencrypted HTTP traffic. It did not look at very targeted attacks or vulnerabilities in the products themselves.

Test Machines

We used two virtual machines, selected at random, from which to make requests. On each machine, an available browser was also selected at random.

We found that, in practice, we were far more likely to receive a malicious response for the Windows 7 machine using either version of Internet Explorer, hence most of the cases that ended up in the test used this configuration.

Windows XP Service Pack 3 Home Edition 2002 (x86)

This machine had the following software installed:

  • Adobe Flash Player 12 Active X
  • Adobe Flash Player 12 plug-in
  • Adobe Reader XI
  • Apple Application Support 2.0.1
  • Apple QuickTime
  • Oracle Java 7 update 51 7.0.510
  • VLC media player 2.1.3

The following browsers were installed:

  • Windows Internet Explorer 8 (8.0.6001.18072)
  • Mozilla Firefox 28.0

Windows 7 Service Pack 1 Ultimate 2009 (x86)

This machine had the following software installed:

  • Adobe Flash Player 13 Active X
  • Adobe Flash Player 13 plug-in
  • Adobe Reader XI
  • Apple Application Support 2.0.1
  • Apple QuickTime
  • Piriform CCleaner 5.0.4
  • Oracle Java 7 update 51 7.0.510
  • Microsoft .NET framework 4.5.2 (
  • Microsoft Silverlight 5.1.10411.0
  • VLC media player 2.1.3

The following browsers were installed:

  • Windows Internet Explorer 11 (11.0.09600.17843 update 11.0.20)
  • Windows Internet Explorer 9 (9.0.8112.16421 update 9.0.37)
  • Mozilla Firefox 28.0

Trustwave Secure Web Gateway

Drive-by download rate: 95.2%
Potentially malicious rate: 95.3%


Trustwave is one of the industry leaders when it comes to web security. Indeed, Trustwave's SpiderLabs blog is one of the resources we turn to for the latest research on exploit kits, so we were expecting the company's Secure Web Gateway product to do a very good job at blocking these threats.

We were not disappointed. The appliance, set up as an explicit proxy in our test lab, blocked more than 95 per cent of exploit kits – and did equally well at blocking potentially malicious URLs proactively. Given how quickly exploit kits change, and how difficult it is for organizations to make sure all endpoints are fully patched, this is a big deal.

There are many things users can and should do to mitigate drive-by downloads, patching being the most important. But for those organizations that cannot trust their users always to follow best security practice (which is probably all organizations), Trustwave's Secure Web Gateway removes 95 per cent of drive-by downloads. And that makes a huge difference.

Of course, Trustwave earns a very well deserved VBWeb award for its performance.


Trustwave: excellent protection.

Download PDF



Latest reviews:

VB100 Comparative Review - February 2018

In the more than 20 years that Virus Bulletin’s anti-malware tests have been running, their primary aim has been to verify that products are able to keep up with the latest, confirmed threats. On this occasion, we were able to do this for no fewer…

VB100 Comparative Review - December 2017

At the end of this, the last VB100 test of 2017, 31 products from 27 vendors were able to add a VB100 award to their tallies.

VBSpam Comparative Review - December 2017

In the 50th VBSpam test, 14 full solutions were lined up on the Virus Bulletin test bench. No fewer than eight products achieved a VBSpam+ award, while five other products achieved a VBSpam award.

VBWeb comparative review Autumn 2017

In this VBWeb test, products blocked between 90 and 100 per cent of both exploit kits and direct malware downloads.

VB100 Comparative Review October 2017

In this month's VB100 test, we tested 32 products from 27 vendors, with some new names appearing in addition to many of the regular ones, showing that the anti-virus market remains very much alive. Twenty eight of the products achieved the VB100…