It's 2016. Can we stop using MD5 in malware analyses?

Posted by   Martijn Grooten on   Jul 26, 2016

When a security researcher comes across a new piece of malware, the first thing he (or she) does is check the file hash to see if it has been seen, or maybe even analysed, before. For that reason, if the researcher does end up writing an analysis, it is considered good practice to add the hashes of the analysed samples to the report.

It is still fairly common for these hashes to be generated using the MD5 algorithm, which is odd given that it was officially broken in 2004, when a collision was found. Since then, it has been broken a lot further, and in 2012 it was found that the Flame malware exploited weaknesses in MD5 to create a fake certificate to sign updates supposedly coming from Microsoft.

In recent months I have given a number of presentations on the exploitability of weaknesses in cryptographic protocols, my conclusion being that, while we should stop using weak protocols, the risks vary from small to negligible.

This is also true when it comes to using MD5 hashes in malware analyses. Firstly, to create another file with the same hash as a given piece of malware is not a trivial task, to put it mildly. And secondly, the harm someone with this power could do would likely be restricted to creating some frustration.

Still, there is a strong argument as to why using MD5 is bad even in this case: it reinforces bad practices. Some security products still use MD5 internally, and there have been reported cases of products using MD5 hashes to whitelist previously analysed suspicious files. Given that it would be feasible to create two executables, one malicious and the other harmless, with the same MD5 hash, an attacker could send the harmless file to such a product first and then take advantage of the whitelisting to get a free pass for the malicious file.

So let's just stop using MD5 everywhere. And, while we're at it, do the same with SHA-1, a collision for which is expected to be found this year, and skip straight to SHA-256.

Finally, if you're worried that your Tweets will be too long if you use SHA-256 hashes to refer to malware samples, use a link to the file's report on VirusTotal or instead, which takes up fewer characters than even MD5. Or, if you really want to, find a way to encode SHA-256 hashes into emojis.




Latest posts:

Mostly blocked, but still good enough: Necurs sending pump-and-dump spam

The Necurs botnet has started sending pump-and-dump spam. Almost all of these emails are blocked by spam filters, yet the stock price still increased.

Why the SHA-1 collision means you should stop using the algorithm

Realistically speaking, if your software or system uses the SHA-1 hashing algorithm, it is unlikely that it will be exploited in the foreseeable future. But it is also extremely difficult to be certain that your system won't be the exception.

VB2017 Call for Papers: frequently asked questions

The call for papers for VB2017, which takes place 4 to 6 October in Madrid, Spain, is currently open. We're always on the look out for new speakers and new content, so to help anyone who's unfamiliar with the VB conference, we've prepared a list of…

Throwback Thursday: Michelangelo - Graffiti Not Art

This week marked the 25th anniversary of the trigger date of the infamous Michelangelo virus. In January 1992, VB published an analysis of the boot sector virus that captured the imagination of the press and kicked up a media storm.

How are you defending your network? Come and tell us at VB2017!

Is it your job to defend your company’s network? Are you defending a government’s systems? Do you help secure the devices used by activists operating in less open societies? Do you work with abuse victims targeted by spyware? Share your experiences…