It's 2016. Can we stop using MD5 in malware analyses?

Posted by   Martijn Grooten on   Jul 26, 2016

When a security researcher comes across a new piece of malware, the first thing he (or she) does is check the file hash to see if it has been seen, or maybe even analysed, before. For that reason, if the researcher does end up writing an analysis, it is considered good practice to add the hashes of the analysed samples to the report.

It is still fairly common for these hashes to be generated using the MD5 algorithm, which is odd given that it was officially broken in 2004, when a collision was found. Since then, it has been broken a lot further, and in 2012 it was found that the Flame malware exploited weaknesses in MD5 to create a fake certificate to sign updates supposedly coming from Microsoft.

In recent months I have given a number of presentations on the exploitability of weaknesses in cryptographic protocols, my conclusion being that, while we should stop using weak protocols, the risks vary from small to negligible.

This is also true when it comes to using MD5 hashes in malware analyses. Firstly, to create another file with the same hash as a given piece of malware is not a trivial task, to put it mildly. And secondly, the harm someone with this power could do would likely be restricted to creating some frustration.

Still, there is a strong argument as to why using MD5 is bad even in this case: it reinforces bad practices. Some security products still use MD5 internally, and there have been reported cases of products using MD5 hashes to whitelist previously analysed suspicious files. Given that it would be feasible to create two executables, one malicious and the other harmless, with the same MD5 hash, an attacker could send the harmless file to such a product first and then take advantage of the whitelisting to get a free pass for the malicious file.

So let's just stop using MD5 everywhere. And, while we're at it, do the same with SHA-1, a collision for which is expected to be found this year, and skip straight to SHA-256.

Finally, if you're worried that your Tweets will be too long if you use SHA-256 hashes to refer to malware samples, use a link to the file's report on VirusTotal or instead, which takes up fewer characters than even MD5. Or, if you really want to, find a way to encode SHA-256 hashes into emojis.




Latest posts:

A crime against statistics that is probably worse than the cyber attacks faced in County Durham

A report on the number of cyber attacks faced by UK local authorities is a good example of how the large numbers seen in many reports on security are rather meaningless.

NCSC gives important advice on lateral movement

The UK's National Cyber Security Centre (NCSC) has provided helpful and practical advice on preventing and detecting lateral movement by an attacker within a network.

What kind of people attend Virus Bulletin conferences?

If you are considering submitting a proposal for a talk to VB2018 and you're not familiar with the event, you may find it useful to know what kind of people attend the conference.

Olympic Games target of malware, again

An unattributed malware attack has disrupted some computer systems of the 2018 Winter Olympics. In 1994, a computer virus also targeted the Winter Olympics.

There are lessons to be learned from government websites serving cryptocurrency miners

Thousands of websites, including many sites of government organisations in the UK, the US and Sweden, were recently found to have been serving a cryptocurrency miner. More interesting than the incident itself, though, are the lessons that can be…