Complete UK domain database 07-2016 to 09-2017 10 million+ IDEAS?

aZooZa · Aug 21, 2018

UK domain database - 10,176,539 records, last updated ~14 months ago.

Please see this for background: https://www.acorndomains.co.uk/threads/hubbard-media-announces-new-outbound-sales-system.149510/

Here is the entry in archive.org (you might have to refresh a few times to get the full page): https://web.archive.org/web/20171020212517/http://domainoutbound.com/

We thus have a wealth of data collated prior to GDPR coming into effect and wondering how best to make use of it and invite ideas. Please PM or email: [email protected]

Also, if you're interested in creating a similar big data project of your own and would like some assistance in building it out, then please also get in contact via PM.

Thanks!

RobM · Aug 21, 2018

As far as I know you can't use any of the information you may have gathered and, according to nominet, you weren't even supposed to store names and addresses even before.

martin-s · Aug 21, 2018

Data gathered before GDPR is still subject to GDPR and so using the database for anything to do with email shouldn't really be a consideration. However, hostnames are not subject to anything and must have some potential value:

dropcatch lists
expired domain search
potential buyers
namespace stats

RobM · Aug 21, 2018

When compiling the lists nominet told me the only things I could store for duration of drop was the info we provide (they weren't even too happy about the tag). They also said I couldn't store data of renewed domains. Whois scrapes and storage of that information was a big no-no as it violates their tos.

martin-s · Aug 21, 2018

Scraping is one thing, but anything in the zone file is presumably fair game?

RobM · Aug 21, 2018

The zone file doesn't (and didn't) contain any information that could be used to identify (and potentially contact) a domain owner. Anyway this is a moot point - the OP has data already. Just he may be opening himself up to potential nominet issues if any data was taken from whois and stored. Also I don't know how strongly gdpr is enforced or if it covers this but they seem very nasty with fines for data breaches.