20i Reseller Hosting

Complete UK domain database 07-2016 to 09-2017 10 million+ IDEAS?

Discussion in 'Domain Research' started by aZooZa, Aug 21, 2018.

  1. aZooZa

    aZooZa Well-Known Member Exclusive Member

    Joined:
    Nov 2005
    Posts:
    4,831
    Likes Received:
    193
    UK domain database - 10,176,539 records, last updated ~14 months ago.

    Please see this for background: https://www.acorndomains.co.uk/threads/hubbard-media-announces-new-outbound-sales-system.149510/

    Here is the entry in archive.org (you might have to refresh a few times to get the full page): https://web.archive.org/web/20171020212517/http://domainoutbound.com/

    We thus have a wealth of data collated prior to GDPR coming into effect and wondering how best to make use of it and invite ideas. Please PM or email: mail@dalehubbard.com

    Also, if you're interested in creating a similar big data project of your own and would like some assistance in building it out, then please also get in contact via PM.

    Thanks!
     
    Last edited: Aug 22, 2018
  2. Domain Forum

    Acorn Domains Elite Member

    Joined:
    1999
    Messages:
    Many
    Likes Received:
    Lots
    articles.co.uk
     
  3. RobM

    RobM Retired Member

    Joined:
    Mar 2012
    Posts:
    3,289
    Likes Received:
    469
    As far as I know you can't use any of the information you may have gathered and, according to nominet, you weren't even supposed to store names and addresses even before.
     
  4. martin-s United Kingdom

    martin-s Well-Known Member

    Joined:
    Jul 2012
    Posts:
    3,353
    Likes Received:
    229
    Data gathered before GDPR is still subject to GDPR and so using the database for anything to do with email shouldn't really be a consideration. However, hostnames are not subject to anything and must have some potential value:
    • dropcatch lists
    • expired domain search
    • potential buyers
    • namespace stats
     
  5. RobM

    RobM Retired Member

    Joined:
    Mar 2012
    Posts:
    3,289
    Likes Received:
    469
    When compiling the lists nominet told me the only things I could store for duration of drop was the info we provide (they weren't even too happy about the tag). They also said I couldn't store data of renewed domains. Whois scrapes and storage of that information was a big no-no as it violates their tos.
     
  6. martin-s United Kingdom

    martin-s Well-Known Member

    Joined:
    Jul 2012
    Posts:
    3,353
    Likes Received:
    229
    Scraping is one thing, but anything in the zone file is presumably fair game?
     
  7. RobM

    RobM Retired Member

    Joined:
    Mar 2012
    Posts:
    3,289
    Likes Received:
    469
    The zone file doesn't (and didn't) contain any information that could be used to identify (and potentially contact) a domain owner. Anyway this is a moot point - the OP has data already. Just he may be opening himself up to potential nominet issues if any data was taken from whois and stored. Also I don't know how strongly gdpr is enforced or if it covers this but they seem very nasty with fines for data breaches.
     
  8. Trauiner United Kingdom

    Trauiner Active Member

    Joined:
    Feb 2016
    Posts:
    338
    Likes Received:
    29
    As some else stated, just because you collected the data before GDPR came into effect, doesn't change anything.

    You can not use any information that relates to any personal identifying information.

    Your options are limited to things like it being useful to see what domains are going to be dropping etc.
     
    Last edited: Aug 22, 2018
  9. aZooZa

    aZooZa Well-Known Member Exclusive Member

    Joined:
    Nov 2005
    Posts:
    4,831
    Likes Received:
    193
  10. 4ndy

    4ndy Active Member

    Joined:
    Oct 2007
    Posts:
    103
    Likes Received:
    12
    I have whowas.co.uk