drop list

[buttontop]

places that offer drop lists for a given day (domainlore, dacr.co.uk) they ahve between 700-1000 domains dropping most days, how many domains do you think they would have in the whole list? 3-4 million? lore only offer .co.uk domains but as a whole how big do you think you list would need to be to produce 700+ domains a day dropping?

i understand that it does depend on how the list is complied, as in it if you were looking for a high amount of drops then it would be easier to produce than a list of mixed (such as provided by lore and dacr) that go back many many years (so we are looking for a cross section, and not putting a value of the domains to see if you really want to reg them again.

so in short the question is, how many domains are in the complete list if the average day dropping rate is around 700?

Thanks

 

[Skinner]

The laws of maths 7-8m names, divided by 730 (2 years), shows 10-11k names expire every day, nominets intel (http://www.nominet.org.uk/intelligence/statistics/renewals/) shows 70% Renewals on average, so 3,000 a day average.

You'll note the above link shows 100,000 drops in October 2009 (julys exp). I'm there are other factors but the numbers show that.

 

[buttontop]

if 100,000 drop in any given month then thats about 3225 domains a day, so (not knocking the free service) but a list of 750 domains is only about 25% of any days given drops? whats the best provider of lists out there that gives the most drops without paying? and with paying?



so would it be a very rough guess to say that lore has a list of about 2m domains (saying that there list is about 25% of the domains that drop in a given day so would stand about 25% of the total domains of about 8m=2m)

anyone got more ideas?

 

[retired_member12]

if 100,000 drop in any given month then thats about 3225 domains a day, so (not knocking the free service) but a list of 750 domains is only about 25% of any days given drops? whats the best provider of lists out there that gives the most drops without paying? and with paying?



so would it be a very rough guess to say that lore has a list of about 2m domains (saying that there list is about 25% of the domains that drop in a given day so would stand about 25% of the total domains of about 8m=2m)

anyone got more ideas?

Well, for a start, you need to factor in that Domainlore only lists co.uk. There are the org.uks' and me.uks too. Yes, lower quantities of total registered compared to the co.uk, but a higher percentage churn i imagine.

 

[Rob_F]

Dropsystem's lists are the largest that I know of. Their database covers 6 mil + domains I believe - you might want to confirm that with Dale.

- Rob

 

[Skinner]

There are very limited numbers of list providers because its not worth the hassle for most people.

To be clear, no one has a complete list, so shy of building your own and hunting the scraps down, your stuck with 25-50% of the list.

Building your own with a tag and dac, would take roughly 2 years or scanning so would be out of date before you finished, you could maybe cut it to 12-18 months with delayed dac usage, but thats as good as it gets.

Oh yeah Nominet say NO ONE can sell you more than 1,000 names per day, so you will never get more than 30-50% of the list per day.

 

[foz]

Even if drop list providers could determine precisely what was dropping, I don't think the quality of the lists would improve much. Theirs a lot of garbage no provider could ever ascertain for.

 

[buttontop]

Building your own with a tag and dac, would take roughly 2 years or scanning so would be out of date before you finished, you could maybe cut it to 12-18 months with delayed dac usage, but thats as good as it gets.

is that by checking every combo (aaa, aab,aac...) or somethine else? just when you said about the time i thought you might have a method in mind?

Dropsystem's lists are the largest that I know of. Their database covers 6 mil + domains I believe - you might want to confirm that with Dale.

well er wow, didnt think that anyone would have over a couple of million but that is truly amazing. any ideas on how long it took him to make that? does he sell the list daily/weekly/monthly? once x number of domains have dropped how do you refresh the list with new domains, once you had gotten to a database of over 6 million you would feel quite happy the job is done kinda thing? - o a small question kinda off the subject - how does his computer handle having a database of 6m domains? mine goes kinda slow (takes 3 secs to run line) with 750000 entrys in and sql database, just wondered if there was something im missing? i my computer is mid range - has he set a computer to sql server in the settings?

Even if drop list providers could determine precisely what was dropping, I don't think the quality of the lists would improve much. Theirs a lot of garbage no provider could ever ascertain for.

i totaly agree, im sure it will turn out that the last 25% that is often not searched is so rubbish that its not really worth having on any list (however you dont know that till you have looked at it).

 

[Skinner]

I posted my method in your other post, its based on the .com zone file of 80m domains, which would cover about 97% of all .co.uk names. I say 97% of all names because I have found various names where the .co.uk is taken but the .com isn't.

I have a database running mysql with 5,756,485 records and it runs a select * (Showing rows 0 - 29 (5,756,485 total, Query took 0.0009 sec) pretty quickly. When I run a join with a %like% search, it slows a fair bit (Showing rows 0 - 29 (1,023,626 total, Query took 0.4805 sec). I don't normally output to screen, I usually output a downloadable text file, I suspect thats where your speed issue is.

 

[stevebrowne]

I grabbed the zonefile recently to do the same; it's now over 85m.

Is your list of 5.7m names that exist as .co.uk or names from the zonefile that you have checked, with some registered and others not?

I have a DB of 5.5m at the moment, with 1.7m being valid .co.uks

80m left to check...

 

[Skinner]

Sorry, my bad.

The list I have ISN'T domain names, its the table from iphotohost that tracks the hits, referer, ip and bandwidth usage, almost 2gb database. It was for an answer to his question, more than a contribution