Domain Manage

Huge bandwidth jump

Discussion in 'Website Design' started by dw1973, Feb 17, 2009.

Thread Status:
Not open for further replies.
  1. dw1973

    dw1973 Active Member

    Joined:
    Jan 2009
    Posts:
    135
    Likes Received:
    2
    Hope someone can help me here.

    A website I made for a local business gets around 20-30 hits a day and has been using around 2gig of b/w per month for Nove/Dec/Jan as it's pretty image intensive.

    However, over the last 2 weeks, bandwidth usage has gone mad, peaking at 2gig a day but averaging 1.5gig but with no increase in visitor numbers. There's been no changes to the site in this time. Currently this month it's used 17gig!

    I suspect that someone is linking to the images from the site so I've added a .htaccess file to prevent this.

    But is there anyway I can find out if images have been linked and any other actions I can take?

    Thanks
     
    Last edited: Feb 17, 2009
  2. Domain Forum

    Acorn Domains Elite Member

    Joined:
    1999
    Messages:
    Many
    Likes Received:
    Lots
     
  3. admin Spain

    admin Administrator Staff Member

    Joined:
    Jun 2004
    Posts:
    10,084
    Likes Received:
    115
    Check your webstats!

    In doing this on occassion I have found someone has hacked into a site, but rather than deface my site, they add their own scripts and webpages for spamming / phishing.

    If you dont have a webstats program, use Google analytics.

    FTP into your site and sort the directories by date, check for any recently added that you don't recognise and see if there are loads of HTML pages added.

    Your web stats should also show you by IP address anything that is sucking bandwidth. Do a lookup on that IP and find out if it is a serach engine crawler or something else.

    If you aren't sure on all this, give me temporary access to your site and I will check it out for you.

    Admin
     
  4. DaveH United Kingdom

    DaveH Active Member

    Joined:
    Apr 2008
    Posts:
    593
    Likes Received:
    7
    Check lechers haven't hacked the site. Not so common now, but peopled use to share large files on exploited websites.
     
  5. dw1973

    dw1973 Active Member

    Joined:
    Jan 2009
    Posts:
    135
    Likes Received:
    2
    There's defintely nothing there that shouldn't be there but 13gig of b/w is going to the US.

    However, when looking at the webstats it gives me the top 25 hosts but then lists Others = 17gig and I can't find out how to drilldown into these. My server is using awstats.

    I have found one forum which was linking to an image but that is blocked now via .htaccess.

    Should I be adding an ignore to my robots.txt for google?
     
  6. Skinner

    Skinner Well-Known Member

    Joined:
    Jul 2008
    Posts:
    4,325
    Likes Received:
    81
    Could your host be counting email, ftp etc ?

    You could be being tagetted by his competition, an old school hack was to start an infinate loop downloading all the images on a site over and over to take down a site. The visitor number of uniques stays the same, so does the repeats as they *used* to track pages served not images, its only when you looked what % of the site was downloaded in images that you would notice millions of loads.

    Have you looked at the file types downloaded ?
     
  7. admin Spain

    admin Administrator Staff Member

    Joined:
    Jun 2004
    Posts:
    10,084
    Likes Received:
    115
  8. dw1973

    dw1973 Active Member

    Joined:
    Jan 2009
    Posts:
    135
    Likes Received:
    2
    Thanks for the help...

    Yes, and the majority IS images....83% of hits and 94% of bandwidth, but as it's a tattoo site the images are obviously important so I'd expect this to be high but this accounts for 16gig which is crazy...the biggest file is ~230K so this is the equivalent of 10,000 downloads a day!

    I have statcounter installed but realised I only have it on the index page so I'm including it on the other pages now.

    Since I added the .htaccess yesterday it seems to have calmed down a little but I've noticed a few hits coming in via google images. How does this work? Does google cache a version of your image or use your b/w?
     
  9. Jeewhizz

    Jeewhizz Well-Known Member

    Joined:
    May 2006
    Posts:
    1,177
    Likes Received:
    18
    Stat Counter won't detect if people are hotlinking your images...

    You really need to look at your site logs as provided by your host.
     
  10. Skinner

    Skinner Well-Known Member

    Joined:
    Jul 2008
    Posts:
    4,325
    Likes Received:
    81
    Poo situation...

    You either accept people will want to show your flash (art for people who don't do ink) off and allow hot linking or you simply block hotlinking full stop.

    If you look in awestats down near the bottom is a section called

    "Links from an external page (other web sites except search engines) - Full list"

    Click on Full List that will show you what sites are loading 1000s of images but no pages (pretty much hotlinkers).

    You may find your hosting someone elses website for them as they are just hotlinking all your flash.
     
  11. dw1973

    dw1973 Active Member

    Joined:
    Jan 2009
    Posts:
    135
    Likes Received:
    2
    Hmmm...since I added the statcounter code to all pages, the visitors for today has jumped from 4 to 49 in just over an hour.

    A LOT seem to be coming in via google images, which is nice as people obviously like the tats, but kind of crazy for a small tattoo shop on the outskirts of Bolton to be getting hits from Bombay, Adelaide, Croatia, Germany, Sweden, Slovakia and Romania

    I've also cut the quality of the big pictures (with little visible image quality loss) so that should help cut b/w down.
     
    Last edited: Feb 18, 2009
  12. Skinner

    Skinner Well-Known Member

    Joined:
    Jul 2008
    Posts:
    4,325
    Likes Received:
    81
    Have you considered GIFs or PNG 8's ?

    Flash shouldnt really need PNG24 or JPG kinda quality.
     
  13. dw1973

    dw1973 Active Member

    Joined:
    Jan 2009
    Posts:
    135
    Likes Received:
    2
    I did have gifs originally but the client didn't like the quality.

    As I wasn't expecting huge traffic on it, the big files weren't an issue until 2 weeks ago :roll:
     
  14. WeTalkBuiness

    WeTalkBuiness Member

    Joined:
    Jan 2009
    Posts:
    26
    Likes Received:
    0
    As the admin said your site might got hacked and/or suffers a DoS attack which hackers will throw you endless rubbish to your server and couldn't serve any webpages to your visitors eventually.
     
  15. dashu1 United Kingdom

    dashu1 Well-Known Member

    Joined:
    Nov 2008
    Posts:
    1,110
    Likes Received:
    14
    I have a few sites that see a large number of hits from Google Images, it takes google a bit longer to index them, but once it does it seems to be a very common way for people to find a website.

    If you try searching for tattoo designs or other search term in google images you'll probaby find that you're appearing on the first page of results now, hence the increase in hits.

    If it isn't doing anything for the business you should look in Googles Webmasters tools - I believe that you can unset the website from being included in google images, or you can do it in robots text, or both.

    User-agent: Googlebot-Image
    Disallow: /

    People are probably downloading the images & going to their local tatooist in Bombay or wherever - not so good for your customer in Bolton.
     
    Last edited: Feb 19, 2009
  16. dw1973

    dw1973 Active Member

    Joined:
    Jan 2009
    Posts:
    135
    Likes Received:
    2
    Never thought of google images being a way of getting more traffic but stats have certainly jumped in the past 2 weeks. 800 unique visitors yesterday, 566 so far today.

    I saw that in webmaster tools yesterday dashu1 but thanks anyway. The owner likes his extra traffic he's getting so I'm leaving it be for a little while, at least until it uses all my b/w allowance.

    Just need to find a way to monetise all those visits now :twisted:
     
  17. dashu1 United Kingdom

    dashu1 Well-Known Member

    Joined:
    Nov 2008
    Posts:
    1,110
    Likes Received:
    14
    Why doesn't he put the better quality images in a protected area with a taster image visible & have people pay to download the designs - if that's why they're coming to the site they must be willing to pay a few quid :D
     
  18. dw1973

    dw1973 Active Member

    Joined:
    Jan 2009
    Posts:
    135
    Likes Received:
    2
    It's an option, but I was thinking more of me making money, rather than him, although we could share I suppose ;)

    Plus I'd prefer something with less work involved :)
     
  19. dashu1 United Kingdom

    dashu1 Well-Known Member

    Joined:
    Nov 2008
    Posts:
    1,110
    Likes Received:
    14
    Thats always a good idea :D
     
  20. Skinner

    Skinner Well-Known Member

    Joined:
    Jul 2008
    Posts:
    4,325
    Likes Received:
    81
    how about adbrite pics ?

    Tell him its just a service to improve his site but generates you a revenue :)

    I told a few clients in return for me doing little tweaks and updates without charge, I wanna put some ad code on there :p
     
Thread Status:
Not open for further replies.

Share This Page