Mike Arrington raises an interesting dilemma on Crunchnotes: when he features a site on TechCrunch, often times the site ends up crashing due to the overwhelming load of traffic that gets sent its way. Its a lose-lose situation as since TechCrunch would clearly like people to see what their review or piece of news is about, while the startup in question would clearly like the exposure that TechCrunch brings.
And neither gets to see the benefit of it really happening as the site goes down.
Case in point: Spotplex, which went down faster than wunderbed in a fistfight after it got some TechCrunch love.
Funny thing is that getting highlighted by influencers on the web isn’t a new thing, nor is it going to go away. Sites which act like traffic funnels for thousands, if not millions of people, will continue to direct traffic to unsuspecting sites. Sure there’s TechCrunch, but what about Seth Godin’s blog? Digg? Slashdot? The New York Times? StumbleUpon?
I think it poses a particularly interesting quandry to startups, however. While we would all *like* a giant surge in traffic for the benefit of bragging rights, a little bit of adsense income, and possibly an increase in retained traffic, many startups depend on any free publicity that comes their way.
Sure, I think they’d all like the slow (or rapid) organic growth that accrues over time — but for many of them that are operating on shoestring (or, no-string) budgets and minimal personnel, getting featured isn’t just a question of “that would be nice if … “, but rather “that might be the break we need if only — “.
Startups need to be able to handle the traffic loads at any one time if they’re serious about their web application, because these kinds of events are tremendous opportunities for free publicity and need to be managed as such.
Some of the Mike’s readers have made a few suggestions as to the solution:
- Letting startups know ahead of time when they might get TechCrunched
- TechCrunch should start a mirror service for their startups
- TechCrunch should have a “minor league” blog to feature beta’s
- There should be screencasts of featured sites instead
These are all fine in their own way, but I really think that startups should try and find a solution themselves; after all, the onus isn’t on any one influencer to try and protect the sites they link *to* (although its in their best interests for it to be up), simply because a web app startup can’t always predict *who* is going to be linking to it.
On the other hand, I’m not qualified to make any kind of technical suggestions as how to manage scalable dynamic hosting in an easy and economic fashion — but a one suggestion did come to mind.
I wonder, speaking of startups, if this is something a “startup” could even work on – providing highly scalable hosting solutions mini- or micro- web applications in a typical low-cost web2.0 fashion, with higher fees kicking in when these applications “make” it to the big time. It would be a numbers game of course, with a tiny sliver of startups actually getting big enough to pay for the rest, but perhaps the challenge is just big enough to represent a great opportunity. And there’s certainly enough interest in the current Web2.0 boom for such a “meta-” company to find enough real takers amongst the tire kickers.
And if it works out, don’t be afraid to let everyone know you heard it on DJI first. ;)

6 Comments
Hi Tony,
You might want to check out Amazon S3 and EC2.
I think they provide the service you suggested.
yeah, was thinking of s3 as well.
Yup, that’s exactly what S3 is for.
Startups should be using it to provide scalable applications.
Shared web farm hosting would be my preference. I know one .net host that does load balanced shared hosting, there must be hosts that do it for other platforms?
“that would be nice if “…lol that was good.Haha .
Ok serious thoughts are you always need something that can give you a sudden push, It takes time for new people to get into limelight.I agree the TC and Digg love can rip off any site (It did mine two days back and my host was on my head when i got digg love) but then you have an advantage….
VPS is a good option if you cant go for dedicated
Arrington is welcome to load-test my site any time he wants.
Mouahahaha. I should be so lucky.
I have been trying that with Digg lately, but I fear there is some kind of “auto-bury” feature over there as regards anything I blog about.
Bummer. It will just have to be about A1 content then!!
- Alister
3 Trackbacks
[...] There has been a couple of suggestions from readers about the first problem, and they’re nicely rounded up over at Deep Jive Interests. However, my suggestion to Mike is that he hires an expert on web-hosting to write a guest post which would explain what exactly startups must do in order to avoid downtime due to traffic surges. It might seem simple, and it is quite trivial for simple sites like this one: it’s just a matter of getting good hosting. But for fairly complex services with AJAX, Flash, lots of user requests and database queries and whatnot, an expert’s opinion might prove very valuable, and if it’s present on TechCrunch, startups will definitely notice and hopefully act accordingly. Techcrunch launches CrunchForumsGeni raises $10 million in fundingFOWA news roundupWhen blogging becomes business – Techcrunch UK on holdNing, the meta-MySpace, relaunches [...]
[...] When it comes to social networking, when is a linkback not always in the best interest of your site? DeepJiveInterests takes a look at the lose-lose situation of Startups Dealing with Getting Crunched, Dugg, Slashdotted, and Redd(ited). While obviously a new site is dying for some love from these big players, it may be all for nothing if their sites can’t stand up to the influx of new traffic. [...]
[...] in the best interest of your site? DeepJiveInterests takes a look at the lose-lose situation of Startups Dealing with Getting Crunched, Dugg, Slashdotted, and Redd(ited). While obviously a new site is dying for some love from these big players, it may be all for [...]