Twitter Connects Popular Twitter Users to Twitter Problems

Bloggers are discussing Twitter developer Alex Payne's recent comment that Twitter is hit the hardest when popular Twitter users "perform a number of actions in rapid succession."

Payne wrote, "The events that hit our system the hardest are generally when "popular" users - that is, users with large numbers of followers and people they're following - perform a number of actions in rapid succession. This usually results in a number of big queries that pile up in our database(s). Not running scripts to follow thousands of users at a time would be a help, but that's behavior we have to limit on our side."

Robert Scoble seems to think that Twitter is blaming him. It isn't clear that Twitter is signaling him out or anyone else. It sounds more like they were just being honest and saying this is how and where Twitter sometimes starts to become overloaded. (By the way here's a good list of several things that might really be Scoble's fault.)

While Robert Scoble does have a huge number of followers he isn't the most followed on Twitter. Leo Laporte, Kevin Rose and Barack Obama each have far more followers than Robert Scoble according to Twitterholic. Of these three Barack Obama is the only one also following a huge number of people back because his Twitter account uses auto-follow.

Farther down on the list are heavy users like Guy Kawasaki and Chris Pirillo who have about 12,000 to 13,000 followers. My Twitter is a little farther down from them with about 10,500 followers. If they are heavy users then I am too. I do tweet less often than Guy Kawasaki and Chris Pirillo and I tweet much less frequently than Robert Scoble does. I currently have 1,700 updates while Robert Scoble has over 12,000.

Whether a popular Twitter user has 1,000 or 12,000 updates Twitter should be able to handle them and whatever richochet effect they have on Twitter's service. If they can't handle something Robert Scoble or Leo Laporte have to say to their numerous followers then they won't be able to stay up the next time there is a big breaking news event either.

Twitter's Alex Payne also said that they will be adding new limits on what Twitter users can do. Payne says, "Chris Kilmer and Tembrooke both ask if putting some limits on what users can do in our system would help, and they're both right. We have some limits, and we're adding more. Legitimate users should never notice them, but these new limits should help mitigate the worst case failures and attacks."

Some people are suggesting ways Twitter could try and reduce the number of tweets. Here are few methods. The above measures might all help reduce tweets but that doesn't mean they should be implemented. Twitter has to be careful and find ways that reduce tweets that won't upset its users. It would be best if Twitter would be able to continue to grow without any new restrictions but its obvious they have been having serious growing pains and server issues. Implementing some of these measures could give them more time to add solutions that give them greater tweet capacity. It will be interesting to see what Twitter does next.

Posted on May 30, 2008

More from Bloggers Blog