Twitter using BitTorrent on the Backend

Anyone who has the battle scars that come from managing a large operational set of computers, like a large popular web site, knows all too well the challenge of deploying a new image site-wide.  Often times, this needs to happen fast (think emergency patch) and as with so many other applications on the network, the traditional client-server model breaks down at scale in the face of this challenge.

But now there is an interesting open source project from Twitter that might bring some relief to this particular problem.  The project uses BitTorrent technology and is called  Murder (per the project page, a “murder” allegedly describes a flock of crows, not some lesser crime than the accusations too-often leveled against the hard-working engineers at BitTorrent, Inc).  The distributed nature of BitTorrent means an operation that once took many dozens of minutes, now happens in less than a dozen seconds.  These efficiencies will reduce maintenance windows, site downtime and exposure to security vulnerabilities.

The folks at Twitter will be disclosing more about the project and the performance of this solution in the coming weeks.  We are thrilled to collaborate with them on this and hope that more Web Monsters out there look to this and other applications of BitTorrent in solving some of the hard problems of the Internet.

–Eric–

11 Comments

  1. Wow
    Posted February 10, 2010 at 10:59 am | Permalink | Reply

    What a waste of bandwidth. Ever heard of multicast?

    http://freshmeat.net/projects/flamethrower/

  2. Posted June 10, 2010 at 11:17 am | Permalink | Reply

    That is really interesting.

  3. fweoij
    Posted July 15, 2010 at 2:38 pm | Permalink | Reply

    Seriously, how is this better than multicast? Multicast ip’s are dedicated to multicast, so you dont ever have to use a tracker or need to know who your peers are… you just start casting on the ip and those who are listening to that ip start receiving.

  4. Posted August 4, 2010 at 3:41 pm | Permalink | Reply

    This is interesting. Is this going to be tied in with Twitter somehow?

  5. Posted September 7, 2010 at 1:46 pm | Permalink | Reply

    bit torrent is one of the greatest programs written in my opinion.

  6. Posted September 13, 2010 at 11:45 pm | Permalink | Reply

    I haven’t heard about Twitter using bittorent before. I can’t believe I missed hearing that.

  7. Posted September 14, 2010 at 4:31 am | Permalink | Reply

    That is really interesting.

  8. Posted September 26, 2010 at 8:46 am | Permalink | Reply

    I love the evolution of the Internet. It is nice to see a powerhouse company being able to test new technology that makes things easier.

  9. Posted March 17, 2011 at 1:56 pm | Permalink | Reply

    Intriguing, did you know that your rss function appears to be broken? Could be on my side though…

  10. Posted March 19, 2011 at 4:23 pm | Permalink | Reply

    Interesting, Didnt know this. Btw its a very catchy name of the technology

11 Trackbacks

  1. […] BitTorrent Inc. freut sich schon jetzt auf die neue Kooperation. Im Unternehmens-Blog schreibt der Chef Eric Klinker: “Das Verteilungsprinzip von BitTorrent kann bewirken, dass […]

  2. […] harnesses Bittorrent technology to deploy server updates across it’s vast network.In a blog post written by Bittorrent CEO Eric Klimker, it has emerged that the microblogging site has crafted […]

  3. […] Eric Klinker, CEO of BitTorrent Inc. is excited about Twitter’s adoption of BitTorrent. “We are thrilled to collaborate with them on this and hope that more Web Monsters out there look to this and other applications of BitTorrent in solving some of the hard problems of the Internet,” he said. […]

  4. […] Eric Klinker, CEO of BitTorrent Inc. is excited about Twitter’s adoption of BitTorrent. “We are thrilled to collaborate with them on this and hope that more Web Monsters out there look to this and other applications of BitTorrent in solving some of the hard problems of the Internet,” he said. […]

  5. […] cargo de este proyecto estara Larry Gadea. Ha generado mucha expectativa este proyecto dentro la comunidad Bittorrent principalmente por que a este protocolo últimamente lo rodea mucha […]

  6. […] Eric Klinker, CEO of BitTorrent Inc. is excited about Twitter’s adoption of BitTorrent. “We are thrilled to collaborate with them on this and hope that more Web Monsters out there look to this and other applications of BitTorrent in solving some of the hard problems of the Internet,” he said. […]

  7. […] auf Produktivsystemen Soeben durfte ich bei Torrentfreak lesen, dass Twitter mit Bittorrent kooperieren […]

  8. […] Eric Klinker, CEO of BitTorrent Inc. is excited about Twitter’s adoption of BitTorrent. “We are thrilled to collaborate with them on this and hope that more Web Monsters out there look to this and other applications of BitTorrent in solving some of the hard problems of the Internet,” he said. […]

  9. […] Eric Klinker, CEO of BitTorrent Inc. is excited about Twitter’s adoption of BitTorrent. “We are thrilled to collaborate with them on this and hope that more Web Monsters out there look to this and other applications of BitTorrent in solving some of the hard problems of the Internet,” he said. […]

  10. […] la elección del protocolo de intercambio de BitTorrent, se ha llevado a cabo el proyecto Murder -anunciado el pasado mes de febrero-, consiguiendo que un proceso que antes duraba 40 minutos dure 12 […]

  11. […] Eric Klinker, CEO of BitTorrent Inc. is excited about Twitter’s adoption of BitTorrent. “We are thrilled to collaborate with them on this and hope that more Web Monsters out there look to this and other applications of BitTorrent in solving some of the hard problems of the Internet,” he said. […]

Post a Comment

Required fields are marked *

*
*

%d bloggers like this: