Load balancer upgrade scheduled Wednesday, Dec 8, 2am GMT for up to one hour

By on December 6, 2010

Bitbucket will be unavailable for up to one hour starting Wednesday, Dec 8th, 02:00 GMT while we upgrade our application architecture for high-availability and fail-over. We expect the downtime not to exceed one hour.

During this maintenance window we’ll deploy two new HAProxy load balancers clustered with Heartbeat. As it stands now we’re load balancing with Apache’s mod_rewrite RewriteMap feature. Repositories are statically distributed across our application servers. If your assigned server has any critical failures, we’re unable to redirect traffic to another server. Luckily that hasn’t happened often since migrating Bitbucket from EC2 to Contegix. With the new application architecture repositories will no longer be bound to a specific server. Should one of our application servers crash, one of the others in the load balancer pool will pick up the slack.

If you check out the footer on any Bitbucket repository page you can see it’s bound to a particular server:

After this change our new load balancers will pass requests to our application servers with the fewest connections and least load instead of a static mapping. In the footer you’ll see different servers handling your repository requests. An added benefit we’re looking forward to is the ability to remove our application servers from the load balancer pool without taking your repositories offline. Overall this will make Bitbucket more reliable and ensure less scheduled maintenance and downtime.

  • http://syhrsg.tumblr.com/me syhr_sg

    (The image isn't visible here – the URL points to a login page.)

    Hooray for less downtime!

  • http://syhrsg.tumblr.com/me syhr_sg

    (The image isn’t visible here – the URL points to a login page.)

    Hooray for less downtime!

  • http://syhrsg.tumblr.com/me syhr_sg

    (The image isn’t visible here – the URL points to a login page.)

    Hooray for less downtime!

  • http://sn.im/ur6lad UR6LAD

    <some sitename here>.bitbucket.org – 404

  • http://sn.im/ur6lad UR6LAD

    <some sitename here>.bitbucket.org – 404

  • http://sn.im/ur6lad UR6LAD

    <some sitename here>.bitbucket.org – 404

    • http://sn.im/ur6lad UR6LAD
      • Charles McLaughlin

        Thanks for pointing this out. We put a temporary redirect in place:

        your_login.bitbucket.org will redirect to bitbucket.org/hosted/your_login

        We’ll restore the true functionality ASAP.

        • Charles McLaughlin

          This was fixed this morning.

  • Shrawan Patel

    This post excellently highlights what the author is trying to communicate. Nonetheless, the article has been framed excellently well and all credits to the author. For more information on how to load balance your web servers, please visit ..nhttp://serverloadbalancing.biz/wordpressbiz/, nhttp://serverloadbalancing.info/wordpressinfo/

  • http://profile.yahoo.com/SM3VILCLYYU4GUKRUHLAJ3FD4U Highwayman Walls

    Thanks for informing us on this! I’ll use the redirect then. Can’t wait to start using this update! It’s most likely to become a much better tool.

    Convert m4a to mp3 http://m4atomp3converter.org

  • Charles McLaughlin

    Thanks for pointing this out. We put a temporary redirect in place:

    your_username.bitbucket.org will redirect to bitbucket.org/hosted/your_username

    We’ll restore the true functionality ASAP.

  • mclaughlinct

    Thanks for pointing this out. We put a temporary redirect in place:

    your_login.bitbucket.org will redirect to bitbucket.org/hosted/your_logi…

    We'll restore the true functionality ASAP.

  • http://sn.im/ur6lad UR6LAD
  • http://sn.im/ur6lad UR6LAD
  • Anonymous

    Thanks for pointing this out. We put a temporary redirect in place:

    your_login.bitbucket.org will redirect to bitbucket.org/hosted/your_login

    We’ll restore the true functionality ASAP.

  • Charles McLaughlin

    This was fixed this morning.

  • Charles McLaughlin

    This was fixed this morning.