Scheduled Maintenance Notice, January 22nd at 10PM CST

Posted by Torhal Jan 21, 2014 at 19:59 UTC

On January 22nd, at 10pm CST, we will be performing scheduled maintenance on the site an estimated downtime of no longer than an hour.

  1. 4 comments

Store Offline for Maintenance

Posted by prencher Oct 09, 2013 at 18:43 UTC

Hi all,

We've taken the store offline for maintenance. Don't worry, this has no effect on your points or your orders. It will be back online later today.

Subversion Rollbacks for a Subset of Repositories

Posted by prencher Nov 07, 2012 at 18:32 UTC

Due to some unforseen complications during a routine maintenance, we've had to temporarily disable access to subversion repositories in order to do rollbacks on a subset of repositories.

Update 12:42am CST / 06:42 UTC:

All affected repositories have been restored to their latest backups from this sunday and access to repositories have been restored. Unfortunately, that is the most recent backup we have where we know the issue not to be present. All affected repositories have had their UUID changed, so you will have to do a fresh checkout. This was done to prevent any corruption of server side repositories, due to limitations in how svn handles revisions.

The easiest way to restore any commits made since sunday is take your old checkout, remove the .svn folder(s) and copy it on top of the fresh checkout, and then commit it.

We're very sorry about this situation, and are still investigating what went wrong during the maintenance to cause this.

  1. 3 comments

Server Migration Complete

Posted by Kaelten Oct 05, 2010 at 21:43 UTC

Hey Guys,

I know that I stopped updating a few days ago when things started slowing down, so I wanted to officially say that the transition is done and that all services are online in our new datacenter and running on the new hardware.

At this point there may be a few known issues here and there, and of course there's always more to do. But if you're experiencing anything please make a ticket, and we'll get to it as soon as we can. If you're having some more urgent issue please feel free to PM me directly.

Thanks for the understanding as we've been transitioning everything and stabilizing things. Enjoy the shiny new hardware!


  1. 5 comments

Site Migration

Posted by Kaelten Sep 30, 2010 at 15:20 UTC

Hey guys,

Tonight I'm beginning the migration of the sites to our shiny new servers. This will unfortunately require that services will be taken offline as needed.

I'll try to keep everyone notified as things progress.

Thanks for understanding, and sorry for the inconvenience.

Going to start posting updates below, if I forget all times given should be GMT-5 (except when Ackis posts).

Quote from Update Thursday 3:19PM GMT-5:

Know it's been a while since the last update. I wanted to let people know that we're doing good on stabilization front.

The Packager is up and running, and the approval queue is fixed. I'm keeping an eye on the error logs so that we know where we're at as far as that, and I'm about to bring the next round of services back online.

Quote from Update Thursday 9:55AM GMT-6:

There are still a few issues being worked out. File approvals can't be processed just yet, there's a few issues with the repo's as well. These are being worked on. If you do see any issues, please create a ticket (search first to see if an existing one is there) under the "Site Issues" link up top. We're getting everything fixed as fast as we can. Thank you for your patience and understanding.

Quote from Update Thursday 3:55AM GMT-5:

All existing repositories are up and functional, however creating new repositories and packaging are still having issues. I'll be getting back on these things first thing in the morning.

Quote from Update Thursday 3:05AM GMT-5:

Hg is fully up and functioning. Please notify of any issues using it.

Quote from Update Thursday 2:05AM GMT-5:

Git is fully up and functioning. Please notify of any issues using it.

Quote from Update Thursday 1:11AM GMT-5:

Svn is fully up and functioning. Please notify of any issues using it.

Quote from Update Wed 11:30PM GMT-5:

I know it's been a long time since my last update but rest assured I'm still working.

I'm glad to say that svn+ssh access is now back working, I'm starting work on svn: now.

NOTE: if you use any of the ssh auth methods you may run into issues because the servers key has changed. On Linux based systems this can be found at /.ssh/known_hosts. I'm not sure about how windows handles that.

Quote from Update Wed 8:46PM GMT-5:

Got several issues worked out including one related to manually uploading files and the virus scanner. Sorry for those who got error messages.

Quote from Update Wed 6:27PM GMT-5:

We're seeing some packet loss in the new datacenter, but we're working on hard on getting it resolved.

Quote from Update Wed 6:00PM GMT-5:

If you're seeing this update you're on the new servers!

Repositories are still down, I'm working on a few things I'm noticing that are off and will be updating you guys shortly.

Quote from Update Wed 4:44PM GMT-5:

Repository access is disabled and a final copy has been started. Sorry for the inconvenience guys.

I don't have a solid ETA yet, but I'll update here when I do. I'm going to be brining the site down for a transition over to the new servers shortly.

Quote from Update Wed 4:25PM GMT-5:

I'm going to be disabling repository access shortly


  1. 9 comments