A few surprises this week, not the good kind. Some problem has been preventing regions from shutting down and coming back up on the new code. This affected thousands of regions. All of the ones affected by the problem are in the main release channel. Support was swamped. The roll out of the new server update was delayed for several hours.

Speculation by some is that the recent OS Update was causing the shutdown problem. Oskar Linden pointed out that they have had shutdowns since the update and those shutdowns worked just fine.
Tuesday’s roll out was delayed as problems were resolved. The roll finished on Wednesday. So, Wednesday’s roll was pushed to Thursday. The details for the week follow. Simon Linden says investigation is ongoing and some fixes are in the pipeline.


