weblogs.com Project Follow-up
Dave Winer had to bring down service on his free weblogs.com accounts recently. It turned into a bumpy ride for a while, and perhaps could have been handled better. Dave says,
One of the things that came from this is a process for shutting down a free service. Let’s draft a common document that explains to people how to do it, and really consider the problems.
We aren’t breaking any new ground here. Systems changes, quiescing a production environment, communication with stakeholders, migration of data across servers… all these matters and more are simply part of a systems project management discipline that many of us around here actually earn a living practicing. I’ve been seriously thinking of using what I’ve observed about this project’s initiation as a case study.
Dave has brought forward a serious proposition. Regarding his recent success at bringing down the free weblogs.com service without leaving his users high and dry, he says:
I don’t want an argument, I want to learn, based on two things, the benefit of time – it’s almost two weeks since the server went off the air, and the sites are back up and redirected now. And second – the emotions have had time to die down, to the point where the issues are not emotional.
I think the problems Dave faced in early June, his movement toward resolving the problems, the reactions that formed in what we might call an adjacent user community, the support that coalesced, the actions that were taken, and the final resolution of matters for Dave and the weblogs.com users are worthy of a case study in systems administration and project management. We all might have a chance to learn something.
The discipline surrounding project management scales. Whether you're a one man band or you're leading an IT shop of three or four hundred employees, whether you want to bring up a web server serving a few bloggers at your house on the end of a DSL circuit or establish a colo service for fortune 500 companies, there are steps you can follow to improve your chances of success in terms of time, cost, and ultimately customer satisfaction.
I don't think scale is terribly important here. There were only 3000 sites and they were being hosted for free so there's no revenue stream complicating our assessment, no ROI, no hurdle rate, none of the business matters that can muddy the water. Staffing was an issue. If Dave couldn't do it, it wasn't going to get done. Dave's communications choices and his perspective on who the stakeholders were seemed to be a disruptive factor in the beginning. I think his "guest" or "gift" accounts, the users who had received a free service, were his primary stakeholders and he was accurate in his assessment that they might suffer a little from a disruption of service, but by July 1 he was committed to give anyone who requested it a copy of his or her weblog.
Now it could be argued that the terms of service for the free accounts were such that just pulling the plug and consigning the blogs to the bit bucket was Dave's right. For me, that's not the point. That discussion follows later, after the creation of a problem statement, or a project initiation. That discussion is part of an evaluation of alternatives. That was one alternative to assess among others as part of a disciplined systems project management process. And a successful project includes a thoroughgoing stakeholder analysis... who were the others who might be affected by the disruption, how might they wish to be informed, what issues did they face? If public opinion is a factor, how do we deal with that?
I think Doc's IT Garage is the perfect forum for mulling over the systems project issues, the choices, the level of planning that we might want to do if faced with this kind of problem in the future. Does anybody else want to discuss the systems management issues Dave was facing a few weeks ago when he brought the weblogs.com service down?
(Incidentally, this forum permits moderation and I'll try to provide that as a service if people want to discuss things here.)


Maximo Park
Maximo Park mp3 - Girls Who Play Guitars, Russian Literature, Karaoke Plays...
You need to set expectations: everything comes to an end
If you set up a free service and people come to depend on it, you're going to get egg on your face if you shut it down. How much egg depends on how you shut it down.
For a very brief time, IBM hosted a "friends" page (http://www.ibm.com/friends). This was something we started at tradeshows in 1995. You'd come by the IBM booth and get to have your picture taken and put some words together in a form and voila, you had your own personal web page, and of all things it was at www.ibm.com/friends/something.
This seemed like a cool idea at the tradeshow, but quickly turned into a maintenance nightmare. We (ibm.com) weren't in the business of hosting anybody's pages, let alone non-IBM employees and the code wasn't really built to run on ibm.com. There was no terms of use, no service agreement, and various people thought they were entitled to various things.
So, after two shows (I think we had at most 300-400 pages hosted, possibly less), we pulled the plug on creating new pages. For the existing users we contacted those who'd provided an email address and warned that we would be removing the pages (I don't remember how much notice we gave, I think it was 90 days, definitely no later than then end of '95). At a minimum we offered to return all content to anyone who asked for it, we also offered to redirect the URLs to their personal sites if they had any. The redirects were in place into 1996.
Lessons I learned:
When I was an amateur at this in 1995 I could pull the "I didn't know what I was getting into" excuse once. The "friends" experience and some others lead me to make sure we had a end-game or end-of-life plan for anything we put up on www.ibm.com. Wasn't necessarily a formal plan, but at least a framework for working through all the tasks to be done and people to contact if something (content, application, endorsement) had to be pulled.
Stakeholders and Expectations
Thanks for the insights, Ed. One outcome of the way the plug was pulled at weblogs.com was that other people who considered themselves stakeholders emerged. It almost looks like an information supply chain model: Weblogs hosts the sites. The site owners sign up subscribers. The subscribers are stakeholders vested in their use of the information coming from the sites. And a second order customer exists... the people who get information from the subscribers. Sorting out who the legitimate stakeholders are in this very public proposition was one of the challenges that emerged. Weblogs found itself facing criticism from people it hadn't considered as stakeholders.
URL Escrow
URL Escrow was an idea that came to me as I was contemplating FeedBurner. If you rely upon the url of a domain that you don't control for a service, then you have no ability to route around a shutdown of the service. But if you could somehow get permanent redirects from that url, then you have a fighting chance to recover. It seems to me that a well-managed shutdown should include a plan for redirecting people from the old service to a new location.
URL escrow
URL Escrow sounds like a very good idea Dwight. But it adds a bit of overhead that free service providers like FeedBurner (and weblogs.com!) would probably be reluctant to assume. Nevertheless, as you say at your blog, if it existed as an offering from companies like Typepad then customers would have some continuity assurance.
Yes, that is a bit of a probl
Yes, that is a bit of a problem. However, I think that many free services are created with the hope that it can be turned into something substantial. URL escrow would then represent one of the milestones to be passed in the transition from free to money making (user fee or otherwise).
And for free services, a URL escrow service might even waive the upfront fee. Then the free service provider could just make an offer: If you care about your url, then give these guys the annual fee to insure that you have access to it if I go dark.