Category Archives: Infrastructure
Developer-driven cloud adoption?
James Governor’s thoughtful blog post on finding the REST of cloud prompted me to think about developer-driven versus sysadmin-driven adoption of cloud. This is a fulcrum that’s separate from GUI vs. CLI vs. API tug-of-war, which in many ways is a sysadmin-driven debate.
The immediacy of cloud provisioning has instinctive appeal to developers who just want to get something up and running. Amazon’s choice to initially do API-based provisioning was a clear choice to favor developer thinking, and developers at vast numbers of start-ups rewarded them by adopting the platform. At Web 2.0 start-ups, the founders, who usually come out of some sort of dev background, get to hire the ops people and call the shots. And thus, direct appeal to developers has been very important to cloud success, up until this point.
But my observation from client interactions is that cloud adoption in established, larger organizations (my typical client is $100m+ in revenue) is, and will be, driven by Operations, and not by Development. The developers may be the business stakeholders, and they might be the engineers who first experiment with the cloud (in a “rogue” or ad-hoc way), but Operations has the budget and Operations is going to be managing the actual cloud deployment, and therefore Operations makes the decision about what cloud to go with in the end.
That assumes, of course, that the developers haven’t tied their code to a non-portable API. If the developers have, unbeknownst to the Ops folks, gone and tightly integrated their application with, say, Amazon S3 in a way that doesn’t readily allow portability between different cloud storage APIs, or built on top of Google App Engine, then Ops isn’t going to have much in the way of options.
Another way to think about this: Developer-driven adoption is bottom-up adoption, rather than top-down adoption. The early stages of cloud adoption have been bottom-up. But because of the economic climate, larger organizations are experiencing a radical acceleration of interest in cloud computing, and thus, the next stage of cloud infrastructure adoption is more likely to be driven top-down.
Self-service shouldn’t mean an information void
Joel Spolsky has two UI design principles:
- Users don’t have the manual, and if they did, they wouldn’t read it.
- In fact, users can’t read anything, and if they could, they wouldn’t want to.
These ought to be core principles of cloud UI design, and, in fact, most cloud infrastructure providers do seem to earnestly be trying to hide complexity between simple, colorful UIs. (Although ostensibly simple things are often not as easy as they look. Appliance-builders and application-stack builders, for instance, usually turn out to be vastly more involved than the GUI, or even the demo, indicate.)
The bright shiny buttons are certainly inviting, and encourage a certain amount of try it and see if you like it, but for a business which is trying to figure out what cloud to go with, understanding the swathe of possible options can be a shockingly difficult exercise. What cloud providers often don’t do a very good job of explaining is what the heck it really means to use their cloud. The in-a-nutshell “this is exactly what is and isn’t going to be different from the systems and network administration you do today” explanation is simply missing.
That’s important, because it means that lots of cloud providers are missing out on the chance to differentiate themselves. Cloud infrastructure is not a commoditized service, yet, and won’t be for several years, while the technology is still immature, and features and the quality of implementation still distinguish providers from one another.
Of course, there’s the challenge: How do you do that without making people read more than a handful of words?
Who is Distribution Cloud?
Matthew Sacks has blogged Keynote performance test results for Akamai via Distribution Cloud.
There are other Akamai resellers out there, but Distribution Cloud posts its prices publicly, starting at 50 GB for $150 per month ($3/GB), and going up to 1 TB for $2,200/month ($2.20/GB), with storage at $15/GB. That’s 10x the cost of Limelight with a Rackspace Cloud Files origin ($0.22/GB, no commit) — definitely not a commodity price, so it’s really the low commit that makes this interesting.
But the blog post got me wondering: Who is Distribution Cloud, anyway? Their website lists a phone number and the fact they’re in Cambridge, MA, but no address or anything else that indicates who the company is. A search on the phone number turns up that it’s registered to a David Reisfeld at 94 Rice St, phone service courtesy of Level 3. LinkedIn and Naymz have listings for a person who seems to match: a senior director, product management, CDN streaming services, at Level 3 — formerly a senior product manager at Akamai.
But that only deepens the mystery. Did Reisfeld run a reseller (since 2002, the site claims) while employed at Akamai, with the blessing of his employer? Is he fronting for a buddy? Is he still doing it while employed at a competitor, or is the name for the phone listing not current? If it’s not his company, whose is it?
Origin story, Amazon EC2
Benjamin Black’s blog has an interesting story: his perspective of how Amazon EC2 came to be.
An interview with Chris Pinkham and Amazon’s Cape Town Development Centre site are interesting reads, too. The latter is focused upon EC2 development.
The hardware-vendor cloud
Are hardware vendors the natural winners in cloud infrastructure services?
I don’t think so. Having the lowest cost of server hardware simply isn’t enough. The failure of both Dell and Intel to build successful hosting businesses ought to make that clear. (Dell sold to Sprint, and Intel sold to Savvis, at a significant loss.) Hosting is not an exact parallel, but it’s close enough to look to it for hard-won lessons. Like hosting, cloud infrastructure services are not and will not be just about the lowest costs possible. Cloud will still also be about service, support, and features.
Cloud tidbits in the press
A few tidbits of cloud computing in the press…
Sun announces plans for a cloud computing service. No details until March, other than a ZDnet interview comment about delivering SaaS and SaaS infrastructure.
Rackspace puts its own spin on cloud. Rackspace now has a “cloud 101” page, most interesting for the results of a recent survey that it commissioned on business awareness of “cloud hosting”. No clear definition is provided for that term, though.
Two IBM scientists write a cloud computing article in Dr. Dobb’s. This article made me blink a great deal, starting from the statement, “Currently, you can create cloud applications through two major implementations: Amazon Web Services (AWS) and Google Application Engine (GAE).” The reduction of the richness of the cloud infrastructure services space to just these two names is a little mind-boggling, and the rest of the article that follows is nearly a marketing glossy — accurate in its superficial overview, but offering nearly no information of actual usefulness to an engineer. I hope for better out of technical journals.
Seven years to SEAP, not to cloud in general
Gartner recently put out a press release titled “Gartner Says Cloud Application Infrastructure Technologies Need Seven Years to Mature“, based on a report from my colleague Mark Driver. That’s gotten a bunch of pickup in the press and in the blogosphere. I’ve read a lot of people commenting about how the timeline given seems surprisingly conservative, and I suspect it’s part of what has annoyed Reuven Cohen into posting, “Cloud computing is for everyone — except stupid people.”
The confusion, I think, is over what the timeline actually covers. Mark is talking specifically about service-enabled application platforms (SEAPs), not cloud computing in general. Basically, a SEAP is a foundation platform for software as a service. Examples of current-generation SEAP platforms are Google App Engine, Microsoft Azure, the Facebook application platform, Coghead, and Bungee Labs. (Gartner clients who want to drill into SEAP, see The Impact of SaaS on Application Servers and Platforms.) When you’re talking about SEAP adoption, you’re talking about something pretty complex, on a very different timeframe than the evolution of the broader cloud computing style.
Cloud computing in general already has substantial business uptake, with potential radical acceleration due to the economic downturn. I say “potential” because it’s very clear to me that existing public cloud services, at their current state of maturity, frequently don’t meet the requirements that enterprises are looking for right now. I have far more clients suddenly willing to consider taking even big risks to leap into the cloud, than I have clients who actually have projects well-suited to the public cloud and who will realize substantial immediate cost savings from that move.
On the flip side, for those who have public-facing Web infrastructure, cloud services are now a no-brainer. Expect cloud elasticity and fast provisioning to simply become part of hosting and data center outsourcing solutions. Traditional hosting providers who don’t make the transition near-immediately are going to get eaten alive.
Volume pricing for Amazon’s CloudFront
New volume pricing for Amazon’s CloudFront CDN takes effect today, February 1st. For US and Europe “edge” delivery, the price goes as low as $0.05/GB at the 1000+ TB level. For Hong Kong, it’s $0.09/GB at that level. For Japan, $0.095/GB. The pricing isn’t quite comparable to a traditional CDN because of the origin bandwidth fees and the per-request fee, but it’s still a useful benchmark.
For those who are mentally comparing this to the cost of bandwidth, those per-GB costs translate into $16/Mbps for US/Europe, and $29/Mbps for Asia. In a day and age when Cogent is splashing “Home of the $4 Megabit” across its home page, it might look like there’s still quite a bit of delta between bandwidth pricing and CDN pricing, but especially once you get out of the US, bandwidth costs escalate pretty dramatically beyond Cogent’s low-water-mark.
Nonetheless, Amazon’s volume pricing play ought to put to an end anyone’s hope that the elimination of some of the financially weaker CDN players is going to do anything significant to alleviate pricing pressure where it’s most severe — the entirely commoditized portion of the market. In fact, this explicit, transparent pricing is probably going to provide a nice bargaining chip. Even if a major media conglomerate isn’t going to use Amazon to deliver their video, it won’t stop its purchasing people from using these published prices to hammer CDNs during negotiations.
Recent polling results
I’ve just put out a new research report called The Changing Colocation and Data Center Market. Macroeconomic factors have driven major changes in both the supply and demand picture for data center construction, leasing, and colocation, in the last quarter of 2008, continuing into this year. The economic environment has brought about abrupt shift in sourcing strategies, build plans, and the like, driving a ton of inquiry for myself and my colleagues. This report looks at those changes, and presents results from a colocation poll done of attendees at Gartner’s data center conference in December.
Those of you interested in commentary related to that conference might also want to read reports done by colleagues of mine: Too Many Data Center Conference Attendees Are Not Considering Availability and Location Risks in Data Center Siting and Sourcing Decisions, and an issue near and dear to many businesses right now, how to stretch out their money and current data center life, Pragmatic Guidance on Data Center Energy Issues for the Next 18 Months.
Reports are clients-only, sorry.
The turf war of unified computing
The New York Times article about Cisco getting into the server market is a very interesting read, as is Cisco’s own blog post announcing something they call “Unified Computing“.
My colleague Tom Bittman has a thoughtful blog post on the topic, writing: What is apparent is that the comfortable sandboxes in which different IT vendors sat are shattering. Those words demand that computing become a much more flexible, unified fabric.
Tom ruminates on the vendors, but setting aside any opinion of Cisco’s approach (or any other vendor making a unified computing attempt), my mind goes to the people — specifically, the way that a unified approach impacts IT operations personnel, and the way that these engineers can help or hinder adoption of unified data center technologies.
Unified computing — unified management of compute, storage, and network elements — is not just going to shape up to be a clash between vendors. It’s going to become a turf war between systems administrators and network engineers. Today, computing and storage are classically the domain of the former, and the WAN the domain of the latter. The LAN might go either way, but the bigger the organization, the more likely it goes to the network guys. And devices like application delivery controllers fall into an uncomfortable in-between, but in most organizations, one group or the other takes them into their domain. The dispute over devices like that serves as the warning shot in this war, I think. (An ADC is a network element, but it is often closely associated with servers; it is usually an appliance, i.e. a purpose-built server, but its administration more closely resembles a network device than a server.) The more a given technology crosses turf lines, the greater the dispute over who manages it, whose budget it comes out of, etc.
(Yes, I really did make a lolcat just for this post.)
He who controls the entire enchilada — the management platform — is king of the data center. There will be personnel who are empire-builders, seeking to use platform control to assert dominance over more turf. And there will be personnel who try to push away everything that is not already their turf, trying to avoid more work piling up on their plate.
Unification is probably inevitable. We’ve seen this human drama play out once this past decade already — the WAN guys generally triumphed over the telephony guys in the VoIP convergence. But my personal opinion is that it’s the systems guys, not the network guys, who will be most likely to triumph in the unified-platform wars. In most organizations, systems guys significantly outnumber the network guys, and they tend to have a lot more clout, especially as you go up the management chain. Internal politics and whose vendor influence triumphs may turn out to influence solution selection as much as, or more than, the actual objective quality of the solutions themselves.