Microsoft, Google, the Innovator’s Dilemma and the Future of Search & Web Ads

by Berin Szoka on January 17, 2009 · Comments

Jerry Yang’s departure as Yahoo! CEO opens the door to a renewed bid by Microsoft to buy Yahoo!’s search business (or Yahoo! itself).  Such a merger could produce a significantly stronger challenger to Google in the search market.  With this possibility in mind, the WSJ just ran a fascinating history of the “paid search” The search marketbusiness—the placement of “contextually targeted” ads next to search engine results based on the search terms that produced those results.

In a nutshell, Microsoft failed to see (back in 1998-2003) the enormous potential of paid search—just as small start-ups (such as Google) were starting to develop the technology and business model that today account for a $12+ billion/year industry, which is twice the size of the display ad market and which supports a great deal of the online content and services we have all come to take for granted online.  Microsoft first put its toe in the water of paid search with a small-scale partnership with Goto.com in 1999-2000.  But this partnership failed because of internal resistance from the managers of Microsoft’s display-ad program.  In 2000, Google launched Adwords and thus began its transformation from start-up into economic colossus.  By 2002, Microsoft realized that it needed to catchup fast, and approached Goto.com (by then renamed Overture) about a takeover.  But Microsoft ultimately chose in 2003 not to buy the startup because  Bill Gates and Steve Ballmer “balked at Overture’s valuation of $1 billion to $2 billion, arguing that Microsoft could create the same service for less.” 

Microsoft, meanwhile, spent the next 18 months deploying hundreds of programmers to build a search engine and a search-ad service, which it code-named Moonshot. The company launched its search engine in late 2004 and its search-ad system in May 2006.

But Microsoft’s ad system came too late:

Advertisers applauded Moonshot for its technical innovation. But Microsoft had trouble coaxing people to migrate to its search engine from Google; advertisers were unwilling to spend large sums on MSN’s search ads. By building a new system instead of buying Overture, Mr. Mehdi says, “we really delayed our time to market.”

What’s most fascinating about the piece is that it seems to suggest that Microsoft missed its opportunities to get into paid search not because it was “dumb,” “uninnovative” or a “bad” company, but for the same sorts of reasons that big, highly successful and even particularly innovative companies fail.  The reasons companies generally succeed in mastering “adaptive” innovation of the technologies behind their established business models are the very reasons why such great companies struggle to encourage or channel the “disruptive” innovation that renders their core technologies and business models obsolete.  This dynamic was described brilliantly in Harvard Business School professor Clayton Christensen’s classic 1997 book The Innovator’s Dilemma:  When New Technologies Cause Great Firms to Fail.  (Read chapter one here and Tim Lee’s recent discussion of the book here.)  

Whatever one thinks about the debate over whether antitrust intervention is necessary to restrain Google’s growth, I’m sure we’d all applaud the evolution of increased competition in the paid search market through market forces.  Let’s hope that Microsoft—as well as Yahoo!—have carefully studied the vast literature produced by business schools in the wake of Christensen’s book about how big companies can avoid the Innovator’s Dilemma by promoting—and capitalizing on—radical innovation from within.  Indeed, this seems to be precisely what has guided Google’s own strategy as it has grown from “disruptive innovator” to become the very sort of behemoth that cannot easily escape the Dilemma, even if corporate managers are fully aware of the problem on a theoretical level.  If Google can do it, Microsoft should be able to, too.  But let’s also not discount the possibility that, no matter how hard Google’s management might try to retain the innovative culture of a start-up, the giant can’t do that well enough to prevent its own apparent market dominance from being disrupted by new upstart innovators in search and advertising technologies.  

The head of Google Research talked about some of these possibilities in July 2007 and the Google has recently covered other possibilities.  Here are my own bets—for what little they’re worth—as to what such “disruptors” might be:

  • Semantic search and social search – whichever search engine masters these tools will likely dominate the market for search, and thus search advertising.
  • Micro-payments to search users for using a search engine and discounts for clicking on ads – something Microsoft has pioneered with its Cashback system but which is probably still only in its infancy.
  • Behavioral targeting that can make display ads competitive with search ads by making display ads as relevant to consumers as search ads (or even more so), rather than simply trying to target display ads based on the context of a page—which limits the economic value of the ad “display inventory” that websites try to fill with ads, especially for smaller websites in the Internet’s “long tail” whose subject matter might have little relevance to the keywords for products or services that are more highly valued by advertisers.  
  • Technologies that allow contextual targeting of ads in or around videos based on the contents of the video (and associated discussion by viewers in comments). Even the imperfect ability to automatically create transcripts of a video, and then search for keywords, could hugely increased the value of advertising associated with video content.

I suspect we’d all be at least a little surprised if we could see what search engines—and online advertising—really looked like in, say, 2019.  But I won’t be terribly surprised if Google—for all its ingenuity—ends up making some of the same mistakes Microsoft made with Search 1.0 ( c. 1998-2005).

Comments Posted in: Advertising & Marketing, Innovation & Entrepreneurship

  • quanticle

    The problem I had when reading "Innovator's Dilemma" was that all the analysis in the book was ex-post-facto. The author doesn't state how any of the firms could have told that the new technology was going to revolutionize their industry and put them out of business at the time the technology came out.

  • It's been several years since I last read the book but as I recall, there are really three parts to the "Dilemma."
    1) How do you identify potentially succesful disruptive innovations?
    2) How can a company know which of the many concepts it sees for disruptive innovation will actually succeed? It's easy to look back at Microsoft's failure to embrace paid search in the late 90s and laugh, but as you point out, we can do so only because of our ex post knowledge that paid search actually did take off.
    3) Even if some part of management decides to bet on a particular disruptive technology, how do you ensure that the company as a whole supports the development of that particular technology to fruition? How do you prevent those managers in the company with a vested interest in whichever existing technology would be "disrupted" by the new technology you're investing in from strangling the baby in its crib?

    Google's famous program of encouraging its engineers to spend 20% of their time on innovative pet projects is clearly intended to deal with these problems: Allow smart people to have fun playing with new ideas and see what comes out of their experimentation. But even there, the problem you've identified still remains: How does management know which pet projects will be the next big thing far enough in advance that the company will be the market leader? Google's approach seems to be to "throw everything against the wall and see what sticks."

    Another response, of course, is to buy small start-ups—precisely what Microsoft now regrets not doing when it passed on the oppoturtunty to buy Overture/Goto.com in 2003.

    But as you rightly point out, the hardest problem in all of this is trying to look into a crystal ball and predict which technologies will take off. But that's what entrepreneurship is all about: investing in a world of uncertainty. If I had any easy answers, I'd be rich!
  • quanticle
    But even there, the problem you've identified still remains: How does management know which pet projects will be the next big thing far enough in advance that the company will be the market leader? Google's approach seems to be to "throw everything against the wall and see what sticks."

    Arguably, given the inherent unpredictability of disruptive innovations, that's the only viable strategy. If you can't predict the future, you have to make a commitment to as many possible future technologies as you can fund and hope that one of them goes big and funds the next phase of your corporation's development. However, that requires a lot of things - a group of shareholders tolerant of long term investment and failed products; employees willing to experiment with new technologies and new ways of doing business; and management that is willing to let employees "goof off", in the hopes that the business can capitalize on whatever comes out of that free time.


    Even then, though, success isn't guaranteed. Google seems to have come the closest, but even it is having trouble making money off its non-search related business. I recently read about the trouble it had monetizing YouTube, and wondered whether any of Google's other technologies (GMail, Google Reader, Google News, etc.) were cash flow positive for the company.

  • Remember the car company Saturn, GM's attempt to do Toyota-like quality plus a no-BS buying experience? The first-generation car in 1990 was almost as good as a late-1980s Toyota Corolla, but then corporate HQ failed to fund R&D for a second version, so instead of catching up, the Corolla pulled ahead. When MSFT execs talk about search, they sound like GM execs talking about Saturn.
blog comments powered by Disqus

Previous post:

Next post: