Bill Burnham writes:
A couple of months ago I had the pleasure of moderating a panel at TIECon on the Search Industry. Peter Norvig, Googles Director of Research, made one comment in particular that stood out in my mind at the time. In response to a question about the prospects for the myriad of search start-ups looking for funding Peter basically said, and I am paraphrasing somewhat, that search start-ups, in the vein of Google, Yahoo Ask, etc. are dead. Not because search isnt a great place to be or because they cant create innovative technologies, but because the investment required to build and operate an Internet-scale, high performance crawling, indexing, and query serving farm were now so great that only the largest Internet companies had a chance of competing.
One can imagine a world in the not to distant future in which an application designer can easily leverage the billions of dollars being spent by Google, Yahoo et. al., by having programmatic access to what is essentially a custom crawl list and a highly filtered index. In this way search engines, in some respects, may become an infrastructure layer not too dissimilar from the telecommunications networks and internet standards that they themselves are built upon.
Tim O’Reilly adds:
In my talks on Web 2.0, I always end with the point that “a platform beats an application every time.” We’re entering the platform phase of Web 2.0, in which first generation applications are going to turn into platforms, followed by a stage in which the leaders use that platform strength to outperform their application rivals, eventually closing them out of the market. And that platform is not enforced by control over proprietary APIs, as it was in the Windows era, but by the operational infrastructure, and perhaps even more importantly, by the massive databases (with network effects creating increasing returns for the database leaders) that are at the heart of Web 2.0 platforms.