Local Search and Advertising

SearchEngineWatch has an article by Greg Sterling about the US market:

Despite the fact that the quality of local search results is still very mixed, local search is clearly gaining traction with users.

The other side of local search, of course, is geo-targeted advertising. And the biggest potential market is small business. The U.S. has roughly 10 million small businesses, the majority of which have fewer than nine employees and conduct most of their business within 50 miles of their physical locations.

To achieve any sizeable revenues from the local market, paid search needs to gain small business advertiser adoption. But how much of the small business market will pay-per-click (PPC) be able to penetrate? There are some very practical challenges, which include:

  • The complexity and time involved in keyword bid-campaign management
  • Limited ad inventory and competition between national and small business advertisers for that inventory
  • The absence of local sales channels to “push” PPC to small business advertisers
  • The lack of websites among as much as 70% of small businesses

    These are not insurmountable by any means, though they should not be minimized. It’s also important to point out that many small businesses are currently users of paid search advertising. But for the great majority of small business, there may be considerable ignorance and even skepticism about PPC.

  • Wired Google Guide

    Wired has a collection of articles on Google. “Today Google’s a library, an almanac, a settler of bets. It’s a parlor game, a dating service, a shopping mall. It’s a Microsoft rival. It’s a verb. At more than 200 million requests a day, it is, by far, the world’s biggest search engine. And now, on the eve of a very public stock offering, it’s cast as savior, a harbinger of rebirth in the Valley. How can it be so many things? It’s Goooooooooogle.”
    One of the sections deals with Google’s primary revenue source – advertising:

    At the heart of the new Google is AdWords, a self-service ad server that uses relevance-ranking algorithms similar to the ones that make the search engine so effective. Advertisers tell Google how much they want to spend, then “buy” pertinent keywords. When users type in a matching term, the ad appears near the search results under the heading “Sponsored Links.” Each time a user clicks on the ad, Google subtracts the cost-per-click from the advertiser’s account. When the account’s daily budget is met, Google stops displaying the ad.

    So far the system has proven easy to use and remarkably effective. Roughly 15 percent of ads displayed adjacent to Google searches (at the company’s own Web site and on Google-powered sites like Yahoo! and AOL) result in clickthroughs – more than 10 times the click rate of the average banner ad. These clickthroughs are the golden leads of online commerce. One Dow Chemical business group reported 25 percent of its traffic comes through Google. Designer Hospital Gowns, a health care industry Web site, boosted sales 20 percent in six months.

    AdWords has worked so well that last year Google began offering the system to other sites as a way for them to provide targeted ads. The new service, AdSense, places ads on Web sites of all stripes, from ABC.com and The New York Times on the Web to quirky blogs like Bananathing!

    Pinpoint targeting has always been the goal for advertising, but has been unattainable for a couple of reasons. First, content providers have rarely been able to deliver to marketers enough well-described and narrowly focused consumers. Second, even when marketers get the perfect audience, they rarely have targeted ads; it costs too much to make multiple variations for micro-audiences. AdSense strips away these barriers.

    Using Google’s relevance-scoring algorithms, AdSense determines ad placement by analyzing the content of Web pages. The system delivers advertisers to the right niche publishers – and vice versa – automatically. What’s more, it allows those advertisers to customize their ads for free. And because Google has a vast inventory to choose from, there’s almost always a well-targeted ad to serve. No human has to intuit what’s going to work for what audience; the stats pick the best match.

    Yahoo Refocuses on Search

    In the aftermath of Yahoo replacing Google and launching its own search engine, NYTimes writes about Yahoo’s plans and challenges:

    Under [CEO] Mr. Terry Semel, Yahoo has become a big hit on Madison Avenue, with advertising revenue surging ahead of its traditional rivals, America Online and Microsoft’s MSN. Yahoo now has about 70 of the top 100 national advertisers as clients.

    But now Mr. Semel must win over a tougher audience: Silicon Valley. In many ways, Yahoo’s main rival is Google, started five years ago by two brainy Stanford graduate students who believed, against conventional wisdom, that sophisticated computer science could produce better Web searches.

    Mr. Semel says the new search engine is just the beginning of a rapid series of improvements to Yahoo’s search capabilities. Many of these, he says, will try to exploit Yahoo’s two main advantages over Google – its vast array of original content and a database with information about its 133 million registered users. Knowing where searchers live and what their interests are, Yahoo believes, will let it present results that are more relevant and advertising that is more focused.

    In addition, he is turning his attention to Yahoo’s specialized areas, like finance and music, which he plans to bolster through a series of major product introductions and acquisitions over the next year.

    Ultimately, Yahoo wants to take share not from other online sites but from television and other traditional media. Of all the time people spent last year using media, 4.9 percent was on the Internet. But online advertising represented only 2.3 percent of all advertising.

    Mr. Jeff Weiner, who runs Yahoo’s search unit, said that there would be a series of improvements to the search system in coming months. Many of them take advantage of its data about users.

    “Personalization will ultimately change the way search is delivered,” Mr. Weiner said. In particular, he hopes that by watching users over time, the search engine can guess what sort of information they are looking for – or, as he put it, “If you type in flowers, do you want to buy flowers, plant flowers or see pictures of flowers?”

    Another plan is to create search systems for Yahoo’s specialized areas, like finance, jobs and travel. Last fall, the company introduced a highly regarded search service in its shopping channel that lets users specify prices, brands and product attributes. Each specialized search engine, of course, also creates opportunities for specialized advertising.

    The biggest new advertising opportunity is in searches related to merchants and other information in a local area. Yellow-pages advertising is a huge market that has yet to move online, and both Yahoo and Google see local search as their way to claim their share. Mr. Weiner says Yahoo should have an advantage because it already has address information for many users.

    One of the things I like about the new Yahoo search: its inclusion of the RSS URL where the feed is available, and the ability to add the feed directly to My Yahoo. Jenny Levine has more.

    Adds Red Herring:

  • It forces Yahoo! back on its historic business model, as a search-centric company, at the very time that CEO Terry Semel has demonstrated that its content and community services, which drive more traditional retail banner advertising, and;

  • Google’s business, by contrast, is blossoming by segmenting audiences around different faces of searchfrom finding information that drives AdWords revenue to community services like Blogger and Orkut that could deliver increasingly targeted AdWords inventory and, even, retail banner advertising.

    Both companies, then, have embarked on a course where they will become increasingly integrated media companies. They will need to pursue new technology development and acquisitions in areas of, for example, blog search, where companies like Technorati and Feedster are already taking leading roles, and growing their search inventories to support specific lines of business, like Google’s Froogle and Yahoo!’s Shopping services. All of these business issues are solved at higher costs than acting as a conduit for other companies’ content, which suggests that Yahoo! more than search-centric Google faces increased operating costs in the short term.

  • Robert Scoble thinks (and I agree) Yahoo missed an opportunity to overtake Google – being nearly as good is not enough. He has some suggestions:

    I’ve done a few dozen more Yahoo vs. Google comparisons. I’m convinced that Yahoo squandered a good chance to overtake Google. Here’s my view on how to overtake Google:

    Give users access to the variables.

    What do I mean? At O’Reilly’s ETCon two weeks ago I saw Google’s Nelson Minar, Google’s senior software engineer speak. He told us that Google tracks 100 variables that they can play with to move around results.

    It’s clear that Yahoo has something like the same kinds of variables. Yahoo, for instance, clearly ranks individual’s sites (er, weblogs) lower than Google does.

    What if the user had control of that? I want a search engine that lets me control the variables. I might never want to see any results with webloggers included. I might want to have results that have only webloggers included (yeah, today I could use Feedster for that). But, what about the other variables?

    A search engine that would let me control the variables would be instantly the one I’d use. Imagine if you could use such an engine via a web service? I could display results here. That kind of engine would instantly be the geek’s favorite. Why? Cause they could tweak it to give better results.

    Even better, why not provide hooks into such an engine so we could come up with new variables that would provide even stronger results?

    Anyway, Yahoo will keep its current market share (which is sizeable) but won’t convince many people to switch with its current engine. Why? Cause it is isn’t demonstratably better.

    I think it’s possible to make a search engine that +is+ demonstratably better. And, no, I haven’t seen MSN’s engine yet. I doubt it’ll give users the kind of control over variables that I’m asking for too.

    I think the innovators will be the small engines like Technorati and Feedster. It’ll be interesting to see if any of those open up their variable tables for us to play with.

    Search Engines and Yellow Pages

    David Galbraith writes about the opportunity:

    The market for local services has traditionally been owned by the phone companies who used phone numbers as the key for Yellow Pages listings, however, Yellow Pages publishers have been lazy and arrogant and are just realizing that they could be crushed by the likes of Google, since the majority of revenues will soon come from online advertising. Traditional publishers’ online Yellow Pages are usually very poorly executed, for example, Dex only introduced searchable listings (instead of browsing a directory) at the beginning of this year.

    The model for online local services is probably Citysearch who offer paid listings alongside the directory and include value added content such as ratings. Craigslist should be in there but the lack of focus means that the biggest services advertised have gravitated to the seedy or low cost end of the market.

    Although Yahoo has had a local services tab for a while, it hasn’t linked this to pay-per-performance advertising, however, an Overture service is in the works. In addition, Google will surely ditch their increasingly defunct DMOZ powered ‘directory’ tab for the Yellow Pages service at Google labs. For Google, Yellow pages may have an added bonus – since local services require a search term plus some information about yourself, such as location, storing this information in a profile benefits users and helps build in a ‘switching cost’ to lock in users. Perhaps this is the kind of profiling service they should morph Orkut into.

    There may be an opportunity for weblog publishing tools to package a product geared to small business websites. In order for PPC (Pay Per Click) local services ads to work, they must click through to a webpage about the service, but most of the 100M local businesses in the US do not yet have a website.

    Intelligent Search Agents

    Washington Post writes about what’s next in search:

    As the Web has grown, it has developed a kind of embedded wisdom. Obviously the Web isn’t a conscious entity, but neither is it a completely random pile of stuff. The way one part links to another reflects the preferences of Web users — and Google tapped into that. Google, in detecting patterns on the Web, harvested meaning from all that madness.

    This points the way to one of the next big leaps for search engines: finding meaning in the way a single person searches the Web. In other words, the search engines will study the user’s queries and Web habits and, over time, personalize all future searches. Right now, Google and the other search engines don’t really know their users.

    For example, Saffo isn’t really interested in the stuff that most people look for when they do a Web search. He’s one of the premier futurists of Silicon Valley and fondly recalls the days, back in the 1980s and early 1990s, the pre-Web era, when the Internet was the reserve of the technological elite who posted their brilliant thoughts on electronic bulletin boards. Now, everyone from about third grade up has an e-mail address and loiters around the Web as though it’s the corner 7-Eleven. The results of a Web search reflect the tastes of a broad swath of ordinary Americans who in some cases are still wearing short pants.

    “The more people get on the Web, the more the Web becomes the vaster wasteland that is the successor to the vast wasteland of television. I don’t care what the majority of people are looking at, because the majority of people are really boring,” Saffo says.

    He needs a better search engine. He needs one that knows that he’s a big-brain tech guru and not an eighth-grader with a paper due.

    “The field is called user modeling,” says Dan Gruhl of IBM. “It’s all about computers watching interactions with people to try to understand their interests and something about them.”

    Imagine a version of Google that’s got a bit of TiVo in it: It doesn’t require you to pose a query. It already knows! It’s one step ahead of you. It has learned your habits and thought processes and interests. It’s your secretary, your colleague, your counselor, your own graduate student doing research for which you’ll get all the credit.

    To put it in computer terminology, it is your intelligent agent.

    Local Search and Advertising Opportunity

    NYTimes reports on the potential of small businesses in the online advertising market:

    The dearth of local search advertising is likely to change soon, Internet advertising analysts said. According to a report released last week by eMarketer, a technology research firm, online search advertising revenues in the United States will reach $2.5 billion this year and $3 billion next, and local search advertising will capture at least 15 percent of that market.

    Neal Polachek, an analyst at the Kelsey Group, said that although Google and Overture have sophisticated paid search functions, they do not hold a firm advantage over their online Yellow Pages competitors in local search advertising because they all face the same challenges. First, the search sites need a significant number of monthly visitors. Second, they need technological expertise. Third, they need effective ways to gather information on the roughly 15 million small businesses in the United States. And finally, they need sales agents to reach those business owners.

    While Google and Overture have the Web traffic, they may lack the ability to attract small business owners, Mr. Polachek said, because they require most advertisers to create their own search ads and monitor their placement. Verizon, SBC and other Yellow Pages publishers have millions of small advertisers already buying their services – and have sales forces to help those businesses with their online advertising – but their Web divisions lack the online traffic of the search giants.

    Search beyond Google

    Search can still do with a lot of improvements. Google reigns right now, but various people and companies are working on alternatives. Technology Review examines the options:

    For example, theres Teoma, which ranks results according to their standing among recognized authorities on a topic, and Australian startup Mooter, which studies the behavior of users to better intuit exactly what theyre looking for. And then theres the gorilla from Redmond: Microsoft is turning to search as one of its next big business opportunities. Its researchers are devising a new operating system that melds Google-like search functions into all Windows programs, as well as software that scours the Web for definitive answers to questions you phrase in everyday English.

    Whichever technology hooks tomorrows Web surfers, its builder will earn enormous influenceand handsome profits. Some 550 million search requests are entered every day worldwide (245 million of them in the United States). By 2007, the paid-placement advertising revenue generated by all these searches will reach about $7 billion, says Piper Jaffray analyst Safa Rashtchy. Yet surveys indicate that almost a quarter of users dont find what theyre looking for in the first set of links returned by a search engine. Thats partly because the precious needles of information we seek are buried under a haystack that grows by some 60 terabytes every day. And its why brutal competition in the search industry is certain to continue, especially as search companies usher in a host of advanced technologies, such as natural-language processing and machine learning. Over the next five to ten years, says Rashtchy, we could see massive improvements that provide orders-of-magnitude increases in relevancy and usage. And its the competition to deliver those improvementsmuch more than the success or failure of Googles rumored IPO, expected by many to happen this springthat is likely to determine how we will be navigating the Web a few years from now.

    Google and Search

    News.com has a commentary by George Colony of Forrester Research in light of its coming IPO:

    Google’s a great company, with smart people and fantastic technology. But perspective is the order of the day, not irrational exuberance. Google can’t survive on search alone.

    Factor one: Competition. Google has made lots of enemies. It is destroying the pop-up ad business and shifting ad revenue to paid search, of which it is the leader. MSN, AOL, Yahoo and other sites are getting bypassed and deconstructed by Googling users that don’t need the walled gardens of portals to ensure content relevancy. The control freaks of Redmond do not like it when anyone starts bypassing their monopoly or slapping toolbars on top of their operating systems and browsers. Microsoft loves complex software like search. Remember, the company started in the languages business. Taking down Google with better search is in its strike zone–this is a business it understands, unlike game consoles or TV.

    Factor two: no barriers to entry. What was the search engine you used before Google? (Mine was AltaVista.) How long did it take you to switch to Google? Seconds. How long will it take to switch out of Google? Seconds. All great businesses are built on a monopoly. The Internet monopoly often hinges on high customer switching costs (online banking, Amazon one-click buyers, eBay). Google has no natural monopoly–there are no walls protecting Google’s market position.

    Factor three: The Web is changing. Google is a step in the long march to better search. Yes, Google’s scheme yields fantastic results. But the Web is inexorably dynamic. During the next five years, it will move from containing primarily file-based content (HTML pages) to containing more executable content (e.g., online gaming or new structure imposed by Web services such as XML). When that happens, the usefulness of link-based search will wane. Simply stated, Google is very much of the times, with no advantage in the more structured, executable Internet that lies ahead.

    Is Google’s search good? Yes. Is the company worth tens of billions? No.

    Future Ideas for Search

    John Battelle talks to Jon Kleinberg, “professor at Cornell who some credit with work that inspired PageRank, though he’s far too modest to accept that mantle. He says he’s proud that in academic citations, his work on hubs and authorities is cited alongside PageRank as seminal to the current state of web search.”

    [Jon] agrees with the consensus view that search is in its early days. The really hard problems – natural language queries, for example, have yet to be solved. “It’s kind of interesting to see how far search has gotten without actually understanding what’s in the document,” he noted. In other words, search has gotten pretty sophisticated using keyword matching, and link/pattern analysis. But search technology still has no idea what a document actually *means* – in the human sense.

    Kleinberg outlined one of his core frustrations with search engines, one I am sure all readers have experienced: the inverse search. In this scenario, you know there is a core term or phrase that, if typed into Google, would yield exactly the set of pages you’re looking for. But you don’t know the term, and your attempts to divine it continually bring up frustrating and non-relevant results.

    Other areas where Kleinberg sees improvement in the next five to ten years: The addition of a time axis in search results, Local/Personalized/social networking search, “wordbursting”-based search and analytics (a la Feedster/Technorati).