Showing Latest Publications

My New Empirical Study on Defining and Measuring Search Bias

Popular Media Tomorrow is the deadline for Eric Schmidt to send his replies to the Senate Judiciary Committee’s follow up questions from his appearance at a hearing . . .

Tomorrow is the deadline for Eric Schmidt to send his replies to the Senate Judiciary Committee’s follow up questions from his appearance at a hearing on Google antitrust issues last month.  At the hearing, not surprisingly, search neutrality was a hot topic, with representatives from the likes of Yelp and Nextag, as well as Expedia’s lawyer, Tom Barnett (that’s Tom Barnett (2011), not Tom Barnett (2006-08)), weighing in on Google’s purported bias.  One serious problem with the search neutrality/search bias discussions to date has been the dearth of empirical evidence concerning so-called search bias and its likely impact upon consumers.  Hoping to remedy this, I posted a study this morning at the ICLE website both critiquing one of the few, existing pieces of empirical work on the topic (by Ben Edelman, Harvard economist) as well as offering up my own, more expansive empirical analysis.  Chris Sherman at Search Engine Land has a great post covering the study.  The title of his article pretty much says it all:  “Bing More Biased Than Google; Google Not Behaving Anti-competitively.”

Read the full piece here

Continue reading
Antitrust & Consumer Protection

Defining and Measuring Search Bias: Some Preliminary Evidence

ICLE White Paper Summary Search engines produce immense value by identifying, organizing, and presenting the Internet´s information in response to users´ queries.1 Search engines efficiently provide better and . . .

Summary

Search engines produce immense value by identifying, organizing, and presenting the Internet´s information in response to users´ queries.1 Search engines efficiently provide better and faster answers to users´ questions than alternatives.

Recently, critics have taken issue with the various methods search engines use to identify relevant content and rank search results for users. Google, in particular, has been the subject of much of this criticism on the grounds that its organic search results—those generated algorithmically—favor its own products and services at the expense of those of its rivals. It is widely understood that search engines´ algorithms for ranking various web pages naturally differ. Likewise, there is widespread recognition that competition among search engines is vigorous, and that differentiation between engines´ ranking functions is not only desirable, but a natural byproduct of competition, necessary to survival, and beneficial to consumers.2 Nonetheless, despite widespread recognition of the consumer benefits of such differentiation, complaints from rival search engines have persisted and succeeded in attracting attention from a number of state, federal and international regulatory agencies. Unfortunately, much of this attention has focused on the impact upon individual websites of differences among search engines´ algorithmic methods of identifying and ranking relevant content, rather than analyzing these differences from a conventional consumer?welfare driven antitrust analysis.

For example, many of these complaints ignore the fact that search engine users self?select into different engines or use multiple engines for different types of searches when considering the competitive implications of search rankings.Rather than focus upon competition among search engines in how results are identified and presented to users, critics and complainants craft their arguments around alleged search engine “discrimination” or “bias.”4 The complainants must have in mind something other than competitive decisions to rank content that differ from the decisions made by rivals; bias in this sense is both necessary to and inherent within any useful indexing tool. Yet, critics have generally avoided a precise definition of the allegedly troublesome conduct. Indeed, the term “bias” is used colloquially and is frequently invoked in the search engine debate to encompass a wide array of behavior—generally suggesting a latent malignancy within search engine conduct—with some critics citing mere differences in results across engines as evidence of harmful conduct.5

The more useful attempts to define “bias,” however, focus upon differences in organic rankings attributable to the search engine ranking its own content (“owncontent bias”); that is, a sufficient condition for own?content bias is that a search engine ranks its own content more prominently than its rivals do. To be even more precise about the nature of the alleged “own?content bias,” it should be clear that this form of  bias refers exclusively to organic results, i.e., those results the search engine produces algorithmically, as distinguished from the paid advertisements that might appear at the top, bottom, or right?hand side of a search result page.6 Critics at the Senate’s recent hearing on the “Power of Google” were particularly vociferous on this front, accusing Google of having “cooked”7 its algorithm and of “rig[ging] its results, biasing in favor of Google.”8

Competition economists and regulatory agencies are familiar with business arrangements which give rise to concerns of own?content bias.9 Complaints and economic theories of harm assert that a vertically integrated firm (in this case, Google offers search results as well as products like YouTube and Google Maps) might discriminate against its rivals by “foreclosing” them from access to a critical input. Here, the critical input necessary for rivals´ success is alleged to be prominent placement in Google´s search results. The economics of the potential anticompetitive exclusion of rivals involving vertically integrated firms are well understood in antitrust. The conditions that must be satisfied for these concerns to generate real risk to consumers are also well known. Over a century of antitrust jurisprudence, economic study, and enforcement agency practice have produced a well?understood economic analysis of the competitive effects of a vertically integrated firm´s “discrimination” in favor of its own products or services, including widespread recognition that such arrangements generally produce significant benefits for consumers. Modern competition policy recognizes that vertical integration and contractual arrangements are generally procompetitive; it also understands that discrimination of this sort may create the potential for competitive harm under some conditions. Sensible competition policy involving vertical integration and contractual arrangements requires one to be sensitive to the potential consumer welfare?enhancing potential of such vertical integration while also taking seriously the possibility that a firm might successfully harm competition itself (and not merely a rival).

In addition to the failure to distinguish procompetitive conduct from anticompetitive behavior, critics´ allegations of own?content bias suffer deeper conceptual ambiguities. The perceived issue for Google´s rivals is not merely that Google links to a map when responding to search queries, suggesting one might be  relevant for the user; indeed, rival search engines frequently respond to similar user queries with their own or other map products. Rather, critics find problematic that Google responds to user queries with a Google Map. This is a critical distinction because it concedes that rivals´ complaints are not satisfied by the response that consumers are better off with the map; nor do critics pause to consider that perhaps the Google search user prefers the Google Map to rival products.10 Thus, critics brazenly take issue with the relationship between Google and the search result even where they concede Google produces more relevant results for consumers.11 Rather than focusing upon consumers, critics argue that the fact that Google is affiliated with the referred search result is itself prima facie evidence of competitively harmful bias.12 On its face, this argument turns conventional antitrust wisdom on its head. Conduct that harms rivals merely because it attracts consumers from rivals is the essence of competition and the logical core of the maxim that antitrust protects “competition, not competitors.?13

Critics´ failure to account for the potential consumer benefits from ?own?content bias? extends beyond ignoring the fact that users might prefer Google´s products to rivals´. Most critics simply ignore the myriad of procompetitive explanations for vertical integration in the economics literature. This omission by critics, and especially by economist critics, is mystifying given that economists have documented not only a plethora of procompetitive justifications for such integration, but also that such vertical relationships are much more likely to be competitively beneficial or benign than to raise serious threats of foreclosure.14

The critical antitrust question is always whether the underlying conduct creates or maintains monopoly power and thus reduces competition and consumer welfare, or is more likely efficient and procompetitive. To be clear, documenting the mere existence of own?content bias itself does little to answer this question. Bias is not a sufficient condition for competitive harm as a matter of economics because it can increase, decrease, or have no impact at all upon consumer welfare; neither is bias, without more, sufficient to state a cognizable antitrust claim.15

Nonetheless, documenting whether and how much of the alleged bias exists in Google´s and its rivals´ search results can improve our understanding of its competitive implications—that is, whether the evidence of discrimination in favor of one´s own content across search engines is more consistent with anticompetitive foreclosure or with competitive differentiation.

Critically, in order to generate plausible competitive concerns, search bias must, at minimum, be sufficient in magnitude to foreclose rivals from achieving minimum efficient scale (otherwise, if it merely represents effective competition that makes life harder for competitors, it is not an antitrust concern at all). It follows from this necessary condition that not all evidence of ?bias? is relevant to this competitive concern; in particular, Google referring to its own products and services more prominently than its rivals rank those same services has little to do with critics´ complaints unless they implicate general or vertical search.

Despite widespread discussion of search engine bias, virtually no evidence exists indicating that bias abounds—and very little that it exists at all. Edelman & Lockwood recently addressed this dearth of evidence by conducting a small study focused upon own?content bias in 32 search queries. They contend that their results are indicative of systemic and significant bias demanding antitrust intervention.16 The authors define and measure ?bias? as the extent to which a search engine´s ranking of its own content differs from how its rivals rank the same content. This approach provides some useful information concerning differences among search engine rankings. However, the study should not be relied upon to support broad sweeping antitrust policy concerns with Google.

The small sample of search queries provides one reason for caution. Perhaps more importantly, the non?random sample of search queries undermines its utility for addressing the critical antitrust policy questions focusing upon the magnitude of search bias, both generally and as it relates to whether the degree and nature of observed bias satisfies the well?known conditions required for competitive foreclosure. Further, evaluating their evidence at face value, Edelman & Lockwood misinterpret its relevance (Edelman & Lockwood in fact find almost no evidence of bias) and, most problematically, simply assume that own?content bias is inherently suspect from a consumer welfare perspective rather than considering the well?known consumer benefits of vertical integration. Despite these shortcomings, Edelman & Lockwood´s study has received considerable attention, both in the press and from Google´s critics, who cite it as evidence of harmful and anticompetitive search engine behavior.17 In the present analysis, as a starting point, we first “replicate” and analyze Edelman & Lockwood´s earlier study of a small, non?random sample of search queries in the modern search market. We then extend this methodology to a larger random sample of search queries in order to draw more reliable inferences concerning the answers to crucial questions for the competition policy debate surrounding search engine bias, including: (1) what precisely is search engine bias?; (2) what are its  competitive implications?; (3) how common is it?; (4) what explains its existence and relative frequency across search engines?; and, most importantly, (5) does observed search engine bias pose a competitive threat or is it a feature of competition between search engines?

Part I of this paper articulates an antitrust?appropriate framework for analyzing claims of “own?content bias” and delineates its utility and shortcomings as a theory of antitrust harm; it further evaluates Edelman & Lockwood’s study, methodology and analysis using this framework. Part II lays out the methodology employed in our own studies. Part III presents the results of our replication of Edelman & Lockwood and analyzes antitrust implications for the search engine bias debate; Part IV does the same for our larger, random sample of search queries. Part V concludes.

Continue reading
Antitrust & Consumer Protection

Will the 2010 Merger Guidelines Survive the DOJ’s Complaint in U.S. v. AT&T?

Popular Media AT&T’s proposed acquisition of T-Mobile presents an opportunity for judicial scrutiny of the newest iteration of the Department of Justice (“DOJ”) and Federal Trade Commission’s . . .

AT&T’s proposed acquisition of T-Mobile presents an opportunity for judicial scrutiny of the newest iteration of the Department of Justice (“DOJ”) and Federal Trade Commission’s (FTC’s) Horizontal Merger Guidelines (“2010 Guidelines”). The Agencies revised the 2010 Guidelines with an eye toward increasing transparency and predictability by conforming them to actual agency analysis. The 2010 Guidelines highlight the Agencies’ adoption of a more economically sound analytical approach focusing directly upon the competitive effects of proposed mergers and de-emphasizing the importance of market definition and competitive inferences from market structure. But, oddly, the DOJ’s complaint reverts to its pre-revision approach, emphasizing a remarkable focus upon market definition and structural analysis. The structure-heavy approach the DOJ adopts in its complaint runs afoul of the standards it espouses in the Guidelines, raising the risk of undermining their continued success as measured by judicial adoption.

https://www.competitionpolicyinternational.com/will-the-2010-merger-guidelines-survive-the-doj-s-complaint-in-u-s-v-at-t

Continue reading
Antitrust & Consumer Protection

10th Annual International Industrial Organization Conference at GMU Law March 2012

Popular Media The 10th Annual International Industrial Organization Conference will be held at GMU Law in Arlington, VA March 16-18, 2012.  Along with Chris Adams (FTC), and . . .

The 10th Annual International Industrial Organization Conference will be held at GMU Law in Arlington, VA March 16-18, 2012.  Along with Chris Adams (FTC), and the Program Committee, I am helping out with some of the local organization.  For those interested in antitrust and regulatory issues specifically, or IO economics more generally, this is a great event and we hope you will consider coming or submitting a paper/ abstract.

The website linked above has all of the relevant registration and lodging details.  Here is the IIOC Conference Announcement:

The 2012 International Industrial Organization Conference, sponsored by the Industrial Organization Society and its affiliated journal, the Review of Industrial Organization, will be held March 16-18 at the George Mason University School of Law in Arlington, Virginia.  The conference will include Richard Schmalensee as keynote speaker, panel discussions and contributed sessions on all topics and from all perspectives of industrial organization including antitrust economics and regulation.

If you wish to submit an abstract or a complete session to the conference, please use the web interface.

DEADLINES:  Paper submissions through the web link above will be accepted through December 19, 2011.  There is no submission fee.  Decisions will be announced by January 16, 2012.  Paper presenters must register by February 13, 2012.  Non-presenters may register up to March 1.  There will be no on-site registration.

CONFERENCE GUIDELINES:  Accepted papers are to be presented by the individual submitting the paper.  Paper acceptances are also strictly conditional on the submitter’s willingness to serve as a discussant in another session of the conference.

RISING STAR SESSIONS:  We are again having a special session on Friday evening for graduate students.  Papers in this session will be discussed by established faculty and the sessions will be chaired by established and distinguished faculty in Industrial Organization. This is a great opportunity for students to get feedback on their work and meet with established researchers in their field.

PROGRAM COMMITTEE:   The Program Committee is chaired by Ken Boyer and George Deltas.

FURTHER INFORMATION:  The conference website, http://www.ios.neu.edu, will provide updated registration, hotel and schedule information.  The preliminary conference program will be posted there by February 10, 2012.

Filed under: antitrust, economics

Continue reading
Antitrust & Consumer Protection

World Series Meltdown, Moneyball, and Ron Washington

TOTM Watching my baseball team get eliminated from the World Series was hard to swallow. Watching it happen two years in a row was worse. And . . .

Watching my baseball team get eliminated from the World Series was hard to swallow. Watching it happen two years in a row was worse. And watching a manager make critical mistakes when a championship was on the line in Game 6 was beyond the pale. As endearing as Ron Washington is to watch during a rally—his running in place stirs the heart—and as much as the players seem to love playing for him, it’s time to pass the baton.

Read the full piece here.

Continue reading

Debunking the New York Times Editorial on Wireless Competition

TOTM Yesterday, the editorial page of the New York Times opined that wireless consumers needed “more protection” than that afforded by voluntary agreements by the carriers and existing . . .

Yesterday, the editorial page of the New York Times opined that wireless consumers needed “more protection” than that afforded by voluntary agreements by the carriers and existing regulation. The essay pointed to the “troublesome pricing practices that have flourished” in the industry, including Verizon’s alleged billing errors, as the basis for stepped up enforcement. As evidence of a lack of wireless competition, the editorial cites several indicia, none of which is persuasive.

Read the full piece here.

Continue reading
Telecommunications & Regulated Utilities

The Bulldozer Solution to the Housing Crisis

TOTM My inaugural blog on two-sided markets did not elicit much reaction from TOTM readers. Perhaps it was too boring. In a desperate attempt to generate . . .

My inaugural blog on two-sided markets did not elicit much reaction from TOTM readers. Perhaps it was too boring. In a desperate attempt to generate a hostile comment from at least one housing advocate, I have decided to advocate bulldozing homes in foreclosure as one (of several) means to relieve the housing crisis. Not with families inside them, of course. In my mind, the central problem of U.S. housing markets is the misallocation of land: Thanks to the housing boom, there are too many houses and not enough greenery. And bulldozers are the fastest way to convert unwanted homes into parks.

Read the full piece here.

Continue reading
Financial Regulation & Corporate Governance

New York Taxis

Popular Media The New York Times reports that the most recent price for a taxi in New York medallion is $1,000,000.  Wikipedia reports that there are 13,237 . . .

The New York Times reports that the most recent price for a taxi in New York medallion is $1,000,000.  Wikipedia reports that there are 13,237 licensed cabs in New York.   (A “medallion” is  the physical form of a taxicab license.)  This means that the present value of the rents created by limiting taxicabs is $13,237,000,000  — thirteen billion dollars.  This is just the rents; the total lost consumer surplus is much greater because the lack of taxicabs creates substantial deadweight losses.  For example, I am confident that many people have cars in New York only because they cannot count on getting a cab.  Cabs change shifts during rush hour because they can earn less at this time and so that is when they go out of Manhattan to change drivers, just when demand is greatest.  (This is also caused by the relatively too low price for waiting compared with the price for driving.)  There is a proposal which will make it easier for limousines to pick up passengers.  Of course, the taxi owners are opposed to this plan, but it would clearly be an efficient change.

Filed under: business, licensing, regulation Tagged: New York, Taxicabs

Continue reading
Financial Regulation & Corporate Governance

Google, Vertical Integration, and Beer

Popular Media First, Google had the audacity to include a map in search queries suggesting a user wanted a map.  Consumers liked it.  Then came video.  Then, . . .

First, Google had the audacity to include a map in search queries suggesting a user wanted a map.  Consumers liked it.  Then came video.  Then, they came for the beer:

Google’s first attempt at brewing has resulted in a beer that taps ingredients from all across the globe. They teamed up with Delaware craft brewery Dogfish Head to make “URKontinent,” a Belgian Dubbel style beer with flavors from five different continents.

No word yet from the Google’s antitrust-wielding critics whether integration into beer will exclude rivals who vertical search engines who, without access to the beer, have no chance to compete.  Yes, there are specialized beer search sites if you must know (or local beer search).  Or small breweries who, because of Google’s market share in search, cannot compete against Dogfish Head’s newest product.  But before we start the new antitrust investigation, Google has offered some new facts to clarify matters:

Similarly, the project with Dogfish Head brewery was a Googler-driven project organized by a group of craftbrewery aficionados across the company. While our Googlers had fun advising on the creation of a beer recipe, we aren’t receiving any proceeds from the sale of the beer and we have no plans to enter the beer business.

Whew.  What a relief.  But, I’m sure the critics will be watching just in case to see if Dogfish Head jumps in the search rankings.  Donating time and energy to the creation of beer is really just a gateway to more serious exclusionary conduct, right?  And Section 5 of the FTC Act applies to incipient conduct in the beer market, clearly.  Or did the DOJ get beer-related Google activities in the clearance arrangement between the agencies?

Filed under: alcohol, antitrust, beer, clearance, doj, federal trade commission, google, musings

Continue reading
Antitrust & Consumer Protection