Skip to content
— CH. 1 · ORIGINS AND DEVELOPMENT —

Google Books

~5 min read · Ch. 1 of 7
7 sections
  • In 1996, two Stanford University graduate students named Sergey Brin and Larry Page began discussing a radical idea. They imagined a future where vast collections of books were digitized and indexed by a web crawler. This concept would eventually become Google Books, initially known as Project Ocean when it officially launched in 2002. The team visited existing digitization efforts like the Library of Congress's American Memory Project to understand their methods. Page spoke with then-University President Mary Sue Coleman about scanning all volumes at her university. He claimed that while the current estimate was one thousand years, Google could achieve the task in six years. By December 2004, Google announced partnerships with major institutions including Harvard University and the University of Michigan. The company planned to digitize approximately fifteen million volumes within a decade.

  • Google established designated scanning centers where trucks transported physical books for processing. A custom-built mechanical cradle adjusted the book spine while an array of lights scanned open pages. Each page received images from two cameras directed at its surface. A range finder LIDAR overlaid a three-dimensional laser grid on the paper to capture curvature. Human operators turned pages by hand using foot pedals to take photographs without flattening or unbinding the books. This system allowed scanning rates up to six thousand pages per hour. Many books used customized Elphel 323 cameras operating at one thousand pages per hour. A patent awarded to Google in 2009 revealed this innovative dual-camera infrared light system. De-warping algorithms corrected page curvature using the LIDAR data before optical character recognition software transformed raw images into text. Google omitted color information to prioritize spatial resolution since most out-of-copyright books lacked colors.

  • Users encounter four distinct viewing levels when searching Google Books. Full view allows public domain books to be downloaded freely. In-print books acquired through the Partner Program may also offer full view if publishers grant permission, though this remains rare. Preview mode limits viewable pages based on access restrictions and security measures set by publishers. Watermarks reading Copyrighted material appear at the bottom of preview pages. Snippet view displays only two to three lines of text surrounding a queried search term when copyright owners decline permission. Google restricts snippet display to prevent users from viewing too much content. No preview results show metadata like titles and authors for books that have not been digitized. These records function similarly to an online library card catalog. The service automatically generates overview pages containing publishing details and high frequency word maps.

  • Initial partners included Harvard University Library which holds more than fifteen point eight million volumes. The University of Michigan scanned five point five million volumes by March 2012. The New York Public Library offered public domain books in their entirety for free online access. Stanford University Libraries joined as part of the Green Library initiative. The Bodleian Library at Oxford University contributed to the global collection. By May 2007, Mysore University announced digitization of over eight hundred thousand manuscripts written on palm leaves dating back to the eighth century. The Big Ten Academic Alliance committed to scanning ten million books over six years. The University of Texas at Austin partnered to digitize about half a million Latin American volumes. As of March 2012, the University of Wisconsin-Madison had scanned approximately six hundred thousand volumes. These partnerships aimed to make millions of works discoverable worldwide through digital means.

  • Scholars frequently reported rampant errors in metadata information including misattributed authors and erroneous publication dates. Linguist Geoffrey Nunberg found that searching for books published before 1950 containing the word internet yielded five hundred twenty seven unlikely results. Woody Allen appeared in three hundred twenty five books ostensibly published before he was born. Google blamed bulk errors on outside contractors handling the data processing. Publication dates sometimes predated author births with one hundred eighty two works by Charles Dickens listed prior to his birth in 1812. Incorrect subject classifications placed an edition of Moby Dick under computers and a biography of Mae West under religion. Conflicting classifications assigned both fiction and nonfiction labels to ten editions of Whitman's Leaves of Grass. Some metadata entries incorrectly appended details from an 1818 mathematical work to a completely different 1963 romance novel. Scanning errors included unreadable pages upside down images or crumpled pages obscuring thumbs and fingers.

  • Google celebrated fifteen years of service in 2017 having scanned more than forty million titles. The company estimated there were about one hundred thirty million distinct titles in the world when it began its mission. A 2023 study by scholars from UC Berkeley and Northeastern University found digitization led to increased sales for physical book versions. The Ngram Viewer graphs word usage frequency across the collection providing historians and linguists insight into human culture. Critics argued that disproportionate English representation creates linguistic imperialism issues affecting future scholarship growth. Jean-Noël Jeanneney, former president of a French institution, criticized the effort on these grounds. Google Editions launched as a digital bookstore competing with Amazon and Apple in December 2010. Despite winning decade-long litigation, Wired reported only a few employees worked on the project by April 2017. Scanning operations slowed significantly since at least 2012 as librarians confirmed reduced pace compared to 2006 levels.

Common questions

When did Google Books officially launch and what was its original name?

Google Books officially launched in 2002 under the initial name Project Ocean. The project originated from discussions between Stanford University graduate students Sergey Brin and Larry Page that began in 1996.

How does Google scan books without damaging them or unbinding the volumes?

The service uses custom mechanical cradles and dual-camera systems to capture images while human operators turn pages by hand using foot pedals. A range finder LIDAR overlays a three-dimensional laser grid on the paper to capture curvature before de-warping algorithms correct the page shape for text recognition.

What legal rulings determined the copyright status of the Google Books digitization project?

US District Judge Denny Chin ruled in favor of Google in November 2013 citing fair use protections after rejecting an earlier settlement in March 2011. An appeals court sided unanimously with Google again in October 2015 declaring no violation of copyright law, and the US Supreme Court declined to hear the Authors Guild's final appeal in April 2016.

Which universities partnered with Google to contribute millions of scanned volumes to the collection?

Initial partners included Harvard University Library which holds more than fifteen point eight million volumes and the University of Michigan which scanned five point five million volumes by March 2012. The New York Public Library offered public domain books in their entirety for free online access while Stanford University Libraries joined as part of the Green Library initiative.

What specific errors did scholars report regarding metadata and scanning quality in the database?

Scholars reported rampant errors including misattributed authors and erroneous publication dates such as Woody Allen appearing in three hundred twenty five books ostensibly published before he was born. Scanning errors also included unreadable pages upside down images or crumpled pages obscuring thumbs and fingers alongside incorrect subject classifications like placing Moby Dick under computers.

All sources

135 references cited across the entry

  1. 3webRead Complete Magazines Online in Google BooksMark O'Neill — 28 January 2009
  2. 5newsGoogle project promotes public goodKevin Bergquist — University of Michigan — 2006-02-13
  3. 6webIs This the Renaissance or the Dark Ages?Andrew K. Pace — American Library Association — January 2006
  4. 8web15 years of Google Books17 October 2019
  5. 10newsGoogle Books: A Complex and Controversial ExperimentStephen Heyman — 28 October 2015
  6. 11magazineWhat Ever Happened to Google Books?11 September 2015
  7. 14webGoogle's Cookie and Hacking Google PrintGreg Duffy — March 2005
  8. 15journalThe Google Library Project: Both Sides of the StoryJonathan Band — University of Michigan — 2006
  9. 16newsIn Google Book Settlement, Business Trumps IdealsJuan Carlos Perez — October 28, 2008
  10. 18webReferences, PleaseTim Parks — 13 September 2014
  11. 19webTorching the Modern-Day Library of AlexandriaJames Somers — The Atlantic — 20 April 2017
  12. 20webWeekly Google Code Roundup for August 10thDion Almaer — 11 August 2007
  13. 22newsScan This Book!Kevin Kelly — May 14, 2006
  14. 23webPatent reveals Google's book-scanning advantageStephen Shankland — 4 May 2009
  15. 24newsThe Secret Of Google's Book Scanning Machine RevealedMaureen Clements — 30 April 2009
  16. 26webIs Google leading an e-book revolution?Laura Miller — 8 December 2010
  17. 34magazineThe Artful Accidents of Google BooksKenneth Goldsmith — 4 December 2013
  18. 35webThe trouble with Google BooksLaura Miller — 9 September 2010
  19. 38journalAn Assessment of Google Books' MetadataRyan James et al. — 2012
  20. 39newsGoogle's Book Search: A Disaster for ScholarsGeoffrey Nunberg — August 31, 2009
  21. 40bookGoogle and the Myth of Universal Knowledge: A View from EuropeJean-Noël Jeanneney — University of Chicago Press — 2006-10-23
  22. 41newsFrance Detects a Cultural Threat in GoogleAlan Riding — 2005-04-11
  23. 46webMichigan Digitization ProjectUniversity of Michigan
  24. 52webAustrian Books OnlineAustrian National Library
  25. 53webGoogle Book Search GrowsAndrew Albanese — 2007-06-15
  26. 64webGoogle to digitise books at Mysore varsityHindustan Times — 20 May 2007
  27. 73newsA new chapterOctober 30, 2008
  28. 74webAuthors Guild Sues Google, Citing "Massive Copyright Infringement"Paul Aiken — Authors Guild — 2005-09-20
  29. 75webPublishers sue Google over book search projectAlorie Gilbert — CNET News — 2005-10-19
  30. 77webJudging Book Search by its coverJen Grant — November 17, 2005
  31. 86webGoogle Book Search Project - MenuBig Ten Academic Alliance
  32. 89webShare and enjoyManas Tungare
  33. 92newsMicrosoft Will Shut Down Book Search ProgramMiguel Helft — May 24, 2008
  34. 93newsSome Fear Google's Power in Digital BooksNoam Cohen — February 1, 2009
  35. 96newsGoogle Hopes to Open a Trove of Little-Seen BooksMotoko Rich — January 4, 2009
  36. 100newsPreparing to Sell E-Books, Google Takes on AmazonMotoko Rich — 2009-06-01
  37. 101newsFrench court shuts down Google Books projectGaelle Faure — December 19, 2009
  38. 102webGoogle Gets Sued by Photographers Over Google BooksJolie O'Dell — 8 April 2010
  39. 114webGoogle Begins to Scale Back Its Scanning of Books From University LibrariesJennifer Howard — The Chronicle of Higher Education — 9 March 2012
  40. 115magazineHow Google Book Search Got LostScott Rosenberg — 11 April 2017
  41. 116magazineGoogle and the Future of BooksRobert Darnton — February 12, 2009
  42. 117newsAuthors sue Google over book plan21 September 2005
  43. 121webGoogle Book Search Wins Victory In German ChallengeDanny Sullivan — 2006-06-28
  44. 122newsFrench publishers toast triumph over GoogleAdam Sage — The Times of London — December 19, 2009
  45. 123newsGoogle's French Book Scanning Project Halted by CourtHeather Smith — Bloomberg — December 18, 2009
  46. 124newsFrench publisher sues GoogleJohn Oates — June 7, 2006
  47. 125newsFine for Google over French booksDecember 18, 2009
  48. 128newsMicrosoft Attorney Accuses Google Of Copyright ViolationsThomas Claburn — March 6, 2007
  49. 136magazineEurope's Answer to Google Book Search Crashes on Day 1Chris Snyder — November 20, 2008