Skip to content

Generative AI

Ch. 1 of 8
— CH. 1 · INTRODUCTION —

Contents

Generative AI

8 sections
  • Generative artificial intelligence arrived in public view not with a single announcement but with a moment of recognition. In November 2022, ChatGPT became available to anyone with an internet connection, and within weeks millions of people were typing questions into it and watching it write back in full sentences. What they were encountering had a history stretching back more than a century, a technical architecture built over years of quiet research, and a set of consequences that governments, courts, artists, and scientists are still trying to understand.

    The field is called generative AI because its systems do not merely classify or predict. They produce: text, images, audio, video, software code, three-dimensional objects, even candidate mathematical proofs. To make that possible, the models learn the underlying patterns of their training data and then use those patterns to generate new material in response to a prompt. Understanding where that capacity came from, what it can do, and what it costs the world to run at scale is what this documentary explores.

  • Russian mathematician Andrey Markov introduced the mathematical tool that would become generative AI's earliest ancestor back in 1906. His analysis of vowel and consonant sequences in the poem Eugeny Onegin gave rise to what became known as the Markov chain. A Markov chain, once trained on a body of text, can generate new probabilistic sequences; it was the first formal method for modeling the patterns of natural language by machine.

    By the early 1970s, artists were pushing these ideas into visual territory. Harold Cohen developed a computer program called AARON, which was designed to generate paintings autonomously. Cohen exhibited works produced by AARON, introducing audiences to the idea that a machine could make something that looked like art.

    In the 1980s and 1990s, the phrase generative AI planning described something quite different from today's chatbots: symbolic AI systems used to generate sequences of actions toward a goal. Practitioners applied these tools to military crisis action plans, manufacturing process plans, and early autonomous spacecraft. Researchers described the technology as relatively mature by the early 1990s, long before the neural network era.

  • In 2014, two new model types arrived almost simultaneously. The variational autoencoder, or VAE, and the generative adversarial network, or GAN, made it possible for the first time to build deep generative models of complex data like images. A GAN works by pitting two neural networks against each other: a generator that tries to produce convincing synthetic data and a discriminator that tries to spot the fakes. The continuous competition between them pushes the generator toward increasingly realistic outputs.

    The year 2016 brought another advance specifically in audio. DeepMind's WaveNet demonstrated that a deep neural network could generate raw audio waveforms directly, enabling speech synthesis more realistic than anything available before it. A subsequent system called Tacotron 2 extended this to full end-to-end neural text-to-speech generation.

    Then in 2017 came the transformer architecture, which proved more capable than the earlier long short-term memory networks for generative tasks. Transformers process tokens in parallel rather than sequentially, improving both training efficiency and scalability. That architecture became the foundation for OpenAI's generative pre-trained transformer series, beginning with GPT-1 in 2018. Every major language model since has built on the same core idea.

  • In March 2020, a free web application called 15.ai, created by an anonymous MIT researcher, offered users the ability to generate convincing character voices from minimal training data. It is credited as the first mainstream service for audio deepfakes. The following year, DALL-E drew widespread public attention to the possibility of turning a text description into a generated image.

    The full public reckoning came in November 2022 with the release of ChatGPT. Within months, generative AI was inside Microsoft Office as Copilot, inside Adobe's suite as Firefly, and inside Google Photos. Open-source alternatives including Stable Diffusion and the LLaMA language model made the technology available outside corporate platforms entirely.

    Adoption was not uniform across the world. A survey by marketing research firm Ipsos found that Asia-Pacific populations were significantly more optimistic about generative AI than Western societies. A separate survey by SAS and Coleman Parkes Research found that 83% of Chinese respondents were using the technology as of 2023, against a global average of 54% and a U.S. rate of 65%. A UN report documented that Chinese entities filed over 38,000 generative AI patents between 2014 and 2023, more than any other country. By mid-2025, however, many companies were walking back pilot projects, citing integration difficulties, data quality problems, and unmet returns. Analysts at Gartner described this moment as the hype cycle's trough of disillusionment.

  • In July 2023, the fact-checking company Logically tested Midjourney, DALL-E 2, and Stable Diffusion by prompting them to produce disinformation images. The models obliged, generating images depicting electoral fraud in the United States and Muslim women supporting India's Bharatiya Janata Party. The test illustrated a structural problem: systems built to respond to natural language requests could generate politically destabilizing imagery without any specialized knowledge on the part of the requester.

    Deepfakes, a portmanteau of deep learning and fake, extend this problem to video and audio. They have been used in celebrity pornography, revenge porn, financial fraud, and covert foreign election interference. In April 2023, the German publication Die Aktuelle published an AI-generated fake interview attributed to Michael Schumacher. Voice-cloning technology has been used to create fake versions of musicians' songs and to mimic the voices of public officials.

    In 2025, a report by Graphika documented how generative AI was being used to launder articles from Chinese state media through social media, obscuring their origin. That same year, a report from the American Sunlight Project found that the Pravda network was publishing as many as 10,000 articles a day, with the apparent goal of pushing particular narratives into the training data of large language models. Also in 2025, Israel signed a six-million-dollar contract with a U.S. firm called Clock Tower X to spread pro-Israel content across platforms in order to influence what ChatGPT, Gemini, and Grok would say.

  • ChatGPT and Midjourney are trained on large publicly available datasets that include copyrighted works. AI developers have argued that this constitutes fair use; copyright holders have argued the opposite. Getty Images sued Stability AI over the training of Stable Diffusion on its images. Both the Authors Guild and The New York Times sued Microsoft and OpenAI over the use of their works to train ChatGPT. As of 2024, several of these lawsuits remain ongoing.

    In April 2023, it was reported that image generation AI had caused 70% of video game illustration jobs in China to disappear. The same month, developments in generative AI contributed to the Hollywood labor disputes of 2023. Fran Drescher, president of the Screen Actors Guild, stated during the SAG-AFTRA strike that artificial intelligence poses an existential threat to creative professions. A 2025 study examining the U.S. labor market found no discernible disruption so far. A study of Danish workers found that those who used chatbots saved an average of 2.8% of their working time, with no significant change in earnings or hours worked.

    In January 2025, the United States Copyright Office released detailed guidance concluding that AI-generated works can qualify for copyright protection when the human user exerts sufficient creative control over the output. The same office subsequently registered the first visual artwork composed entirely of AI-generated materials, titled A Single Piece of American Cheese. In the European Union, the Artificial Intelligence Act requires disclosure of copyrighted training material and labeling of AI-generated output.

  • Training a large language model and then running it at the scale of a popular product requires enormous data centers, and those data centers carry real-world costs. Scientists and journalists have raised concerns about CO2 emissions, electronic waste, diesel generator exhaust, and the freshwater consumed for cooling. The carbon footprint of generative AI globally is estimated to be growing steadily. Potential annual emissions range from 18.21 to 245.94 million tons of CO2 by 2035, with the higher end of that estimate approaching the annual emissions of the U.S. beef industry, currently pegged at 257.5 million tons.

    Training frontier models requires computing power on a scale that only large technology companies can afford. Smaller firms such as Cohere and OpenAI have ended up buying access to data centers from Google and Microsoft respectively. Export controls add a geopolitical dimension: in 2022, the United States imposed restrictions on the sale of GPU and AI accelerator chips to China. New chip designs including NVIDIA's A800 and Biren Technology's BR104 were developed specifically to work within the limits of those sanctions.

    Smaller models can run locally. LLaMA-7B, a version with 7 billion parameters, can run on a Raspberry Pi 4. One version of Stable Diffusion can run on an iPhone 11. For those larger models with hundreds of billions of parameters, such as GPT-4, datacenter-scale hardware is required, typically arrays of GPUs such as NVIDIA's H100 or AI accelerators such as Google's TPU chips.

  • Google DeepMind introduced three systems in 2023 that suggest the direction the field is heading. FunSearch generated computer programs that solved problems in pure mathematics, including new constructions in the cap set problem and the bin packing problem. AlphaDev discovered small sorting algorithms that outperformed known human benchmarks and were subsequently integrated into the LLVM standard C++ sorting library. GNoME proposed candidate inorganic crystal structures for testing in materials science.

    In 2025, Google DeepMind followed with AlphaEvolve, a system for general-purpose algorithm discovery that uses large language models to propose code changes, automated evaluators to assess each candidate, and an evolutionary process to iteratively improve results. These applications suggest that generative AI is moving beyond producing prose and images into producing scientific and mathematical knowledge that researchers can verify and use.

    Detection remains a parallel challenge. In May 2025, Google deployed SynthID, its watermarking tool for output from Gemini, Imagen, and Veo. Detection requires using Google's own SynthID detector portal. OpenAI developed a comparable watermarking tool for ChatGPT in 2023 but did not release it, citing concerns that users would switch to competitors and that the tool could be circumvented simply by asking another model to rephrase the output. That gap between generating content and reliably identifying it remains one of the field's most consequential open problems.

Updated

Common questions

When was generative AI first used by the general public?

A free web application called 15.ai, created by an anonymous MIT researcher, launched in March 2020 and is credited as the first mainstream service for audio deepfakes. The broader public adoption of generative AI accelerated sharply after the release of ChatGPT in November 2022.

Who invented the transformer architecture used in generative AI models?

The transformer architecture was introduced in 2017 and replaced earlier long short-term memory networks for generative tasks. It became the foundation for OpenAI's generative pre-trained transformer series, beginning with GPT-1 in 2018.

What country has filed the most generative AI patents?

Chinese entities filed over 38,000 generative AI patents from 2014 to 2023, more than any other country, according to a UN report. A survey also found that 83% of Chinese respondents were using generative AI as of 2023, exceeding the global average of 54% and the U.S. rate of 65%.

Can AI-generated works be copyrighted in the United States?

The United States Copyright Office has ruled that works created by AI without any human input cannot be copyrighted because they lack human authorship. However, in January 2025, the office issued guidance clarifying that AI-generated works can qualify for copyright protection when the user exerts sufficient creative control, and subsequently registered the first artwork composed entirely of AI-generated materials, titled A Single Piece of American Cheese.

What are the environmental impacts of generative AI?

Generative AI data centers produce high CO2 emissions, consume large amounts of freshwater for cooling, generate electronic waste, and rely on backup diesel generators. Potential annual emissions from generative AI globally are estimated to range from 18.21 to 245.94 million tons of CO2 by 2035, with the upper estimate approaching the annual emissions of the U.S. beef industry.

How have deepfakes been used for disinformation?

Deepfakes have been used in fake celebrity pornography, financial fraud, and covert foreign election interference. In July 2023, fact-checking company Logically found that Midjourney, DALL-E 2, and Stable Diffusion would generate plausible disinformation images when prompted, including images depicting electoral fraud in the United States. In April 2023, Die Aktuelle published an AI-generated fake interview attributed to Michael Schumacher.

All sources

215 references cited across the entry

  1. 1JournalGenerative artificial intelligenceLeonardo Banh et al. — 2023
  2. 4NewsA Cheat Sheet to AI Buzzwords and Their MeaningsNate Lanxon et al. — March 10, 2023
  3. 8JournalGenerative AI and large language models in health care: pathways to implementationMarium M. Raza et al. — March 7, 2024
  4. 10The Impact of Generative AI on Hollywood and EntertainmentThomas H. Davenport and Randy Bean — June 19, 2023
  5. 11Generative AI at WorkErik Brynjolfsson et al. — April 2023
  6. 12Don't fear an AI-induced jobs apocalypse just yetThe Economist — March 6, 2023
  7. 13In Hollywood writers' battle against AI, humans win (for now)Jake Coyle — Associated Press — September 27, 2023
  8. 15JournalGovernance of Generative AIAraz Taeihagh — 2025-04-04
  9. 16JournalMisinformation reloaded? Fears about the impact of generative AI on misinformation are overblownFelix M. Simon et al. — 18 October 2023
  10. 19BookIntroduction to ProbabilityCharles Miller Grinstead et al. — American Mathematical Society — 1997
  11. 20BookMarkov Chains: Gibbs Fields, Monte Carlo Simulation, and QueuesPierre Bremaud — Springer Science & Business Media — March 9, 2013
  12. 21JournalFirst Links in the Markov ChainBrian Hayes — 2013
  13. 22JournalThe Hierarchical Hidden Markov Model: Analysis and ApplicationsShai Fine et al. — July 1998
  14. 23JournalA Brief History of Generative AINathan Bergen et al. — 2023
  15. 25JournalAutomated planning and scheduling for goal-based autonomous spacecraftSteve Chien — 1998
  16. 26BookARPA/Rome Laboratory Knowledge-based Planning and Scheduling Initiative Workshop ProceedingsThe Advanced Research Projects Agency, Department of Defense, and Rome Laboratory, US Air Force, Griffiss AFB — 1994
  17. 27BookAn Autonomous Spacecraft Agent PrototypeBarney Pell et al. — Autonomous Robots Volume 5, No. 1 — 1998
  18. 29BookMachine learning: discriminative and generativeTony Jebara — Springer Science & Business Media — 2012
  19. 30JournalAuto-Encoding Variational BayesDiederik P. Kingma — 2014
  20. 31JournalGenerative Adversarial NetsIan Goodfellow — 2014
  21. 32JournalAttention Is All You NeedAshish Vaswani — 2017
  22. 44JournalHuman-AI agency in the age of generative AISebastian Krakowski — March 2025
  23. 47Young Chinese Have Almost No Concerns About AI, Survey FindsHe Qitong et al. — Shanghai United Media Group — May 31, 2024
  24. 50JournalArtificial Intelligence in Healthcare: Applications and ChallengesAyush Kaushal — 2023
  25. 51JournalOn the Opportunities and Risks of Foundation ModelsRishi Bommasani — 2021
  26. 52JournalArt and the science of generative AIZiv Epstein — 2023
  27. 53JournalLanguage Models are Few-Shot LearnersTom B. Brown — 2020
  28. 54On the opportunities and risks of foundation modelsR. Bommasani — 2021
  29. 55JournalEvaluating Large Language Models Trained on CodeMark Chen — 2021
  30. 56JournalWaveNet: A Generative Model for Raw AudioAaron van den Oord — 2016
  31. 58Zero-shot text-to-image generationAditya Ramesh — 2021
  32. 61JournalWorld ModelsDavid Ha — 2018
  33. 62JournalA Generalist AgentScott Reed — 2022
  34. 63JournalMathematical discoveries from program search with large language modelsBernardino Romera-Paredes et al. — 2024
  35. 64JournalLarge language models help computer programs to evolveJean-Baptiste Mouret — January 17, 2024
  36. 65Generative Modeling for Mathematical DiscoveryJordan S. Ellenberg et al. — March 17, 2025
  37. 67JournalFaster sorting algorithms discovered using deep reinforcement learningDaniel J. Mankowitz et al. — June 2023
  38. 70JournalScaling deep learning for materials discoveryAmil Merchant et al. — 2023
  39. 71JournalA generative model for inorganic materials designClaudio Zeni et al. — 2025
  40. 73JournalCrystalFlow: a flow-based generative model for crystalline materialsXiaoshan Luo et al. — 2025
  41. 74JournalGenerative AI for crystal structures: a reviewClaudio Zeni — 2025
  42. 75Journalism, media, and technology trends and predictions 2026Nic Newman — University of Oxford — 12 January 2026
  43. 79Microsoft adds OpenAI technology to Word and ExcelJonathan Vanian — CNBC — March 16, 2023
  44. 80The app's Memories feature just got a big upgradeMark Wilson — August 15, 2023
  45. 81Adobe Adds Generative AI To PhotoshopLaurie Sullivan — May 23, 2023
  46. 84"Draw Things" App brings Stable Diffusion to the iPhoneJonathan Kemper — November 10, 2022
  47. 86Who Needs ChatGPT? How to Run Your Own Free and Private AI ChatbotBrian Westover — Ziff Davis — September 28, 2023
  48. 87U.S. officials order Nvidia to halt sales of top AI chips to ChinaStephen Nellis et al. — September 1, 2022
  49. 88Nvidia's Chinese A800 GPU's Performance RevealedAnton Shilov — Tom's Hardware — May 7, 2023
  50. 94JournalGenerative adversarial networksIan Goodfellow et al. — October 22, 2020
  51. 95BookAn Introduction to Variational AutoencodersDiederik P. Kingma et al. — Emerald Insights — 2019
  52. 98News3 Obstacles to Regulating Generative AIAndrew Burt — October 31, 2023
  53. 105NewsThe New York Times sues OpenAI and Microsoft for using its stories to train chatbotsHaleluya Hadero et al. — AP News — December 27, 2023
  54. 107MagazineThe Generative AI Copyright Fight Is Just Getting StartedGregory Barber — December 9, 2023
  55. 118JournalTrajectories of AI policy in higher education: Interpretations, discourses, and enactments of students and teachersJack Tsao — 2025
  56. 119JournalNot quite eye to A.I.: Student and teacher perspectives on the use of generative artificial intelligence in the writing processA. Barrett et al. — 2023
  57. 121JournalImplementing equitable and intersectionality-aware AI in education: A practical guideM. Mangal et al. — 2024
  58. 123NewsLessons from ElizaBen Tarnoff — August 4, 2023
  59. 126Actors vs. AI: Strike brings focus to emerging use of advanced techKevin Collier — NBC News — July 14, 2023
  60. 135Digital News Report 2024Nic Newman et al. — Reuters Institute for the Study of Journalism — June 2024
  61. 145NewsHere Come the Fake Videos, TooKevin Roose — March 4, 2018
  62. 146JournalHealth Disinformation Use Case Highlighting the Urgent Need for Artificial Intelligence Vigilance: Weapons of Mass DisinformationBradley D. Menz et al. — January 2024
  63. 147U.S. braces for foreign interference in 2024 electionMorgan Chalfant — March 6, 2024
  64. 155NewsMaking Deepfakes Gets Cheaper and Easier Thanks to A.I.Stuart A. Thompson — March 12, 2023
  65. 161AI Assists Chinese External PropagandaArthur Kaufman — 2025-09-08
  66. 162NewsFirst Came 'Spam.' Now, With A.I., We've Got 'Slop'Benjamin Hoffman — June 11, 2024
  67. 163NewsInvestigation Finds Actual Source of All That AI Slop on FacebookVictor Tangermann — August 10, 2024
  68. 164The MAGA Aesthetic Is AI SlopCharlie Warzel — August 21, 2024
  69. 173JournalA Shocking Amount of the Web is Machine Translated: Insights from Multi-Way ParallelismBrian Thompson et al. — Association for Computational Linguistics — August 2024
  70. 176ChatGPT "contamination": estimating the prevalence of LLMs in the scholarly literatureAndrew Gray — March 24, 2024
  71. 177How Much Research Is Being Written by Large Language Models?Prabha Kannan — Stanford University — May 13, 2024
  72. 178JournalAI models collapse when trained on recursively generated dataIlia Shumailov et al. — July 2024
  73. 179NewsWhen A.I.'s Output Is a Threat to A.I. ItselfAatish Bhatia — August 26, 2024
  74. 181JournalWhat we must be: AI and the future of porn studiesPeter Alilunas — 2 January 2024
  75. 184NewsDeepfakes: Get ready for phishing 2.0Stu Sjouwerman — December 26, 2022
  76. 188JournalFrom ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and PrivacyMaanak Gupta et al. — 2023
  77. 193CLOUD ActMarch 21, 2018
  78. 195Reaching for the CLOUDAlexander Berengaut — 2019-04-06
  79. 196How much energy does ChatGPT use?Josh You — February 7, 2025
  80. 197AI's carbon footprint is bigger than you thinkMelissa Heikkilä — December 5, 2023
  81. 198BookProceedings of the 2021 ACM Conference on Fairness, Accountability, and TransparencyEmily M. Bender et al. — Association for Computing Machinery — March 1, 2021
  82. 200JournalThe carbon impact of artificial intelligencePayal Dhar — August 1, 2020
  83. 204NewsWill A.I. Ruin the Planet or Save the Planet?Steve Lohr — August 26, 2024
  84. 207JournalTracking the carbon footprint of global generative artificial intelligenceZhaohao Ding et al. — May 5, 2025
  85. 208JournalGreenhouse gas emissions in US beef production can be reduced by up to 30% with the adoption of selected mitigation measuresRylie E. O. Pelton et al. — September 2024

Queue