Skip to content
— CH. 1 · THE FIRST ALGORITHMIC VOICE —

Generative artificial intelligence

8 min listen · Ch. 1 of 6
6 sections
  • In 1906, Russian mathematician Andrey Markov introduced a concept that would eventually birth generative artificial intelligence. He analyzed vowel and consonant patterns in the novel Eugeny Onegin to model natural language. This early work laid the foundation for systems that could generate probabilistic text after training on a corpus of words. By the early 1970s, artists began using computers to extend these techniques beyond simple Markov models. Harold Cohen developed AARON, a pioneering computer program designed to autonomously create paintings. These works were exhibited and marked an early attempt at machine creativity.

    The terms generative AI planning or generative planning emerged in the 1980s and 1990s to describe systems generating sequences of actions. Military planners used these tools to generate crisis action plans while manufacturing sectors utilized them for process planning. By the early 1990s, this technology was considered relatively mature within its specific domains. The field then shifted focus toward deep learning technologies beginning in the late 2000s. Neural networks trained as discriminative models dominated the era due to the difficulty of generative modeling.

  • Advancements in 2014 produced the first practical deep neural networks capable of learning generative models for complex data like images. Variational autoencoders and generative adversarial networks enabled systems to output entire images rather than just class labels. DeepDream became one of the earliest examples of such deep generative models producing visual content. In 2017, the Transformer network replaced older long short-term memory models to enable advancements in generative capabilities. This architecture allowed models to process entire sequences simultaneously and capture long-range dependencies more efficiently.

    OpenAI developed the first generative pre-trained transformer known as GPT-1 in 2018 following the Transformer breakthrough. Generative adversarial networks consist of two neural networks trained simultaneously in a competitive setting. A generator creates synthetic data by transforming random noise into samples resembling training datasets. A discriminator learns to distinguish authentic data from the synthetic data produced by the generator. These two models engage in a minimax game where the generator aims to fool the discriminator while the discriminator improves its detection abilities. Transformers allow models to capture the significance of every word in a sequence when predicting subsequent words.

  • In March 2020, the release of 15.ai marked one of the earliest popular use cases of generative AI. An anonymous MIT researcher created this free web application to generate convincing character voices using minimal training data. The platform became the first mainstream service for AI voice cloning used in memes and content creation. By 2021, DALL-E emerged as a transformer-based model advancing AI-generated imagery. Open-source projects like VQGAN+CLIP and DALL-E Mini became widely used public text-to-image generation tools before mobile applications allowed users to generate art from simple prompts.

    Midjourney and Stable Diffusion launched in 2022 to democratize access to artificial intelligence art creation. These systems generated photorealistic images based on text descriptions leading to widespread adoption among artists and designers. November 2022 saw the public release of ChatGPT which popularized generative AI for general-purpose text tasks. A 2024 survey revealed that Asia-Pacific countries were significantly more optimistic about generative AI than Western societies. China emerged as a global leader with 83% of respondents using the technology compared to a global average of 54%. Chinese entities filed over 38,000 generative AI patents between 2014 and 2023 surpassing United States patent applications.

  • In April 2023 reports indicated image generation AI resulted in 70% of jobs for video game illustrators in China being lost. Fran Drescher declared during the 2023 SAG-AFTRA strike that artificial intelligence poses an existential threat to creative professions. Voice generation AI emerged as a potential challenge to the voice acting sector while developments contributed to Hollywood labor disputes. However a 2025 study concluded the US labor market had not experienced discernible disruption from generative AI so far.

    Generative models reflect and amplify cultural biases present in underlying data. A language model might assume doctors are male and secretaries are female if those biases exist in training data. An image model prompted with text describing a CEO might disproportionately generate images of white male CEOs when trained on racially biased datasets. Deepfakes have garnered widespread attention for uses including revenge porn fake news hoaxes health disinformation financial fraud and covert foreign election interference. In July 2023 fact-checking company Logically found popular models would produce plausible disinformation images when prompted to do so.

  • Scientists and journalists expressed concerns about the environmental impact of developing and deploying generative models. High CO2 emissions large amounts of freshwater used for data centers and high electricity usage characterize the industry. The carbon footprint globally is estimated to be growing steadily with potential annual emissions ranging from 18.21 to 245.94 million tons of CO2 by 2035. Highest estimates for 2035 near the impact of the United States beef industry which currently emits 257.5 million tons annually as of 2024.

    Proposed mitigation strategies include increasing efficiency of data centers to reduce energy usage and building more efficient machine learning models. Regulating transparency of these models and their energy and water usage remains a key focus area. Researchers are encouraged to publish data on their models' carbon footprint while subject matter experts understanding both machine learning and climate science become more numerous. Large-scale data centers consume fresh water for cooling and generate significant e-waste alongside high energy consumption that grows steadily.

Common questions

When did Russian mathematician Andrey Markov introduce the concept that birthed generative artificial intelligence?

Russian mathematician Andrey Markov introduced the concept in 1906. He analyzed vowel and consonant patterns in the novel Eugeny Onegin to model natural language.

What year did OpenAI develop the first generative pre-trained transformer known as GPT-1?

OpenAI developed the first generative pre-trained transformer known as GPT-1 in 2018. This development followed the Transformer breakthrough which allowed models to process entire sequences simultaneously.

Which company sued Stability AI over the use of its images to train Stable Diffusion?

Getty Images sued Stability AI over the use of its images to train Stable Diffusion. The Authors Guild and The New York Times also sued Microsoft and OpenAI regarding the use of their works to train ChatGPT.

How many generative AI patents did Chinese entities file between 2014 and 2023?

Chinese entities filed over 38,000 generative AI patents between 2014 and 2023. This number surpassed United States patent applications during the same period.

When did the United States Copyright Office register the first visual artwork composed entirely of AI-generated materials titled A Single Piece of American Cheese?

The United States Copyright Office registered the first visual artwork composed entirely of AI-generated materials titled A Single Piece of American Cheese in January 2025. This registration occurred after the office released extensive guidance establishing that users can exert control over selection and placement of creative elements.

All sources

211 references cited across the entry

  1. 1JournalGenerative artificial intelligenceLeonardo Banh et al. — 2023
  2. 4NewsA Cheat Sheet to AI Buzzwords and Their MeaningsNate Lanxon et al. — March 10, 2023
  3. 8JournalGenerative AI and large language models in health care: pathways to implementationMarium M. Raza et al. — March 7, 2024
  4. 10The Impact of Generative AI on Hollywood and EntertainmentThomas H. Davenport and Randy Bean — June 19, 2023
  5. 11Generative AI at WorkErik Brynjolfsson et al. — April 2023
  6. 12Don't fear an AI-induced jobs apocalypse just yetThe Economist — March 6, 2023
  7. 13In Hollywood writers' battle against AI, humans win (for now)Jake Coyle — Associated Press — September 27, 2023
  8. 15JournalGovernance of Generative AIAraz Taeihagh — 2025-04-04
  9. 16JournalMisinformation reloaded? Fears about the impact of generative AI on misinformation are overblownFelix M. Simon et al. — 18 October 2023
  10. 19BookIntroduction to ProbabilityCharles Miller Grinstead et al. — American Mathematical Society — 1997
  11. 20BookMarkov Chains: Gibbs Fields, Monte Carlo Simulation, and QueuesPierre Bremaud — Springer Science & Business Media — March 9, 2013
  12. 21JournalFirst Links in the Markov ChainBrian Hayes — 2013
  13. 22JournalThe Hierarchical Hidden Markov Model: Analysis and ApplicationsShai Fine et al. — July 1998
  14. 23JournalA Brief History of Generative AINathan Bergen et al. — 2023
  15. 25JournalAutomated planning and scheduling for goal-based autonomous spacecraftSteve Chien — 1998
  16. 26BookARPA/Rome Laboratory Knowledge-based Planning and Scheduling Initiative Workshop ProceedingsThe Advanced Research Projects Agency, Department of Defense, and Rome Laboratory, US Air Force, Griffiss AFB — 1994
  17. 27BookAn Autonomous Spacecraft Agent PrototypeBarney Pell et al. — Autonomous Robots Volume 5, No. 1 — 1998
  18. 29BookMachine learning: discriminative and generativeTony Jebara — Springer Science & Business Media — 2012
  19. 30JournalAuto-Encoding Variational BayesDiederik P. Kingma — 2014
  20. 31JournalGenerative Adversarial NetsIan Goodfellow — 2014
  21. 32JournalAttention Is All You NeedAshish Vaswani — 2017
  22. 44JournalHuman-AI agency in the age of generative AISebastian Krakowski — March 2025
  23. 47Young Chinese Have Almost No Concerns About AI, Survey FindsHe Qitong et al. — Shanghai United Media Group — May 31, 2024
  24. 50JournalArtificial Intelligence in Healthcare: Applications and ChallengesAyush Kaushal — 2023
  25. 51JournalOn the Opportunities and Risks of Foundation ModelsRishi Bommasani — 2021
  26. 52JournalArt and the science of generative AIZiv Epstein — 2023
  27. 53JournalLanguage Models are Few-Shot LearnersTom B. Brown — 2020
  28. 54On the opportunities and risks of foundation modelsR. Bommasani — 2021
  29. 55JournalEvaluating Large Language Models Trained on CodeMark Chen — 2021
  30. 56JournalWaveNet: A Generative Model for Raw AudioAaron van den Oord — 2016
  31. 58Zero-shot text-to-image generationAditya Ramesh — 2021
  32. 61JournalDreamFusion: Text-to-3D using 2D DiffusionBen Poole — 2022
  33. 62JournalWorld ModelsDavid Ha — 2018
  34. 63JournalA Generalist AgentScott Reed — 2022
  35. 64JournalMathematical discoveries from program search with large language modelsBernardino Romera-Paredes et al. — 2024
  36. 65JournalLarge language models help computer programs to evolveJean-Baptiste Mouret — January 17, 2024
  37. 66Generative Modeling for Mathematical DiscoveryJordan S. Ellenberg et al. — March 17, 2025
  38. 68JournalFaster sorting algorithms discovered using deep reinforcement learningDaniel J. Mankowitz et al. — June 2023
  39. 70JournalScaling deep learning for materials discoveryAmil Merchant et al. — 2023
  40. 71JournalA generative model for inorganic materials designClaudio Zeni et al. — 2025
  41. 73JournalCrystalFlow: a flow-based generative model for crystalline materialsXiaoshan Luo et al. — 2025
  42. 76Microsoft adds OpenAI technology to Word and ExcelJonathan Vanian — CNBC — March 16, 2023
  43. 77The app's Memories feature just got a big upgradeMark Wilson — August 15, 2023
  44. 78Adobe Adds Generative AI To PhotoshopLaurie Sullivan — May 23, 2023
  45. 81"Draw Things" App brings Stable Diffusion to the iPhoneJonathan Kemper — November 10, 2022
  46. 83Who Needs ChatGPT? How to Run Your Own Free and Private AI ChatbotBrian Westover — Ziff Davis — September 28, 2023
  47. 84U.S. officials order Nvidia to halt sales of top AI chips to ChinaStephen Nellis et al. — September 1, 2022
  48. 85Nvidia's Chinese A800 GPU's Performance RevealedAnton Shilov — Tom's Hardware — May 7, 2023
  49. 91JournalGenerative adversarial networksIan Goodfellow et al. — October 22, 2020
  50. 92BookAn Introduction to Variational AutoencodersDiederik P. Kingma et al. — Emerald Insights — 2019
  51. 95News3 Obstacles to Regulating Generative AIAndrew Burt — October 31, 2023
  52. 102NewsThe New York Times sues OpenAI and Microsoft for using its stories to train chatbotsHaleluya Hadero et al. — AP News — December 27, 2023
  53. 104MagazineThe Generative AI Copyright Fight Is Just Getting StartedGregory Barber — December 9, 2023
  54. 113JournalTrajectories of AI policy in higher education: Interpretations, discourses, and enactments of students and teachersJack Tsao — 2025
  55. 114JournalNot quite eye to A.I.: Student and teacher perspectives on the use of generative artificial intelligence in the writing processA. Barrett et al. — 2023
  56. 116JournalImplementing equitable and intersectionality-aware AI in education: A practical guideM. Mangal et al. — 2024
  57. 118NewsLessons from ElizaBen Tarnoff — August 4, 2023
  58. 121Actors vs. AI: Strike brings focus to emerging use of advanced techKevin Collier — NBC News — July 14, 2023
  59. 130Digital News Report 2024Nic Newman et al. — Reuters Institute for the Study of Journalism — June 2024
  60. 132AI Search Has a Citation ProblemKlaudia Jaźwińska et al.
  61. 141NewsHere Come the Fake Videos, TooKevin Roose — March 4, 2018
  62. 142JournalHealth Disinformation Use Case Highlighting the Urgent Need for Artificial Intelligence Vigilance: Weapons of Mass DisinformationBradley D. Menz et al. — January 2024
  63. 143U.S. braces for foreign interference in 2024 electionMorgan Chalfant — March 6, 2024
  64. 151NewsMaking Deepfakes Gets Cheaper and Easier Thanks to A.I.Stuart A. Thompson — March 12, 2023
  65. 157AI Assists Chinese External PropagandaArthur Kaufman — 2025-09-08
  66. 158NewsFirst Came 'Spam.' Now, With A.I., We've Got 'Slop'Benjamin Hoffman — June 11, 2024
  67. 159NewsInvestigation Finds Actual Source of All That AI Slop on FacebookVictor Tangermann — August 10, 2024
  68. 160The MAGA Aesthetic Is AI SlopCharlie Warzel — August 21, 2024
  69. 169JournalA Shocking Amount of the Web is Machine Translated: Insights from Multi-Way ParallelismBrian Thompson et al. — Association for Computational Linguistics — August 2024
  70. 172ChatGPT "contamination": estimating the prevalence of LLMs in the scholarly literatureAndrew Gray — March 24, 2024
  71. 173How Much Research Is Being Written by Large Language Models?Prabha Kannan — Stanford University — May 13, 2024
  72. 174JournalAI models collapse when trained on recursively generated dataIlia Shumailov et al. — July 2024
  73. 175NewsWhen A.I.'s Output Is a Threat to A.I. ItselfAatish Bhatia — August 26, 2024
  74. 177JournalWhat we must be: AI and the future of porn studiesPeter Alilunas — 2 January 2024
  75. 180NewsDeepfakes: Get ready for phishing 2.0Stu Sjouwerman — December 26, 2022
  76. 184JournalFrom ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and PrivacyMaanak Gupta et al. — 2023
  77. 189CLOUD ActMarch 21, 2018
  78. 191Reaching for the CLOUDAlexander Berengaut — 2019-04-06
  79. 192How much energy does ChatGPT use?Josh You — February 7, 2025
  80. 193AI's carbon footprint is bigger than you thinkMelissa Heikkilä — December 5, 2023
  81. 194BookProceedings of the 2021 ACM Conference on Fairness, Accountability, and TransparencyEmily M. Bender et al. — Association for Computing Machinery — March 1, 2021
  82. 196JournalThe carbon impact of artificial intelligencePayal Dhar — August 1, 2020
  83. 200NewsWill A.I. Ruin the Planet or Save the Planet?Steve Lohr — August 26, 2024
  84. 203JournalTracking the carbon footprint of global generative artificial intelligenceZhaohao Ding et al. — May 5, 2025
  85. 204JournalGreenhouse gas emissions in US beef production can be reduced by up to 30% with the adoption of selected mitigation measuresRylie E. O. Pelton et al. — September 2024