Skip to content
— CH. 1 · THE FIRST ALGORITHMIC VOICE —

Generative artificial intelligence

~5 min read · Ch. 1 of 6
6 sections
  • In 1906, Russian mathematician Andrey Markov introduced a concept that would eventually birth generative artificial intelligence. He analyzed vowel and consonant patterns in the novel Eugeny Onegin to model natural language. This early work laid the foundation for systems that could generate probabilistic text after training on a corpus of words. By the early 1970s, artists began using computers to extend these techniques beyond simple Markov models. Harold Cohen developed AARON, a pioneering computer program designed to autonomously create paintings. These works were exhibited and marked an early attempt at machine creativity.

    The terms generative AI planning or generative planning emerged in the 1980s and 1990s to describe systems generating sequences of actions. Military planners used these tools to generate crisis action plans while manufacturing sectors utilized them for process planning. By the early 1990s, this technology was considered relatively mature within its specific domains. The field then shifted focus toward deep learning technologies beginning in the late 2000s. Neural networks trained as discriminative models dominated the era due to the difficulty of generative modeling.

  • Advancements in 2014 produced the first practical deep neural networks capable of learning generative models for complex data like images. Variational autoencoders and generative adversarial networks enabled systems to output entire images rather than just class labels. DeepDream became one of the earliest examples of such deep generative models producing visual content. In 2017, the Transformer network replaced older long short-term memory models to enable advancements in generative capabilities. This architecture allowed models to process entire sequences simultaneously and capture long-range dependencies more efficiently.

    OpenAI developed the first generative pre-trained transformer known as GPT-1 in 2018 following the Transformer breakthrough. Generative adversarial networks consist of two neural networks trained simultaneously in a competitive setting. A generator creates synthetic data by transforming random noise into samples resembling training datasets. A discriminator learns to distinguish authentic data from the synthetic data produced by the generator. These two models engage in a minimax game where the generator aims to fool the discriminator while the discriminator improves its detection abilities. Transformers allow models to capture the significance of every word in a sequence when predicting subsequent words.

  • In March 2020, the release of 15.ai marked one of the earliest popular use cases of generative AI. An anonymous MIT researcher created this free web application to generate convincing character voices using minimal training data. The platform became the first mainstream service for AI voice cloning used in memes and content creation. By 2021, DALL-E emerged as a transformer-based model advancing AI-generated imagery. Open-source projects like VQGAN+CLIP and DALL-E Mini became widely used public text-to-image generation tools before mobile applications allowed users to generate art from simple prompts.

    Midjourney and Stable Diffusion launched in 2022 to democratize access to artificial intelligence art creation. These systems generated photorealistic images based on text descriptions leading to widespread adoption among artists and designers. November 2022 saw the public release of ChatGPT which popularized generative AI for general-purpose text tasks. A 2024 survey revealed that Asia-Pacific countries were significantly more optimistic about generative AI than Western societies. China emerged as a global leader with 83% of respondents using the technology compared to a global average of 54%. Chinese entities filed over 38,000 generative AI patents between 2014 and 2023 surpassing United States patent applications.

  • In April 2023 reports indicated image generation AI resulted in 70% of jobs for video game illustrators in China being lost. Fran Drescher declared during the 2023 SAG-AFTRA strike that artificial intelligence poses an existential threat to creative professions. Voice generation AI emerged as a potential challenge to the voice acting sector while developments contributed to Hollywood labor disputes. However a 2025 study concluded the US labor market had not experienced discernible disruption from generative AI so far.

    Generative models reflect and amplify cultural biases present in underlying data. A language model might assume doctors are male and secretaries are female if those biases exist in training data. An image model prompted with text describing a CEO might disproportionately generate images of white male CEOs when trained on racially biased datasets. Deepfakes have garnered widespread attention for uses including revenge porn fake news hoaxes health disinformation financial fraud and covert foreign election interference. In July 2023 fact-checking company Logically found popular models would produce plausible disinformation images when prompted to do so.

  • Scientists and journalists expressed concerns about the environmental impact of developing and deploying generative models. High CO2 emissions large amounts of freshwater used for data centers and high electricity usage characterize the industry. The carbon footprint globally is estimated to be growing steadily with potential annual emissions ranging from 18.21 to 245.94 million tons of CO2 by 2035. Highest estimates for 2035 near the impact of the United States beef industry which currently emits 257.5 million tons annually as of 2024.

    Proposed mitigation strategies include increasing efficiency of data centers to reduce energy usage and building more efficient machine learning models. Regulating transparency of these models and their energy and water usage remains a key focus area. Researchers are encouraged to publish data on their models' carbon footprint while subject matter experts understanding both machine learning and climate science become more numerous. Large-scale data centers consume fresh water for cooling and generate significant e-waste alongside high energy consumption that grows steadily.

Common questions

When did Russian mathematician Andrey Markov introduce the concept that birthed generative artificial intelligence?

Russian mathematician Andrey Markov introduced the concept in 1906. He analyzed vowel and consonant patterns in the novel Eugeny Onegin to model natural language.

What year did OpenAI develop the first generative pre-trained transformer known as GPT-1?

OpenAI developed the first generative pre-trained transformer known as GPT-1 in 2018. This development followed the Transformer breakthrough which allowed models to process entire sequences simultaneously.

Which company sued Stability AI over the use of its images to train Stable Diffusion?

Getty Images sued Stability AI over the use of its images to train Stable Diffusion. The Authors Guild and The New York Times also sued Microsoft and OpenAI regarding the use of their works to train ChatGPT.

How many generative AI patents did Chinese entities file between 2014 and 2023?

Chinese entities filed over 38,000 generative AI patents between 2014 and 2023. This number surpassed United States patent applications during the same period.

When did the United States Copyright Office register the first visual artwork composed entirely of AI-generated materials titled A Single Piece of American Cheese?

The United States Copyright Office registered the first visual artwork composed entirely of AI-generated materials titled A Single Piece of American Cheese in January 2025. This registration occurred after the office released extensive guidance establishing that users can exert control over selection and placement of creative elements.

All sources

211 references cited across the entry

  1. 1journalGenerative artificial intelligenceLeonardo Banh et al. — 2023
  2. 3webAnthropic Said to Be Closing In on $300 Million in New A.I. FundingErin Griffith et al. — January 27, 2023
  3. 4newsA Cheat Sheet to AI Buzzwords and Their MeaningsNate Lanxon et al. — March 10, 2023
  4. 8journalGenerative AI and large language models in health care: pathways to implementationMarium M. Raza et al. — March 7, 2024
  5. 10webThe Impact of Generative AI on Hollywood and EntertainmentThomas H. Davenport and Randy Bean — June 19, 2023
  6. 11citationGenerative AI at WorkErik Brynjolfsson et al. — April 2023
  7. 12webDon't fear an AI-induced jobs apocalypse just yetThe Economist — March 6, 2023
  8. 13webIn Hollywood writers' battle against AI, humans win (for now)Jake Coyle — Associated Press — September 27, 2023
  9. 15journalGovernance of Generative AIAraz Taeihagh — 2025-04-04
  10. 16journalMisinformation reloaded? Fears about the impact of generative AI on misinformation are overblownFelix M. Simon et al. — 18 October 2023
  11. 19bookIntroduction to ProbabilityCharles Miller Grinstead et al. — American Mathematical Society — 1997
  12. 20bookMarkov Chains: Gibbs Fields, Monte Carlo Simulation, and QueuesPierre Bremaud — Springer Science & Business Media — March 9, 2013
  13. 21journalFirst Links in the Markov ChainBrian Hayes — 2013
  14. 22journalThe Hierarchical Hidden Markov Model: Analysis and ApplicationsShai Fine et al. — July 1998
  15. 23journalA Brief History of Generative AINathan Bergen et al. — 2023
  16. 25journalAutomated planning and scheduling for goal-based autonomous spacecraftSteve Chien — 1998
  17. 26bookARPA/Rome Laboratory Knowledge-based Planning and Scheduling Initiative Workshop ProceedingsThe Advanced Research Projects Agency, Department of Defense, and Rome Laboratory, US Air Force, Griffiss AFB — 1994
  18. 27bookAn Autonomous Spacecraft Agent PrototypeBarney Pell et al. — Autonomous Robots Volume 5, No. 1 — 1998
  19. 29bookMachine learning: discriminative and generativeTony Jebara — Springer Science & Business Media — 2012
  20. 30journalAuto-Encoding Variational BayesDiederik P. Kingma — 2014
  21. 31journalGenerative Adversarial NetsIan Goodfellow — 2014
  22. 32journalAttention Is All You NeedAshish Vaswani — 2017
  23. 43webHow ChatGPT turned generative AI into an "anything tool"Haomiao Huang — August 23, 2023
  24. 44journalHuman-AI agency in the age of generative AISebastian Krakowski — March 2025
  25. 47webYoung Chinese Have Almost No Concerns About AI, Survey FindsHe Qitong et al. — Shanghai United Media Group — May 31, 2024
  26. 50journalArtificial Intelligence in Healthcare: Applications and ChallengesAyush Kaushal — 2023
  27. 51journalOn the Opportunities and Risks of Foundation ModelsRishi Bommasani — 2021
  28. 52journalArt and the science of generative AIZiv Epstein — 2023
  29. 53journalLanguage Models are Few-Shot LearnersTom B. Brown — 2020
  30. 54arxivOn the opportunities and risks of foundation modelsR. Bommasani — 2021
  31. 55journalEvaluating Large Language Models Trained on CodeMark Chen — 2021
  32. 56journalWaveNet: A Generative Model for Raw AudioAaron van den Oord — 2016
  33. 58conferenceZero-shot text-to-image generationAditya Ramesh — 2021
  34. 61journalDreamFusion: Text-to-3D using 2D DiffusionBen Poole — 2022
  35. 62journalWorld ModelsDavid Ha — 2018
  36. 63journalA Generalist AgentScott Reed — 2022
  37. 64journalMathematical discoveries from program search with large language modelsBernardino Romera-Paredes et al. — 2024
  38. 65journalLarge language models help computer programs to evolveJean-Baptiste Mouret — January 17, 2024
  39. 66arxivGenerative Modeling for Mathematical DiscoveryJordan S. Ellenberg et al. — March 17, 2025
  40. 68journalFaster sorting algorithms discovered using deep reinforcement learningDaniel J. Mankowitz et al. — June 2023
  41. 70journalScaling deep learning for materials discoveryAmil Merchant et al. — 2023
  42. 71journalA generative model for inorganic materials designClaudio Zeni et al. — 2025
  43. 73journalCrystalFlow: a flow-based generative model for crystalline materialsXiaoshan Luo et al. — 2025
  44. 76webMicrosoft adds OpenAI technology to Word and ExcelJonathan Vanian — CNBC — March 16, 2023
  45. 77webThe app's Memories feature just got a big upgradeMark Wilson — August 15, 2023
  46. 78webAdobe Adds Generative AI To PhotoshopLaurie Sullivan — May 23, 2023
  47. 81web"Draw Things" App brings Stable Diffusion to the iPhoneJonathan Kemper — November 10, 2022
  48. 83webWho Needs ChatGPT? How to Run Your Own Free and Private AI ChatbotBrian Westover — Ziff Davis — September 28, 2023
  49. 84webU.S. officials order Nvidia to halt sales of top AI chips to ChinaStephen Nellis et al. — September 1, 2022
  50. 85webNvidia's Chinese A800 GPU's Performance RevealedAnton Shilov — Tom's Hardware — May 7, 2023
  51. 86webHow China's Biren Is Attempting To Evade US SanctionsDylan Patel — October 24, 2022
  52. 91journalGenerative adversarial networksIan Goodfellow et al. — October 22, 2020
  53. 92bookAn Introduction to Variational AutoencodersDiederik P. Kingma et al. — Emerald Insights — 2019
  54. 95news3 Obstacles to Regulating Generative AIAndrew Burt — October 31, 2023
  55. 102newsThe New York Times sues OpenAI and Microsoft for using its stories to train chatbotsHaleluya Hadero et al. — AP News — December 27, 2023
  56. 104magazineThe Generative AI Copyright Fight Is Just Getting StartedGregory Barber — December 9, 2023
  57. 106webAI-generated art cannot receive copyrights, US court saysBlake Brittain — August 21, 2023
  58. 113journalTrajectories of AI policy in higher education: Interpretations, discourses, and enactments of students and teachersJack Tsao — 2025
  59. 114journalNot quite eye to A.I.: Student and teacher perspectives on the use of generative artificial intelligence in the writing processA. Barrett et al. — 2023
  60. 116journalImplementing equitable and intersectionality-aware AI in education: A practical guideM. Mangal et al. — 2024
  61. 118newsLessons from ElizaBen Tarnoff — August 4, 2023
  62. 121webActors vs. AI: Strike brings focus to emerging use of advanced techKevin Collier — NBC News — July 14, 2023
  63. 122webElevenLabs' voice-generating tools launch out of betaKyle Wiggers — August 22, 2023
  64. 130webDigital News Report 2024Nic Newman et al. — Reuters Institute for the Study of Journalism — June 2024
  65. 132webAI Search Has a Citation ProblemKlaudia Jaźwińska et al.
  66. 141newsHere Come the Fake Videos, TooKevin Roose — March 4, 2018
  67. 142journalHealth Disinformation Use Case Highlighting the Urgent Need for Artificial Intelligence Vigilance: Weapons of Mass DisinformationBradley D. Menz et al. — January 2024
  68. 143webU.S. braces for foreign interference in 2024 electionMorgan Chalfant — March 6, 2024
  69. 151newsMaking Deepfakes Gets Cheaper and Easier Thanks to A.I.Stuart A. Thompson — March 12, 2023
  70. 155webAI songs that mimic popular artists raising alarms in the music industryEmily Lippiello et al. — November 3, 2023
  71. 157webAI Assists Chinese External PropagandaArthur Kaufman — 2025-09-08
  72. 158newsFirst Came 'Spam.' Now, With A.I., We've Got 'Slop'Benjamin Hoffman — June 11, 2024
  73. 159newsInvestigation Finds Actual Source of All That AI Slop on FacebookVictor Tangermann — August 10, 2024
  74. 160webThe MAGA Aesthetic Is AI SlopCharlie Warzel — August 21, 2024
  75. 163webGoogle News Is Boosting Garbage AI-Generated ArticlesJoseph Cox — January 18, 2024
  76. 169journalA Shocking Amount of the Web is Machine Translated: Insights from Multi-Way ParallelismBrian Thompson et al. — Association for Computational Linguistics — August 2024
  77. 172arxivChatGPT "contamination": estimating the prevalence of LLMs in the scholarly literatureAndrew Gray — March 24, 2024
  78. 173webHow Much Research Is Being Written by Large Language Models?Prabha Kannan — Stanford University — May 13, 2024
  79. 174journalAI models collapse when trained on recursively generated dataIlia Shumailov et al. — July 2024
  80. 175newsWhen A.I.'s Output Is a Threat to A.I. ItselfAatish Bhatia — August 26, 2024
  81. 177journalWhat we must be: AI and the future of porn studiesPeter Alilunas — 2 January 2024
  82. 180newsDeepfakes: Get ready for phishing 2.0Stu Sjouwerman — December 26, 2022
  83. 184journalFrom ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and PrivacyMaanak Gupta et al. — 2023
  84. 189webCLOUD ActMarch 21, 2018
  85. 191webReaching for the CLOUDAlexander Berengaut — 2019-04-06
  86. 192webHow much energy does ChatGPT use?Josh You — February 7, 2025
  87. 193webAI's carbon footprint is bigger than you thinkMelissa Heikkilä — December 5, 2023
  88. 194bookProceedings of the 2021 ACM Conference on Fairness, Accountability, and TransparencyEmily M. Bender et al. — Association for Computing Machinery — March 1, 2021
  89. 196journalThe carbon impact of artificial intelligencePayal Dhar — August 1, 2020
  90. 200newsWill A.I. Ruin the Planet or Save the Planet?Steve Lohr — August 26, 2024
  91. 203journalTracking the carbon footprint of global generative artificial intelligenceZhaohao Ding et al. — May 5, 2025
  92. 204journalGreenhouse gas emissions in US beef production can be reduced by up to 30% with the adoption of selected mitigation measuresRylie E. O. Pelton et al. — September 2024