Skip to content

Questions about Generative pre-trained transformer

Short answers, pulled from the story.

When did Google publish the paper that introduced the transformer architecture used by GPT models?

Researchers at Google published the paper titled Attention Is All You Need on the 12th of June 2017. This document introduced the transformer architecture that powers all GPT models today and replaced older recurrent neural network systems.

What were the parameter counts for OpenAI's first three major GPT releases between 2018 and 2023?

OpenAI released GPT-1 with 117 million parameters on the 11th of June 2018. They launched GPT-2 with 1.5 billion parameters on the 14th of February 2019, followed by GPT-3 containing 175 billion parameters later in 2020. ChatGPT arrived using the GPT-3.5 architecture on the 30th of November 2022 before transitioning to GPT-4 on the 14th of March 2023.

How has the Generative pre-trained transformer evolved from text-only processing to multi-modal capabilities?

Early versions of these models focused exclusively on generating text based on written input. Recent iterations like GPT-4o now process and generate images alongside audio files while models such as o3 allocate additional computation time to analyze complex questions.

Which specific companies created specialized tools using the Generative pre-trained transformer foundation after 2022?

Companies adapted these foundations into specialized tools including EinsteinGPT for sales teams, BloombergGPT for financial professionals, Khanmigo for student tutoring, and SlackGPT for instant-messaging discussions. Google Workspace offers add-ons such as GPT for Sheets and Docs to enhance spreadsheet functionality.

What legal challenges did OpenAI face regarding the trademark status of the term GPT in 2023?

The United States Patent and Trademark Office declined to expedite handling of OpenAI's application in April 2023 and stated that GPT was both descriptive and generic by May 2023. The European Union Intellectual Property Office registered GPT as a trademark in spring 2023 but faced challenges by spring 2024 while Switzerland also granted registration in spring 2023 before similar disputes emerged globally.

Up Next