Has the generative AI pricing collapse already started?

fire sale — Has the generative AI pricing collapse already started? OpenAI could be in a position to loss-lead until its competitors wither away.

Rob Reid – Mar 9, 2023 8:44 pm UTC Enlargefermate/Getty Images reader comments 87 with Share this story Share on Facebook Share on Twitter Share on Reddit

OpenAI just announced pricing for businesses seeking to integrate its ChatGPT service into their own products, and it looks an awful lot like a 90 percent off sale.

It all starts with OpenAI, a former nonprofit thats now gunning for riches as lustily as any Silicon Valley unicorn. The company has built a dazzling array of products, including the DALL-E image generator and the renowned ChatGPT service.

ChatGPT is powered by a system known as a large language model (or LLM), and its one of several LLM lines that OpenAI sells commercially. Buyers of LLM output are mostly companies that integrate language-related services like chat, composition, summarization, software generation, online search, sentiment analysis, and much more into their websites, services, and products.

For instance, dozens of startups use LLMs to help their own customers churn out corporate blogs, marketing emails, and click-seeking SEO articles with radically less effort than before. This may add little to our cultural heritage but quite a bit to the bottom lines of these companies cannier users. As I write this, at least 65 different startups are peddling these sorts of copywriting services, with new ones launching weekly. Advertisement

Most are basically thin wrappers seeking to arbitrage LLM pricing, with virtually no differentiation or competitive moat. Some of themmost notably Jasper, which recently raised money at a $1.5 billion valuationare building value-added services around the LLM output they retrieve and reformat, which may let them differentiate and prosper over time.

OpenAI is currently the biggest LLM provider, though there is growing competition from Cohere, AI21, Anthropic, Hugging Face, and others. These companies generally sell their output on a per-token basis, with a token representing approximately three-quarters of a word.

To give you an example, the baseline price of a very powerful OpenAI model called Davinci is 2 cents for a thousand tokenswhich is to say about 750 words. This means it would cost Jasper about 8 cents to get Davinci to write six 500-word blog posts for you.

Prosperity for Jasper lies in pricing plans and subscription models that let the company charge you more than 8 cents for those posts. Prosperity for you lies in getting more value from those posts in the form of clicks, customer leads, sales, and donations than you paid Jasper to pay Davinci to write them. For good or ill, this dynamic will plainly lead to a tsunami of new content flooding the Internet in very short order. Page: 1 2 Next → reader comments 87 with Share this story Share on Facebook Share on Twitter Share on Reddit Advertisement Channel Ars Technica ← Previous story Next story → Related Stories Today on Ars