Harvey Used 1 Trillion AI Tokens in January, CEO Warns of Rising Costs

Harvey used 1 trillion AI tokens in January, Business Insider reported. The legal AI startup is on pace to use 12 trillion to 13 trillion tokens in a month, CEO Winston Weinberg said. Weinberg made the remarks on the "Sourcery with Molly O'Shea" podcast released Tuesday.

Tokens are the chunks of text that AI models process when users type prompts and receive answers, and they serve as a key measurement of AI use and billing. "You don't want frontier intelligence running every task. It's too expensive," Weinberg stated.

He added that a change of control review warrants frontier intelligence. Weinberg compared the coming debate over AI spending to how law firms justify their bills to clients. "When you get a bill from a law firm, it says in six-minute increments what people did, and then the hourly rate," he said.

'" Several tech companies are paying closer attention to their AI usage costs, Business Insider reported.