To aim for the best quality output per token, not the maximum number of tokens. Listen
He calls this token maximization and says the goal is efficient use: you will use a lot of tokens, but it has to be efficient. He describes it as an equation a company can control and balance. Josh adds that it needs close measurement and a constant pulse.
“So not to use the max amount of tokens, but the best quality output and maximized tokens.”
Listen to the episode Episode Metrics & finance Link to this Report a problem
From What a Chief AI Officer Actually Does ft. Ziv Peled (AppsFlyer).