RWS TrainAI study warns LLM performance shifts unpredictably between model releases

Reuters04-13 16:04
RWS TrainAI study warns LLM performance shifts unpredictably between model releases
  • RWS TrainAI study found multilingual performance gap between English and underrepresented languages has narrowed across leading large language models.
  • Google Gemini Pro scored above 4.5 out of 5 in Kinyarwanda, a language where earlier model generations struggled to produce coherent text.
  • Research flagged “benchmark drift,” with capabilities shifting unpredictably between model releases, including latest GPT version trailing smaller models on several content-generation tasks.
  • Tokenizer efficiency varied sharply by model and language, with cost differences reaching 3.5 times in certain languages.
  • Report urged enterprises to run continuous, independent evaluations on each new model release rather than rely on public leaderboards.


Disclaimer: This news brief was created by Public Technologies (PUBT) using generative artificial intelligence. While PUBT strives to provide accurate and timely information, this AI-generated content is for informational purposes only and should not be interpreted as financial, investment, or legal advice. RWS Holdings plc published the original content used to generate this news brief via Business Wire (Ref. ID: 202604130401BIZWIRE_USPR_____20260413_BW820932) on April 13, 2026, and is solely responsible for the information contained therein.

At the request of the copyright holder, you need to log in to view this content

Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.

Comments

We need your insight to fill this gap
Leave a comment