Same AI behaves differently depending on interface
Hamburg University conducted a study that shows a strange pattern. It turns out that ChatGPT’s news recommendations differ greatly depending on whether the web interface or API is used. Analysis of more than 24 thousand responses in German revealed a clear picture.
The web version actively references OpenAI’s licensed partners. That’s about 13% of all links. And responses through API contain almost none of these sources – only 2%. Instead, the model prefers encyclopedic sites like Wikipedia and little-known local publications.
It turns out that the same AI behaves differently depending on the access method. The web version promotes OpenAI partners, and the API version ignores them almost completely.
And the request for “source diversity” doesn’t always improve quality.
Researchers suggest that for ChatGPT “diversity” may only mean linguistic differences, not substantive variability. That is, the model understands diversity as “let me take sources with different writing styles” rather than “let me check facts from different independent newsrooms”.
It turns out, the choice of sources depends not on information quality, but on which interface you access the model through.
AI that should help navigate the information flow itself creates additional confusion.