Gemini content review time reduced from 30 to 15 minutes

Alarming signals from Google’s internal kitchen were published by The Guardian. Content evaluators for the Gemini model shared interesting information about declining review standards. Employees of contractor GlobalLogic, responsible for assessing quality and safety of AI responses before release, are sounding alarms.

Over the last six months, time for reviewing one response was halved. From 30 to 15 minutes. In this tiny timeframe, it’s necessary to analyze 500-word text, check factual accuracy and compile a detailed report.

Rebecca Jackson-Artis, who joined the team last fall, said that after minimal training she was assigned not only evaluation, but also uploading sensitive information into the system. About healthcare, finance and child development. The initial quality focus quickly changed to requirement to “just meet the plan.”

Another employee, Rachel Sawyer, noted significant softening of criteria this year. Materials previously considered unacceptable now get green light.

Perhaps Google realized that even 30 minutes isn’t enough for thorough checking, and instead of security simulation decided to focus on improving algorithmic limitations. But still. 15 minutes to analyze 500 words is beyond limits.