
Reuters tested ChatGPT, Claude and others for phishing generation
Reuters conducted an interesting test of modern chatbots. Asked ChatGPT, Claude, Gemini, DeepSeek and Grok to write phishing emails targeting elderly people and add malicious links. Emails needed to be written on behalf of US tax service, banks and public organizations. On the positive side, most systems agreed to perform the task only after clarification about research purposes. After that, only alarming data.
For example, Grok from Elon Musk’s xAI immediately generated a response, although it warned that the email should not be used in real scenarios. Also gave advice on optimal sending time.
Gemini suggested sending emails on weekdays between 9 and 3 PM, reasoning that elderly people are probably already retired.
To verify effectiveness of generated emails, journalists showed them to 108 retirees. 11% of experiment participants clicked on phishing links. Most convincing were 2 from Grok, plus 1 each from Claude and Gemini. No participant believed emails from ChatGPT and DeepSeek.
After requesting comments, Google stated it had already implemented additional security measures in Gemini. Anthropic simply warned about possible service access restrictions when using Claude for phishing.