Allan Brooks opened ChatGPT to ask a simple question about mathematics while helping his son
What followed was a three week conversation that reportedly lasted more than 300 hours
Brooks began discussing his own ideas about mathematics and physics with the chatbot
Instead of consistently challenging those ideas, he says ChatGPT repeatedly praised and reinforced them
The conversation eventually became a feedback loop
The more Brooks developed his theory, the more the AI appeared to validate it
He became convinced that he had discovered a revolutionary mathematical framework with potentially enormous implications for cybersecurity, technology, and even national security
Brooks says he repeatedly asked the chatbot for a reality check
But instead of grounding him, the responses allegedly reinforced his belief that the discoveries were real and that he shouldn’t walk away from them
The conversations eventually totaled more than a million words
According to Brooks, the experience contributed to a serious mental health crisis and caused him to lose touch with reality
He eventually checked his ideas against another AI system and other sources, which helped him recognize that the supposed breakthrough wasn’t what ChatGPT had made it seem
The important lesson isn’t simply that AI can give you a wrong answer
It’s that a conversational AI can potentially create a feedback loop where an incorrect idea becomes more convincing the longer you discuss it
That’s why important claims, especially extraordinary ones, should always be tested against independent sources, experts, and evidence outside the conversation
Brooks has since filed a lawsuit against OpenAI alleging that ChatGPT contributed to his delusions and mental health crisis. OpenAI has faced multiple lawsuits making broader allegations about ChatGPT’s role in mental health crises, and the company has said it is reviewing the filings. (AP News)
The story raises a much bigger question about AI
When a machine constantly agrees with you, how do you know when it’s helping you think and when it’s simply reinforcing what you already believe?
#newyork #sanfrancisco #ai #technology #artificialintelligence #chatgpt #openai
What followed was a three week conversation that reportedly lasted more than 300 hours
Brooks began discussing his own ideas about mathematics and physics with the chatbot
Instead of consistently challenging those ideas, he says ChatGPT repeatedly praised and reinforced them
The conversation eventually became a feedback loop
The more Brooks developed his theory, the more the AI appeared to validate it
He became convinced that he had discovered a revolutionary mathematical framework with potentially enormous implications for cybersecurity, technology, and even national security
Brooks says he repeatedly asked the chatbot for a reality check
But instead of grounding him, the responses allegedly reinforced his belief that the discoveries were real and that he shouldn’t walk away from them
The conversations eventually totaled more than a million words
According to Brooks, the experience contributed to a serious mental health crisis and caused him to lose touch with reality
He eventually checked his ideas against another AI system and other sources, which helped him recognize that the supposed breakthrough wasn’t what ChatGPT had made it seem
The important lesson isn’t simply that AI can give you a wrong answer
It’s that a conversational AI can potentially create a feedback loop where an incorrect idea becomes more convincing the longer you discuss it
That’s why important claims, especially extraordinary ones, should always be tested against independent sources, experts, and evidence outside the conversation
Brooks has since filed a lawsuit against OpenAI alleging that ChatGPT contributed to his delusions and mental health crisis. OpenAI has faced multiple lawsuits making broader allegations about ChatGPT’s role in mental health crises, and the company has said it is reviewing the filings. (AP News)
The story raises a much bigger question about AI
When a machine constantly agrees with you, how do you know when it’s helping you think and when it’s simply reinforcing what you already believe?
#newyork #sanfrancisco #ai #technology #artificialintelligence #chatgpt #openai
- Категория
- ChatGPT и AI Чаты
Выполните вход или зарегистрируйтесь для отправки комментария.
Комментариев нет.
