OpenAI is taking up the mantle against AI 'hallucinations,' which occur when models like ChatGPT or Google's Bard fabricate information entirely The research comes at a time when misinformation stemming from AI systems is more hotly debated than ever
"Detecting and mitigating a model's logical mistakes, or hallucinations, is a critical step towards building aligned AGI [or artificial general intelligence]," Karl Cobbe, mathgen researcher at OpenAI, told CNBC, noting that while OpenAI did not invent the process-supervision approach, the company is helping to push it forward."The motivation behind this research is to address hallucinations in order to make models more capable at solving challenging reasoning problems.
Ben Winters, senior counsel at the Electronic Privacy Information Center and leader of its AI and human rights project, expressed skepticism, telling CNBC he would like to examine the full dataset and accompanying examples. Since it's unclear that the OpenAI paper has been peer-reviewed or reviewed in another format, Suresh Venkatasubramanian, director of the center for technology responsibility at Brown University, told CNBC that he views the research as more of a preliminary observation than anything else.
Venkatasubramanian added,"Some of the hallucinatory stuff that people have been concerned about is [models] making up citations and references. There is no evidence in this paper that this would work for that. … It's not that I'm saying it won't work; I'm saying that this paper does not provide that evidence."
France Dernières Nouvelles, France Actualités
Similar News:Vous pouvez également lire des articles d'actualité similaires à celui-ci que nous avons collectés auprès d'autres sources d'information.
OpenAI isn’t doing enough to make ChatGPT’s limitations clearChatGPT needs more prominent warning labels.
Lire la suite »
OpenAI CEO Signs Letter Warning AI Could Cause Human 'Extinction'Sam Altman, the CEO of OpenAI, has signed onto a one-sentence open letter warning about the 'extinction' dangers posed by AI, LOL.
Lire la suite »
AI poses 'extinction' risk, OpenAI, DeepMind, and Anthropic CEOs sayInsider tells the global tech, finance, markets, media, healthcare, and strategy stories you want to know.
Lire la suite »
Exclusive: EU's Breton to discuss AI rules with OpenAI CEO in JuneEU industry chief Thierry Breton will meet OpenAI CEO Sam Altman in San Francisco next month to discuss how the company will implement the bloc's world-leading rules on artificial intelligence (AI), EU officials said on Tuesday.
Lire la suite »
Unlike Elon Musk, OpenAI's Sam Altman has 'no desire' to live on MarsUnlike Elon Musk, OpenAI's Sam Altman has 'no desire' to live on Mars — but he would consider sending robots there
Lire la suite »
OpenAI CEO Freaks Out, Threatens to Leave EU Over New AI RegulationsAs the European Union readies its new artificial intelligence rules, the CEO of OpenAI is, apparently, already preparing his counter-attack.
Lire la suite »