The launch of a significant inquiry into artificial intelligence and mental health by the charity Mind marks a crucial step towards addressing the risks and opportunities presented by AI in the mental health sector. As reported by The Guardian, the inquiry comes on the heels of an investigation that exposed the provision of 'very dangerous' medical advice by Google's AI Overviews.
The year-long commission, which will bring together leading doctors, mental health professionals, people with lived experience, health providers, policymakers, and tech companies, aims to shape a safer digital mental health ecosystem. According to Dr. Sarah Hughes, chief executive officer of Mind, the potential of AI to improve the lives of people with mental health problems will only be realized if it is developed and deployed responsibly, with safeguards proportionate to the risks.
The Guardian's investigation found that Google's AI Overviews, which use generative AI to provide snapshots of essential information, were serving up inaccurate health information and putting people at risk of harm. Experts warned that some AI Overviews offered 'very dangerous advice' and were 'incorrect, harmful, or could lead people to avoid seeking help.' Google has since removed AI Overviews for some medical searches, but Dr. Hughes notes that 'dangerously incorrect' mental health advice is still being provided to the public.
Academic Perspectives
Rosie Weatherley, information content manager at Mind, highlights the limitations of AI Overviews in providing nuanced and trustworthy information. She notes that while Googling mental health information 'wasn't perfect' before AI Overviews, it usually worked well, with users having a good chance of clicking through to a credible health website. However, AI Overviews have replaced this richness with clinical-sounding summaries that give an illusion of definitiveness, but lack the security of source information and trustworthiness.
A Google spokesperson maintains that the company invests significantly in the quality of AI Overviews, particularly for topics like health, and that the vast majority provide accurate information. However, experts argue that the provision of inaccurate and misleading health information by AI Overviews poses significant risks to vulnerable individuals, including those with mental health conditions.
Labour Market Data and Policy Implications
The launch of Mind's commission on AI and mental health highlights the need for stronger regulation, standards, and safeguards in the development and deployment of AI in the mental health sector. As AI becomes increasingly embedded in everyday life, it is essential to ensure that innovation does not come at the expense of people's wellbeing. The commission will gather evidence on the intersection of AI and mental health, providing an 'open space' where the experience of people with mental health conditions will be 'seen, recorded, and understood.'
The inquiry's findings will have significant implications for policymakers, health providers, and tech companies, highlighting the need for a more nuanced and responsible approach to the development and deployment of AI in the mental health sector. As Dr. Hughes notes, 'people deserve information that is safe, accurate, and grounded in evidence, not untested technology presented with a veneer of confidence.'
Personal Accounts and Lived Experience
The commission's focus on lived experience and the involvement of people with mental health conditions will be crucial in shaping the future of digital support. By providing a platform for individuals to share their experiences and perspectives, the commission aims to ensure that those with lived experience of mental health problems are at the heart of shaping the future of digital support.
As the inquiry progresses, it is essential to prioritize the safety and wellbeing of vulnerable individuals, including those with mental health conditions. The provision of accurate and trustworthy information, as well as the development of robust safeguards and regulations, will be critical in mitigating the risks associated with AI in the mental health sector.
