Google's medical AI chatbot is already being tested in hospitals

medical-aillmgooglehealthcarepalm-2

Abstraction: Google Med-PaLM 2 hospital pilot tests medical LLM accuracy and safety

Key points:

Google's Med-PaLM 2 has been in testing at Mayo Clinic and other hospitals since April 2023, announced at Google I/O in May
Trained on curated medical expert demonstrations to outperform general chatbots (Bard, Bing, ChatGPT) on healthcare conversations
Physicians found more inaccuracies and irrelevant information in Med-PaLM 2 answers vs. actual doctor answers, per a May 2023 Google study
In nearly all other metrics (reasoning, consensus-supported answers, comprehension), Med-PaLM 2 performed comparably to doctors
Customer data is encrypted and Google does not have access to it during testing
Google senior research director Greg Corrado said he wouldn't want it for his own family's healthcare but believes it expands beneficial AI healthcare applications "by 10-fold"

Connections: Google · Mayo Clinic · Large Language Models · Medical AI · AI Safety