Google’s Med-PaLM Passes US Medical Exam

Google’s AI-powered medical chatbot, Med-PaLM, passes the US Medical Licensing Examination (USMLE)

[{"selector":"#anim-3a247b73-7d95-4e03-a711-dee3aa9011b2","keyframes":{"transform":["translate3d(-127.44361%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-62a966c1-896c-4642-a91e-c7f6b73dc113","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bf5c2e5a-7dfa-44f2-9676-d2af1c222f0b","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

The exam is taken by medical students and physicians in training in the US

[{"selector":"#anim-3be2fcd5-3e57-4988-80ae-c6ac06d4e63f","keyframes":{"transform":["translate3d(-138.00905%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-92f30f4c-7544-4e17-8aee-b58ec353a448","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-31af8c91-1ff6-4f86-9ec3-cb88afba7779","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

The passing grade for the exam is around 60 percent, and Med-PaLM scored 67.6 percent on the USMLE-style multiple-choice questions

[{"selector":"#anim-7077d4cd-9dfb-4f8f-8205-407071481b65","keyframes":{"transform":["translate3d(-120.74831%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c285de81-7608-4ffb-af9a-2593577b7e9f","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ee707b3b-1954-4fef-afed-a34b5b16c32a","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

Med-PaLM 2 scored 86.5 percent on the USMLE exam. However, there is an elephant in the room

[{"selector":"#anim-271d0663-1752-4545-a0e4-eec47dc1818c","keyframes":{"transform":["translate3d(-134.28571%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d09e4f36-f2eb-47f7-bdc9-d18d78ee80c2","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-21720c55-005d-4510-a301-12d2510c0658","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

James Davenport, a computer scientist from the UK, said there is a big difference between answering medical questions and actual medicine

[{"selector":"#anim-5a45fdd2-9ac7-4f66-b499-b2046d2b96be","keyframes":{"transform":["translate3d(-121.03449%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-260424f4-eba9-4e1b-b110-157537628490","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-51243bcb-fb17-4aa5-b518-a2ba3f090b9c","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

Google’s Med-PaLM Passes US Medical Exam

Google’s AI-powered medical chatbot, Med-PaLM, passes the US Medical Licensing Examination (USMLE)

The exam is taken by medical students and physicians in training in the US

The passing grade for the exam is around 60 percent, and Med-PaLM scored 67.6 percent on the USMLE-style multiple-choice questions

Med-PaLM 2 scored 86.5 percent on the USMLE exam. However, there is an elephant in the room

James Davenport, a computer scientist from the UK, said there is a big difference between answering medical questions and actual medicine

Read more stories