{"id":50299,"date":"2024-12-30T20:36:40","date_gmt":"2024-12-30T15:06:40","guid":{"rendered":"http:\/\/officechai.com\/?p=50299"},"modified":"2025-01-19T03:06:07","modified_gmt":"2025-01-18T21:36:07","slug":"openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors","status":"publish","type":"post","link":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/","title":{"rendered":"OpenAI’s Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors"},"content":{"rendered":"\n

Math and coding are rapidly falling <\/a>to AI, and it looks like medicine might be next.<\/p>\n\n\n\n

OpenAI’s o1-preview model handily outperformed human doctors at diagnosing illnesses, a research paper<\/a>has found. Titled “Superhuman performance of a large language model on the reasoning tasks of a physician,” the paper compared the accuracy of diagnoses of clinical cases between human doctors and OpenAI’s o-1 model, which uses chain-of-thought reasoning. In a particular test, the o1-preview model managed to correctly diagnose around 80 percent of cases, compared to around 60 percent accuracy for GPT-4 and just 30 percent for human clinicians.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

“We evaluated the medical reasoning abilities of the o1-preview model across five diverse experiments, comparing the model to historical controls of human baselines and GPT-4,” the research paper said. “As in non-medical studies, we saw significant gains in performance for most tasks for o1-preview. For differential diagnosis generation, o1-preview surpasses both GPT-4 and previous non-LLM differential generators, as well as the human baseline,” it added.<\/p>\n\n\n\n

The paper tested used several different kinds of medical cases to determine how the model performed in detecting them. The cases were fed into the model, and the model then gave its diagnosis. The results were scored by human doctors, who decided whether the diagnosis of the model was accurate. After the researchers had looked at the results, they called the performance of AI models “superhuman”.<\/p>\n\n\n\n

Medicine does look to be a field that could very easily be disrupted by AI. Most modern doctors look at lab reports and hear symptoms from patients before making their diagnosis and prescribing their course of treatment. All this data can be fed into an LLMs, and modern LLMs are seemingly already able to parse it correctly and using their rich databases, able to diagnose the underlying condition. Additionally, AI systems have become extremely adept at seeing X-ray and other visual reports , and can also double up as radiologists<\/a>. The current results indicate that it might not be long before most doctors have an LLM with them that helps them guide their diagnoses. And if these LLMs can produce good results, they might end up slowly chipping away at many doctor jobs going forward.<\/p>\n","protected":false},"excerpt":{"rendered":"

Math and coding are rapidly falling to AI, and it looks like medicine might be next. OpenAI’s o1-preview model handily outperformed human doctors…<\/p>\n","protected":false},"author":1,"featured_media":50304,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1029,46],"tags":[],"class_list":["post-50299","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-stories"],"yoast_head":"\nOpenAI's Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"OpenAI's Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors\" \/>\n<meta property=\"og:description\" content=\"Math and coding are rapidly falling to AI, and it looks like medicine might be next. OpenAI’s o1-preview model handily outperformed human doctors...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/\" \/>\n<meta property=\"og:site_name\" content=\"OfficeChai\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/OfficeChai\/\" \/>\n<meta property=\"article:published_time\" content=\"2024-12-30T15:06:40+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-01-18T21:36:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"OfficeChai Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:site\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"OfficeChai Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/\",\"url\":\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/\",\"name\":\"OpenAI's Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors\",\"isPartOf\":{\"@id\":\"https:\/\/officechai.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1\",\"datePublished\":\"2024-12-30T15:06:40+00:00\",\"dateModified\":\"2025-01-18T21:36:07+00:00\",\"author\":{\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\"},\"breadcrumb\":{\"@id\":\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1\",\"width\":1200,\"height\":630},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/officechai.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"OpenAI’s Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/officechai.com\/#website\",\"url\":\"https:\/\/officechai.com\/\",\"name\":\"OfficeChai\",\"description\":\"Startups, Businesses And Careers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/officechai.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\",\"name\":\"OfficeChai Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"caption\":\"OfficeChai Team\"},\"description\":\"Dotting the i's, crossing the t's.\",\"url\":\"https:\/\/officechai.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"OpenAI's Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/","og_locale":"en_US","og_type":"article","og_title":"OpenAI's Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors","og_description":"Math and coding are rapidly falling to AI, and it looks like medicine might be next. OpenAI’s o1-preview model handily outperformed human doctors...","og_url":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/","og_site_name":"OfficeChai","article_publisher":"https:\/\/www.facebook.com\/OfficeChai\/","article_published_time":"2024-12-30T15:06:40+00:00","article_modified_time":"2025-01-18T21:36:07+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1","type":"image\/jpeg"}],"author":"OfficeChai Team","twitter_card":"summary_large_image","twitter_creator":"@OfficeChai","twitter_site":"@OfficeChai","twitter_misc":{"Written by":"OfficeChai Team","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/","url":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/","name":"OpenAI's Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors","isPartOf":{"@id":"https:\/\/officechai.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#primaryimage"},"image":{"@id":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1","datePublished":"2024-12-30T15:06:40+00:00","dateModified":"2025-01-18T21:36:07+00:00","author":{"@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2"},"breadcrumb":{"@id":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#primaryimage","url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1","contentUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1","width":1200,"height":630},{"@type":"BreadcrumbList","@id":"https:\/\/officechai.com\/stories\/openais-model-correctly-diagnosed-80-of-medical-cases-compared-to-30-by-human-doctors\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/officechai.com\/"},{"@type":"ListItem","position":2,"name":"OpenAI’s Model Correctly Diagnosed 80% Of Medical Cases, Compared To 30% By Human Doctors"}]},{"@type":"WebSite","@id":"https:\/\/officechai.com\/#website","url":"https:\/\/officechai.com\/","name":"OfficeChai","description":"Startups, Businesses And Careers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/officechai.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2","name":"OfficeChai Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","caption":"OfficeChai Team"},"description":"Dotting the i's, crossing the t's.","url":"https:\/\/officechai.com\/author\/admin\/"}]}},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2024\/12\/MixCollage-30-Dec-2024-08-35-PM-337.jpg?fit=1200%2C630&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p685C6-d5h","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/50299","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/comments?post=50299"}],"version-history":[{"count":2,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/50299\/revisions"}],"predecessor-version":[{"id":50305,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/50299\/revisions\/50305"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media\/50304"}],"wp:attachment":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media?parent=50299"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/categories?post=50299"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/tags?post=50299"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}