Fig. 2: Comparison of our method and prior state of the art. | Nature

Fig. 2: Comparison of our method and prior state of the art.

From: Large language models encode clinical knowledge

Fig. 2

Our Flan-PaLM 540B model exceeds the previous state-of-the-art performance (SOTA) on MedQA (four options), MedMCQA and PubMedQA datasets. The previous state-of-the-art results are from Galactica20 (MedMCQA), PubMedGPT19 (MedQA) and BioGPT21 (PubMedQA). The percentage accuracy is shown above each column.

Back to article page