.Attributes Medicine, Published online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although large foreign language designs (LLMs) present assurance in measured environments, a study right now exposes their constraints in real-world medical requests as well as points the method in the direction of robust evaluation and benchmarking just before clinical make use of.