Google Research· Research

Testing LLMs on superconductivity research questions

Subhashini Venugopalan, Research Scientist, and Eun-ah Kim, Visiting Scientist, Google Research Can LLMs become expert-level research partners in modern physics? Using high-temperature superconductivity as a case study, physicists tested six LLMs with challenging questions and graded the responses. Quick links Paper Share Copy link × Artificial intelligence (AI) is now routinely used to compose emails, edit images and summarize information from the web. AI also holds enormous potential to accelerate scientific research. However, its effectiveness in providing scientifically accurate and comprehensive answers to complex questions within specialized domains remains an active area of research, requiring AI to meet an extremely high bar for accuracy and to navigate complex, evolving areas of knowledge. Our new paper published in the Proceedings of the National Academy of Sciences , “ Expert evaluation of LLM world models: A high-Tc superconductivity case study ”, assesses whether large language model (LLM) world models could answer expert-level questions in condensed matter physics. In collaboration with …

Announced

16 Mar 2026 17:31 UTC