A new 'AI scientist' can write science papers without any human input. Here's why that's a problem.

The article explains the problem with the artificial intelligence (AI) scientist, a system that can automatically write scientific papers using generative large language models (LLM), developed by Sakana AI Labs. Issues discussed include the ability of LLMs to judge the quality of research and its weakness in judging the risk of bias in medical research studies, and potential collapse of an AI-driven scientific ecosystem and the peer review system.