Median Watch

Eyes on statistics

Ethics transparency

Why aren’t ethics applications publicly available? If not the full application, then at least the investigators' names, the title, a plain language summary, the application number, and the date it was approved. A public record would help confirm that the research actually took place. We live in a world where entire papers can be written in under 30 minutes. Many thousands of researchers are using this new technology to boost their CVs with meaningless papers.

Beating the panel drum

There’s been another call to “Bring back panels!” for the NHMRC, this time published in Science. These calls normally appear on social media on the day of major funding announcements, when the majority of people find out that they’ve been unsuccessful and vent their frustrations. There are some scientists who, when their applications are rejected, don’t consider that it was bad luck or that there’s some flaw in their ideas. Instead, they conclude that the system must be wrong and therefore must be changed.

Breadcrumbs

Breadcrumbs feature in the fairy tale Hansel and Gretel where two lone children drop them along their journey into the forest so that they can find their way home. I’ve been thinking a lot about breadcrumbs and paper trails because the research world is rapidly moving to widely using artificial intelligence, including for generating questions, collecting data, and writing papers. Whilst these uses may sometimes be legitimate and make for faster and better research, it’s now also possible for bad actors to use AI to make a decent quality paper in just 30 minutes.

Research Grant System Teeters on the Cusp of an AI Hellscape

Reproduced from Future Campus.

Last week, I blocked out two hours of protected time in my diary for “grant writing”. I’ve done this before, but the difference this time was that at the end of two hours I had a nearly finished NHMRC Ideas Grant. Of course I used AI. I used PRISM, a new free tool from OpenAI designed for academic writing. I gave PRISM the Ideas Grant criteria, a document on what makes a good application, and a title and an aim.

Research integrity is locked into an arms race with agentic AI slop

Reproduced from the LSE impact blog.

Science prides itself on being self-correcting. While scientific fakery has always been a problem, cases of fraud have been isolated, and a combination of scepticism and scrutiny has up to now generally worked to highlight published papers that are unreliable. The 30 minute paper However, the world of research and publishing is changing. The introduction of agentic artificial intelligence (AI) allows an automated assembly line of research tasks without any human checkpoints.