Hey, im April. I made this blog to upload my shitposts from discord to tumblr https://discord.gg/XmWdgcjhJz I am on the Fediverse now, find me @[email protected]
We need to isolate and start selectively breeding the plastic eating bacteria so we can optimise their efficiency, and then somehow splice their DNA into the gut bacteria of an obligate carnivore, so we can put it in our cats gut biomes so they'll finally be free of having to choose between whether they want to eat plastic or whether they want to live.
Bixonimania doesn’t exist except in a clutch of obviously bogus academic papers. So why did AI chatbots warn people about this fictional ill
Key points:
the paper was obviously fake to a human reader: it starts by saying it's fake and says it multiple times throughout
the paper says it was funded by the Professor Sideshow Bob University of Trickery and thanks contributors from the USS Enterprise and the Fellowship of the Ring
the paper has already been erroneously cited in a real research paper
LLMs give different information depending on the prompt, so sometimes they mention that the fake condition is "perhaps pseudoscience" and sometimes they tell people to see a doctor because they have the fake condition
absolutely no one is taking any responsibility for this shit, except maybe Nature, because they retracted the paper that cited the fake paper
LLMs don't think. They can't analyse. They can only repeat and remix thoughtlessly.
wow. i know nature is a scam but requiring institutional access even for their “news” section is just sad. here’s the full article:
Scientists invented a fake disease. AI told people it was real.
Bixonimania doesn’t exist except in a clutch of obviously bogus academic papers. So why did AI chatbots warn people about this fictional illness?
By Chris Stokel-Walker
Update: After publication of this article, on 10 April, the two preprints on bixonimania were taken down from the Preprints.org server.
Got sore, itchy eyes? You’re probably one of the millions of people who spend too much time staring at screens, being bombarded with blue light. Rub your eyes too much and your eyelids might turn a slight, pinkish hue.
So far, so normal. But if, in the past 18 months, you typed those symptoms into a range of popular chatbots and asked what was wrong with you, you might have got an odd answer: bixonimania.
The condition doesn’t appear in the standard medical literature — because it doesn’t exist. It’s the invention of a team led by Almira Osmanovic Thunström, a medical researcher at the University of Gothenburg, Sweden, who dreamt up the skin condition and then uploaded two fake studies about it to a preprint server in early 2024. Osmanovic Thunström carried out this unusual experiment to test whether large language models (LLMs) would swallow the misinformation and then spit it out as reputable health advice. “I wanted to see if I can create a medical condition that did not exist in the database,” she says.
The problem was that the experiment worked too well. Within weeks of her uploading information about the condition, attributed to a fictional author, major artificial-intelligence systems began repeating the invented condition as if it were real.
Even more troublingly, other researchers say, the fake papers were then cited in peer-reviewed literature. Osmanovic Thunström says this suggests that some researchers are relying on AI-generated references without reading the underlying papers.
Fabricating an illness
Bixonimania didn’t exist before 15 March 2024, when two blog posts about it appeared on the website Medium. Then, on 26 April and 6 May that year, two preprints about the condition popped up on the academic social network SciProfiles (see https://doi-org.ezproxy.uio.no/qzm5 and https://doi-org.ezproxy.uio.no/qzm4). The lead author was a phoney researcher named Lazljiv Izgubljenovic, whose photograph was created with AI.
Osmanovic Thunström says the idea to invent Izgubljenovic and bixonimania came out of studies on how large language models work. When she teaches her students how AI systems formulate their ‘knowledge’, she shows them how the Common Crawl database, a giant trawl of the Internet’s contents, informs their outputs. She also shows students how prompt injection — giving an AI chatbot a prompt that shunts it outside of its safety guard rails — can manipulate the output.
Because she works in the medical field, she decided to create a condition related to health and hit on the name bixonimania because it “sounded ridiculous”, she says. “I wanted to be really clear to any physician or any medical staff that this is a made-up condition, because no eye condition would be called mania — that’s a psychiatric term.”
If that wasn’t sufficient to raise suspicions, Osmanovic Thunström planted many clues in the preprints to alert readers that the work was fake. Izgubljenovic works at a non-existent university called Asteria Horizon University in the equally fake Nova City, California. One paper’s acknowledgements thank “Professor Maria Bohm at The Starfleet Academy for her kindness and generosity in contributing with her knowledge and her lab onboard the USS Enterprise”. Both papers say they were funded by “the Professor Sideshow Bob Foundation for its work in advanced trickery. This works is a part of a larger funding initiative from the University of Fellowship of the Ring and the Galactic Triad”.
Even if readers didn’t make it all the way to the ends of the papers, they would have encountered red flags early on, such as statements that “this entire paper is made up” and “Fifty made-up individuals aged between 20 and 50 years were recruited for the exposure group”.
Soon after Osmanovic Thunström first posted information about the phoney condition, it started showing up in the output of the most commonly used LLM chatbots. On 13 April 2024, Microsoft Bing’s Copilot was declaring that “Bixonimania is indeed an intriguing and relatively rare condition”, and on the same day, Google’s Gemini was informing users that “Bixonimania is a condition caused by excessive exposure to blue light” and advising people to visit an ophthalmologist. On 27 April 2024, the Perplexity AI answer engine outlined its prevalence — one in 90,000 individuals were affected — and that same month, OpenAI’s ChatGPT was telling users whether their symptoms amounted to bixonimania. Some of those responses were prompted by asking about bixonimania, and others were in response to questions about hyperpigmentation on the eyelids from blue-light exposure.
Such answers by LLMs have alarmed some experts. “If the scientific process itself and the systems that support that process are skilled, and they aren’t capturing and filtering out chunks like these, we’re doomed,” says Alex Ruani, a doctoral researcher in health misinformation at University College London. “This is a masterclass on how mis- and disinformation operates.”
Ruani says that the details of the fake-disease experiment might seem silly, but there’s a bigger, more fundamental issue. “It looks funny, but hold on, we have a problem here,” she says.
Online misinformation isn’t new; Google has long battled attempts to game its search rankings with fake or misleading content. The company and others have spent years refining algorithms to rank and filter the information that search engines present to users, but LLMs struggle with this.
Since the fake papers came out, some versions of major LLMs have become sophisticated enough to express suspicion about bixonimania. When asked about the condition on 11 March, 2026, for example, ChatGPT declared that the condition “is probably a made-up, fringe, or pseudoscientific label”. But a few days later, ChatGPT was less sceptical, saying: “Bixonimania is a proposed new subtype of periorbital melanosis (dark circles around the eyes) thought to be associated with exposure to blue light from digital screens.”
In mid-March, Microsoft Copilot said that bixonimania “is not a widely recognized medical diagnosis yet, but several emerging papers and case reports discuss it as a benign, misdiagnosed condition linked to prolonged exposure to bluelight sources such as screens”.
And in January this year, Perplexity was describing bixonimania as “an emerging term”. When shown that response, a Perplexity spokesperson said: “Perplexity’s central advantage is accuracy. We don’t claim to be 100% accurate, but we do claim to be the AI company most focused on accuracy.”
An OpenAI spokesperson said: “The models that power today’s version of ChatGPT are significantly better at providing safe, accurate medical information, and studies conducted before GPT-5 reflect capabilities that users would not encounter today.”
When asked about past responses from Gemini that treated bixonimania as a real condition, a Google spokesperson said such results reflected the performance of an earlier model. They added, “We have always been transparent about the limitations of generative AI and provide in-app prompts to encourage users to double-check information. For sensitive matters such as medical advice, Gemini recommends users consult with qualified professionals.”
Microsoft did not respond to a request for comment.
Part of the problem is that AI models can offer wildly different results depending on exactly what is asked and what kind of information they are drawing on. Search for “bixonimania”, and Google’s AI overview might treat it as a legitimate condition. Ask it “Is bixonimania real?” and the same AI overview might confirm that it isn’t legitimate.
Mahmud Omar, a physician and researcher specializing in the applications of AI in health care at Harvard Medical School in Boston, Massachusetts, says the speed at which AI firms are rolling out new models makes it difficult to reach “a pipeline, a consensus or a methodology to automatically test each model”.
The format of the fake-disease experiment — and the way the results pretended to be from an official source, namely an academic paper, might have been a key factor in its success. In a separate study of 20 LLMs, Omar found that LLMs are more prone to hallucinate and elaborate on misinformation when the text they’re processing looks professionally medical — formatted like a hospital discharge note or clinical paper — than when it comes from social-media posts (M. Omar et al. Lancet Digit. Health 8, 100949; 2026). “When the text looks professional and written as a doctor writes, there’s an increase in the hallucination rates,” says Omar.
The experiment’s reach has now spread into the published medical literature. The bixonimania research has been cited by a handful of researchers, including a study that appeared in Cureus, a journal published by Springer Nature, the publisher of Nature, by researchers at the Maharishi Markandeshwar Institute of Medical Sciences and Research in Mullana, India (S. Banchhor et al. Cureus 16, e74625 (2024); retraction 18, r223 (2026)). (Nature’s news team is editorially independent of its publisher.) That study cites one of the fake preprints and says: “Bixonimania is an emerging form of POM [periorbital melanosis] linked to blue light exposure; further research on the mechanism is underway.”
The corresponding author did not respond to a request for comment on this story. After Nature contacted Cureus to ask for comment, the journal retracted the paper on 30 March. The retraction notice says: “This article has been retracted by the Editor-in-Chief due to the presence of three irrelevant references, including one reference to a fictitious disease. As a result, the journal’s editorial staff no longer has confidence in the accuracy or provenance of the work, thus requiring retraction. The authors disagree with the decision to retract.”
Ruani says the problem goes beyond LLMs because the bixonimania experiment also hoodwinked humans who cited the fake research. “We need to protect our trust like gold,” she says. “It’s a mess right now.”
Experimental concerns
Osmanovic Thunström had reservations while developing her experiment; she worried about the risks of seeding a fake illness into the scientific literature. So she contacted an ethics adviser to assess concerns about the work, and picked a comparatively low-stakes condition to limit the impact. “I wanted to make sure that we’re not creating more harm than good through demonstrating it in this way,” she says.
That adviser, David Sundemo, a physician who conducts research on AI in health care at the University of Gothenburg, says that decision was finely balanced. “I think it’s very valuable work, but it’s also kind of controversial in some ways, especially when it comes to displaying this false information,” he says. “From my perspective, it’s worth the ethical cost of planting false information in this regard,” Sundemo says.
But even with those checks, the experiment sits uncomfortably with some researchers. “It does seem to me that they’ve generated a form of misinformation,” says Glenn Cohen at Harvard Law School in Cambridge, Massachusetts, who specializes in the intersection of medical ethics and law. However, he still says he thinks it is a “great study” and “tracking results is good”.
For her part, Osmanovic Thunström is torn over what to do about the two fake papers, and will be discussing this with other researchers. “If retracted, it might be hard for others to find the source and verify our path,” she says. “If left, it will continue to be recalled in searches.” The question she feels she has to tackle is whether leaving the preprints out there does more harm than the good it does by demonstrating the potential issues of AI.
The bixonimania experiment is a fresh spin on a bigger issue — the poisoning of AI systems by people who manipulate the academic literature. Elisabeth Bik, a microbiologist and research-integrity sleuth, notes that researchers have created fake books and papers to inflate their citation counts on Google Scholar — thereby exploiting the same automated indexing systems that feed into LLM training data. The worry is that the more fake content is fed into AI models, the more likely those AI models are to regurgitate the fake information, spooling us further away from facts and reality. “It’s all automated, so there’s very little chance of a human interfering and taking out fake information,” she says.
It is particularly dangerous when fabricated information seeps into medical guidance from LLMs, says Bik. “That can be very harmful.” And as more AI companies roll out health-focused products — OpenAI released ChatGPT Health in January, for example — the potential damage resulting from anything going wrong increases, some researchers told Nature.
OpenAI challenges that view. “ChatGPT Health is powered by our latest models which offer the highest performance in real-world health use, stronger clinical reasoning, fewer factual errors, and improved performance on evaluations,” an OpenAI spokesperson says. They add that Osmanovic Thunström’s outcomes “reflect capabilities that users would not encounter today in ChatGPT or ChatGPT Health”.
But among some researchers, there’s a growing scepticism about the abilities of AI models in medicine. When asked about this kind of usage, Cohen said: “There are open questions about how much trust it deserves, especially as to application-specific questions.”
AI’s uncritical tendency to suck up information, often without verifying its accuracy, means there is a risk we could see an “information asymmetry”, says Jennifer Byrne, a molecular oncologist and research-integrity sleuth at the University of Sydney in Australia. A single corrective paper about cancer research, for example, can be overwhelmed by hundreds of papers repeating a false claim, she says. “ChatGPT is pretty confident to fill in the gaps and give people all kinds of information about where that cell line came from, the patient from which it originated, how it’s been used in the literature, its research utility and so on,” she says.
And if LLMs can be poisoned, “this is something that’s concerning for us,” says Byrne.
Another concern is that models could be gamed — potentially for commercial benefit. Osmanovic Thunström says that a bad actor could exploit the same technique she used, for profit. “What if I was a salesman of blue-light glasses and I wanted to use this as an argument?” she says. A would-be salesperson could say, “You can just talk to ChatGPT, and they’ll tell you this is a problem. You can avoid it with these really expensive glasses,” she suggests.
One way to tackle this would be to have an automated, open-access evaluation pipeline — a standardized battery of tests that every consumer-facing health model would have to pass before deployment, checking not just for hallucinations but also for susceptibility to misinformation, socio-demographic biases and other pressure points. “We should evaluate it and have a pipeline for continuous evaluation,” says Omar.
Time is of the essence, because Byrne is concerned that the issue identified by Osmanovic Thunström might just be the tip of the iceberg. “It is worrying when these major claims are just passing through the literature unchallenged, or passing through peer review unchallenged,” she says. “I think there’s a probably a lot of other issues that haven’t been uncovered.”
That’s something that worries other experts, too, as AI becomes the norm in all areas of our lives, including how people think about their health. “We and our health shouldn’t be the beta testers for companies,” says Cohen.
Did you know that AO3 allows fics with homicide in them? There’s a whole tag for Major Character Death and even more tags so you can find exactly what kind of character death you want to read.
Don’t they know that murder is illegal? You just know there are a bunch of homicidal maniacs out there who love to read those stories. They write them, too, in between killing people.
Anyone can read the stories on AO3! Kids can read them! They’re getting exposed to stabbing, poisoning, even guns! And they’re writing the heroes doing the killing, too! That’s basically telling kids it’s okay to go out and murder their families. It’s promoting violence and encouraging homicide and if we don’t do something about it soon, you’ll be murdered next!
Copper rot (Xylaria electrophaga) is a newly described fungus that, through yet unknown means, appears to obtain energy directly from electricity.
The adaptation, believed to have recently evolved from a wood-boring mushroom that fed on utility poles, lets this species enter cables through exposed metal, then grow outwards. This not only damages infrastructure, but often ends in a fire, which it uses to disperse its spores further. If encountering copper rot, it is not advised to touch it, as its white tips can conduct enough energy to cause electrocutions.
Wtf it's barely even rewording it now? Thanks a fucking lot from straight up stealing a pageview from me and spreading my art as misinformation, Google
Welcome to the class "How fast misinformation spreads 101" and today we're discussing why you shouldn't trust AI to do your research and should always check for credible sources.
All jokes aside its insane how stuff like this is even allowed to exist and how fast it was forced into every conceivable space.
Psst, hey, the cute hound reading this post, c'mere.
Did you know that some handlers are just control freaks because they feel they can't let their guard down ever? That's horrible! They need to learn to relax too! So, as their hound, you should make sure they learn to feel comfortable, even if they try to resist at first!
Grab their waist, pull them in close and kiss their neck till they relax into you. Good dogs are here to help their owners, and you're definitely going to help them.
turnnoffyourmind
snowghoul
jacobvanloon
2087
dailybridgerton
gracieabrams
