No Big Deal. It Is Just Life or Death. Meh.
July 31, 2025
This blog post is the work of an authentic dinobaby. Sorry. No smart software can help this reptilian thinker.
I am not sure about information from old-fashioned television channels is rock solid, but today what information is? I read “FDA’s Artificial Intelligence Is Supposed to Revolutionize Drug Approvals. It’s Making Up Nonexistent Studies.” Heads up. You may have to pay to read the full write up.
The main idea in the report struck me as:
[Elsa, an AI system deployed by the US Food and Drug Administration] has also made up nonexistent studies, known as AI “hallucinating,” or misrepresented research, according to three current FDA employees and documents seen by CNN. This makes it unreliable for their most critical work, the employees said.
To be fair, some researchers make up data and fiddle with “real” images for some peer reviewed research papers. It makes sense that smart software trained on “publicly available” data would possibly learn that making up information is standard operating procedure.
The cited article does not provide the names and backgrounds of the individuals who provided the information about this smart software. That’s not unusual today.
I did not this anonymous quote:
“Anything that you don’t have time to double-check is unreliable. It hallucinates confidently,” said one employee — a far cry from what has been publicly promised. “AI is supposed to save our time, but I guarantee you that I waste a lot of extra time just due to the heightened vigilance that I have to have” to check for fake or misrepresented studies, a second FDA employee said.
Is this a major problem? Many smart people are working to make AI the next big thing. I have confidence that prudence, accuracy, public safety, and AI user well-being is a priority. Yep, that’s my assumption.
I wish to offer several observations:
- Smart software may need some fine tuning before it becomes the arbiter of certain types of medical treatments, procedures, and compounds.
- AI is definitely free from the annoying hassles of sick leave, health care, and recalcitrance that human employees evidence. Therefore, AI has major benefits by definition.
- Hallucinations are a matter of opinion; for example, humans are creative. Hallucinating software may be demonstrating creativity. Creativity is a net positive; therefore, why worry?
The cited news report stated:
Those who have used it say they have noticed serious problems. For example, it cannot reliably represent studies.
As I said, “Why worry?” Humans make drug errors as well. Example: immunomodulatory drugs like thalidomide. AI may be able to repurpose dome drugs. Net gain. Why worry?
Stephen E Arnold, July 31, 20205
Comments
Got something to say?