THE post appeared on the r/ChatGPT forum of the social platform Reddit in December of 2024, authored by a user whose handle this newspaper withholds as immaterial. It is brief—five sentences—and it is, in its way, a civic document. The author reports having received a medical diagnosis, unspecified. The attending physician's consultation lasted four minutes. The author turned to a large language model, which answered, by the author's count, forty-seven follow-up questions at two o'clock in the morning. The author reports that this exchange "changed how I understood my own health." The post concludes: "The bar for human medical communication is apparently very low."
The post is not slop. It contains no machine-generated text, no hallucinated citations, no fabricated imagery. It is the testimony of an individual who has had an experience and drawn from it a reasonable-sounding conclusion. The conclusion is wrong, but the experience that produced it is real, and any serious treatment must begin there rather than with the error.
The four-minute appointment is real. It is the product of billing structures, physician shortages, administrative overhead, and an insurance reimbursement model that has, over four decades, compressed the clinical encounter into a unit of time insufficient for the communication of complex diagnostic information. The author's frustration with this encounter is not irrational. It is the correct response to a system that has made patient comprehension a structural afterthought. This newspaper does not dispute the complaint. It disputes the remedy.
What the chatbot provided, at two in the morning, was not understanding. It was production—rapid, confident, syntactically coherent production that bore the surface characteristics of understanding without possessing any of its architecture. The machine did not examine the author. It did not review imaging. It did not weigh the author's history against population-level data with the clinical judgment that such weighing requires. It generated plausible text about a diagnosis, drawing on patterns in its training data, and it did so with an inexhaustible patience that the author, understandably, experienced as attentiveness.
The distinction between patience and competence is not academic. It is the distinction upon which the post's entire testimonial architecture collapses. A physician who sighs during a four-minute appointment is performing poorly at communication. A machine that answers forty-seven questions without sighing is not performing well at medicine—it is performing at all times and in all cases identically, irrespective of whether the answers it generates are correct, incomplete, dangerously misleading, or subtly inapplicable to the specific clinical situation the author faces. The physician's sigh, however regrettable, is at minimum evidence of a human being in the room making judgments. The machine's equanimity is evidence of nothing except architecture.
The number forty-seven is doing considerable work in this testimonial. It is a specific number, deployed with the precision of a person who wishes to establish that they are not asking idle questions but conducting a thorough inquiry. The two-in-the-morning detail performs a similar function: it signals a responsible autodidact, awake with worry, seeking knowledge rather than reassurance. These are the rhetorical markers of a serious person, and this newspaper takes the author to be one. But seriousness of intent does not confer the ability to evaluate the reliability of answers to medical questions, and the author's post contains no indication—because it cannot contain one—of any method by which the forty-seven answers were assessed for accuracy.
This is the civic matter. The post received significant engagement on a forum whose subscribers number in the millions. It functions, in the ecology of that platform, not merely as personal testimony but as informal medical guidance: the implicit recommendation that others facing similar diagnostic confusion might profitably consult the same tool. The author's closing sentence—that the bar for human medical communication is "apparently very low"—reframes what is in fact an inability to distinguish between comprehension and completion as an indictment of physicians. The indictment is not wholly unearned. The reframing is nonetheless dangerous.
The danger is not that the machine was wrong in this instance. It may not have been. The danger is that the author possesses no method for determining when it is—and that the machine, by the nature of its construction, will never volunteer the information. A physician who does not know will, in the ordinary course, say so, or refer the patient onward, or order further tests. A chatbot that does not know will produce another paragraph. It will do so at two in the morning. It will not sigh. It will answer the forty-eighth question with the same equanimity it brought to the first, and the forty-eighth answer will be indistinguishable in tone and confidence from every answer that preceded it, regardless of whether it is correct.
The author has identified a genuine failure and located a false solution. The failure belongs to a medical system that has made the four-minute appointment an economic inevitability. The solution belongs to a technology that cannot distinguish between explaining a diagnosis and generating text that resembles an explanation. That these two things feel identical to the patient at two in the morning is the problem, not the proof of concept.