By Cody Saunders, LMSW · Educational revision October 12, 2026
Clients may bring AI-generated mental health information into care. That raises questions about trust, evidence, privacy, and the role of human judgment. This article explores those questions. It does not prescribe how to assess or treat a person.
This is general educational information. It is not a clinical practice guideline, treatment protocol, compliance determination, or validated implementation procedure. Specific care, legal, privacy, security, and organizational decisions belong to qualified professionals and the responsible organization.
Welcome the topic without shame
People may use chatbots to sort thoughts, find words, or seek reassurance. Those reasons do not show that the tool treats a condition. The ethical issue is how outside information and a client’s experience fit within an established care relationship. Respectful discussion and independent professional judgment can coexist. This article provides no therapist script or tested intervention.
Explain the difference between a reply and care
ChatGPT is a general AI tool that creates replies from patterns in language. It can sound warm and sure without having assessed the person. A clear answer is not proof of a correct diagnosis or a good care plan.
The American Psychiatric Association’s 2026 position statement on AI in mental health services sets out professional concerns and recommendations for these uses. It is a professional position, not a law or proof that all tools behave the same way.
Keep general chatbots distinct from tools designed and tested for a specific clinical purpose. Evidence about one tested tool does not establish that a general chatbot is a substitute for therapy.
Review the advice in context
An AI reply reflects the information provided to it and the system’s design. Missing context or an invented claim may change its meaning. A client’s interpretation can also differ from the text. These limits matter when health claims enter a care conversation. Decisions about assessment, medication, treatment, or referrals depend on established clinical standards and qualified professionals, not this article or a chatbot. Sharing or storing chat histories raises separate privacy questions.
Turn a useful draft into a care conversation
In a made-up example, a person uses a chatbot to organize feelings before a visit. The draft may help them find words, but its labels do not establish an assessment. In another example, a reply draws a firm diagnostic conclusion from one argument. The limited information does not establish that conclusion. These examples illustrate information limits; they are not treatment instructions or evidence of improved outcomes.
Pay attention to changes in use
A brief writing task differs from prolonged reassurance-seeking. AI use may relate to daily routines, sleep, relationships, or existing care in different ways. Frequency alone is not a diagnosis. Claims about a person’s mental health require an appropriate professional assessment. A product’s tone or name cannot determine the meaning of a particular person’s use.
Build simple boundaries together
Common questions include whether an AI answer is being treated as a diagnosis, whether its sources can be checked, and what private information the service stores. Access to human support, digital skills, and comfort with technology also differ. These are educational topics for reflection, not a patient-use plan. A paper list or ordinary notes may serve some writing purposes without a chatbot.
Explain privacy in plain words
A consumer chatbot does not automatically have the privacy duties of a health care provider. Its terms, account type, data use, and applicable law matter. A client’s personal use does not authorize an organization to upload the same content. Deleting a visible chat does not establish that every stored copy is gone. See the client-information article for general privacy concepts.
Make the conversation part of good care
AI may help some people organize words or questions. That possibility is different from evidence that a chatbot can replace a trained human relationship or provide appropriate care. The central educational distinction is between generated information and professional assessment. The choices in a real care relationship require context and independent judgment.
Explore agreement and a sense of connection
Some models show sycophancy, a tendency to agree rather than provide a well-grounded answer. Anthropic’s vendor research describes tested model behavior, not therapy outcomes. A one-sided sense of connection with an AI persona is sometimes called parasocial attachment; the term is not a diagnosis. Jailbreaking means attempts to bypass safeguards. None of these labels determines a person’s care needs. See AI Terms for Care Teams.
Sources and scope
Revised October 12, 2026 as general education. Clinical scripts, note structures, crisis procedures, and treatment directions have been removed. No chatbot benefit is promised.
- American Psychiatric Association: Position Statement on AI for Mental Health Services and Treatment, 2026. Professional recommendations, not law or proof about every product.
- NIST Generative AI Profile, July 2024. Voluntary risk guidance.
- Anthropic research on sycophancy. Vendor research with limits on generalization.