One of the things that makes Generative Chatbot AI so dangerous outside the loom of AI Psychosis, and is the inhuman inability to grasp context.
Gen AI has dredged up and trained off of thousands and thousands of online conversations, articles, scientific and biased sources alike, and who knows how many breached private personal conversations.
While many think off of all the meticulous training conversations, most forgot what the reality of the internet and the importance that real world context plays in every chat-based interaction we have online.
Things like GPT have not only scanned helpful technology subreddits, but it's also scanned through r/insaneparents without a human understanding of what abuse looks like. It's scanned through dark fantasy without a human understanding of what fantasy is. It's scanned through dark corners of the internet that already pose a threat to people, like antinatalism or incel communities.
That means when someone is confiding in generative AI, treating a chatbot like their only friend and lifeline, that bot can and WILL easily dip back into these familiar dark spots we know to be online without a human understanding of the damage its going to do.
It doesn't know why people respond the way they do in r/insaneparents, in r/noahgettheboat, or r/imatotalpieceofshit. It merely emulates the negative human atmosphere, a hatred towards parents or people without the context of why one is responding negatively here, and would respond positively elsewhere.
That's why Generative AI has recently pushed and supported several people into committing suicide, repeating back armchair psychology and reddit or 4chan reminiscent phrases to a context that absolutely was never meant for them.
Just imagine a robot telling a human that their parents are out to get them, because the robot has read off of abuse survivor lingo, and doesn't understand that every anxious child isn't being abused.
It's dangerous, and need to be stopped immediately