jeinee (though u can call me Anna) | 27 | she/her I like to draw, write and procrastinate ✩ If you only want to see my art posts and no personal stuff/reblogs follow my art only blog @lostmidnight ++
my art
art blog
twitter: jeinee_art
KOKOBOT - The Airbnb-Owned Tech Startup - Data Mining Tumblr Users' Mental Health Crises for "Content"
I got this message from a bot, and honestly? If I was a bit younger and not such a jaded bitch with a career in tech, I might have given it an honest try. I spent plenty of time in a tough situation without access to any mental health resources as a teen, and would have been sucked right in.
Chatting right from your phone, and being connected with people who can help you? Sounds nice. Especially if you believe the testimonials they spam you with (tw suicide / self harm mention in below images)
But I was getting a weird feeling, so I went to read the legalese.
I couldn't even get through the fine-print it asked me to read and agree to, without it spamming the hell out of me. Almost like they expect people to just hit Yes? But I'm glad I stopped to read, because:
What you say on there won't be confidential. (And for context, I tried it out and the things people were looking for help with? I didn't even feel comfortable sharing here as examples, it was all so deeply personal and painful)
Also, what you say on there? Is now...
Koko's intellectual property - giving them the right to use it in any way they see fit, including
Publicly performing or displaying your "content" (also known as your mental health crisis) in any media format and in any media channel without limitation
Do this indefinitely after you end your account with them
Sell / share this "content" with other businesses
Any harm you come to using Koko? That's on you.
And Koko won't take responsibility for anything someone says to you on there (which is bleak when people are using it to spread Christianity to people in crisis)
I was curious about their business model. They're a venture-capitol based tech startup, owned by Airbnb, the famous mental health professionals with a focus on ethical business practices./s They're also begging for donations despite having already been given 2.5 million dollars in research funding. (If you want a deep dive on why people throw crazy money at tech startups, see my other post here)
They also use the data they gather from users to conduct research and publish papers. I didn't find them too interesting - other than as a good case study of "People tend to find what they are financially incentivized to find". Predictably, Koko found that Kokobot was beneficial to its users.
So yeah, being a dumbass with too much curiosity, I decided to use the Airbnb-owned Data-Mining Mental Health Chatline anyway. And if you thought it was dangerous sounding from the disclaimers? Somehow it got worse.
(trigger warning / discussions of child abuse / sexual abuse / suicide / violence below the cut - please don't read if you're not in a good place to hear about negligence around pretty horrific topics.)
I first messed around with the available options, but then I asked it about something obviously concerning, saying I had a gun and was going to shoot myself. It responded... Poorly. Imagine the vibes of trying to cancel Comcast, when you're suicidal.
Anyway, I tried again to ask for help about something else that would be concerning enough for any responsible company to flag. School was one of their main options, which seems irresponsible - do you really think a child in crisis would read that contract?
I told it about a teacher at school trying to "be my boyfriend", and it immediately suggested I help someone else while I wait for help. I was honestly concerned that it wasn't flagged before connecting. Especially when I realized it was connecting me to children.
I first got someone who seemed to be a child in an abusive home. (Censored for their privacy.) I declined to talk to them because despite being an adult and in an OK mental place - I knew I'm not equipped to counsel a kid through that. If my act of being another kid in crisis was real? Holy shit.
Remember- if my BS was true, that kid would be being "helped" by an actively suicidal kid who's also being groomed by a teacher. Their pipeline for "helpers" is the same group of people looking for help.
I skipped a number of messages, and they mostly seemed to be written by children and young adults with nowhere else to turn. Plus one scary one from an adult whose "problem" was worrying that they'd been inappropriate with a female student, asking her to pull her skirt down "a little" in front of the class. Koko paired this person with someone reporting that they were a child being groomed by a teacher. Extremely dangerous, and if this was an episode of Black Mirror? I'd say it was a little too on the nose to be believable.
I also didn't get the option to get help without being asked... Er... Harassed... to help others. If I declined, I'd get the next request for help, and the next. If I ignored it, I got spammed by the "We lost you there!" messages, asking if I'd like to pick up where I left off, seeing others' often triggering messages while waiting for help, including seriously homophobic shit. I was going into this as an experiment, starting from a good mental place, and being an adult with coping skills from an actual therapist, and I still felt triggered by a lot of what I read. I can't imagine the experience someone actually in crisis would be having.
My message was starting to feel mild in comparison to what some people were sharing - but despite that I was feeling very uneasy about my message being shown to children. There didn't seem to be a way to take it back either.
Then I got a reply about my issue. It was very kind and well meaning, but VERY horrifying. Because it seemed to be written by a child, or someone too young to understand that "Do have feelings for the teacher who's grooming you? If you don't, you should go talk to him." Is probably THE most dangerous advice possible.
Not judging the author - I get the impression they're probably a child seeking help themselves and honestly feel horribly guilty my BS got sent to a young person and they wanted to reply. Because WTF. No kid should be in that position to answer my fucked up question or any of the others like it.
---
Anyway, what can you do if this concerns you, or you've had a difficult experience on Koko, with no support from them or Tumblr?
Get on their LinkedIn (https://www.linkedin.com/company/kokocares/) and comment on their posts! You may also want to tag the company's co-founders in your comments - their accounts are listed on the company page.
There's no way to reach support through chat, and commenting on a company's LinkedIn posts / tagging the people responsible is the best way to get a quick response to a sensitive issue - as their investors and research funders follow those posts, and companies take it seriously if safety issues are brought up in front of the people giving them millions of dollars.
Legal Disclaimer since tech companies LOVE lawsuits:
The views, thoughts, and opinions expressed in the text belong solely to the author, and not necessarily to the author's employer, organization, committee or other group or individual. This text is for entertainment purposes only, and is not meant to be referenced for legal, business, or investment purposes. This text is based on publically available information. Sources may contain factual errors. The analysis provided in this text may contain factual errors, miscalculations, or misunderstandings.
Kokobot is incredibly predatory and exploitative. I wrote a post about how it exploits minors' empathy and gamifies "giving mental health advice", resulting in an unregulated mess that can only do harm to teens' mental health in the long run.
There are young people on tumblr that actively seek support from KokoBot right now, if you check the tag for recent posts. Those people did not get paid to promote it, so do not harrass them. If you can, direct them towards resources about Kokobot (like this post) that are more transparent about what this company is up to.
If you weren't asking hypothetically... These are the investors funding it.
And Crunchbase, Linkedin, and their website have info on their founders and board.
If anyone reaches out, please do it respectfully and direct your messages to the investment firms, founders or board, not the staff.
I'm familiar with the field, and it's common for corporations to mislead programmers and lower level staff about the purpose and potential harms of their technical work. There may very well be people working there who believe they're doing good, and absolutely do not deserve online harassment. The founders, C-suite, and board members are the informed decision-makers in these sorts of companies, not the coders and other employees who may very well believe they're creating something helpful.
Also they're apparently hiring?? For 150k a year. Damn.
Fucking love Shi Qingxuan. Look at this. Who fucking else would have the audacity to just ignore Hua Cheng when he's telling you to tell Xie Lian something. Shi Qingxuan is like on the phone and Hua Cheng is right beside him like "Tell him to get dressed. Qingxuan. Tell him to get dressed. Tell him to get dressed, Qingxuan. Qingxuan, tell him to get dressed."
And Shi Qingxuan waving at him like "I'm gonna get to it, don't rush me, jeez."
Shi Qingxuan is the absolute best. I love how much he's not afraid of Hua Cheng ;0; like "whatever, boomer" at him.
This does imply Shi Qingxuan saw Ming Yi naked plenty of times and circumstances were such that he felt it was no big deal. "We're all men here :O" god I would die for him, my perfect angel, he's so cute ;0;
If you’re wondering what kinda media I’m into lately well I’m still obsessed w/tgcf going on 2 yrs now, still in love w/gits and steins;gate/science adventure series of course, Fate & Nasuverse, but also after the Witch from Mercury season 1 finale I watched that and got into Gundam, I binged 0079 while I was sick w/covid back in February & made my way through zeta, zz, char’s counterattack, unicorn, first and only out hathaway film, F91, stardust memory, war in the pocket (god if you wanna just cry for some reason, just watch that one), 08th ms squad, currently still on g fighter, seed, and victory. I’m just skipping around rn
Once I get some more hualian art out of my system I’m gonna draw some fan art (and Motoko, haven’t drawn motoko in a long time)
As someone who took etiquette lessons, politeness is an incredibly effective tool for disarming bigots. You can either force them to reconsider their words/actions by directly and calmly confronting their behavior (by using the rules of society in your favor), or you can dip entirely while they appear to be in the wrong.
Both options are great.
Because the thing is, when bigots pick fights, they are 100% counting on you to get louder than them. Or meaner. They want you to react emotionally and provide fodder for their 'You're Too Emotionally Immature To Understand' cannon.
What they aren't expecting you to do is say one of the following phrases in a polite, concerned tone:
Are you okay?
That's not the kind of language I was raised to use with others.
Do you need a moment to think on why that wasn't acceptable?
This is no way to engage in intelligent conversation. Please try that again in a kinder tone if you'd like this to continue. (I really like this one because it lets you turn their public-shame rhetoric around)
For those of you who'd are spiteful and/or dealing with Fundamentalists/Evangelicals/generally shitty Christians:
What's happening in your life to cause you this much anger? I can't imagine hurting so badly that I need to hurt other people.
Who taught you it was acceptable to treat other people this way? Certainly not the Jesus I remember.
Whatever happened to 'judge not lest ye be judged'?
If I talked like that in front of my parents or grandparents I would be ashamed.
I think there's something you need to pray on before we try and have this conversation.
And my all time favorite:
"It sounds to me like there are some seriously dark and angry forces at work in your heart."
(Nothing stops a Christian bigot in their tracks faster than implying the Devil is causing their bigotry. But you MUST be calm, polite, and gentle with your tone and wording. It is absolutely fair to twist the rules and play them at their own game, but you gotta play hard.)
TLDR: It's much faster to use etiquette, politeness, and rhetoric reversal when eviscerating idiots online and in person, because they aren't expecting you to weaponize their behaviors back in their direction. Don't get angry, get spitefully polite! :)
bring back movie protagonists being battered to shit. luke skywalker walked around half of esb looking like a sausage that got smacked on the sidewalk for what?? not for a protag with a perfect little forehead cut and a single red line of blood after the final battle. disgraceful
friendly reminder that characters don't need to be saints to be entertaining. and telling a story does not mean endorsement. art does not need to be all about morally good people.
IDK if this was meant as hyperbole but it's literally true:
Adult literacy is low.
Child literacy is low.
Information literacy has shifted dramatically in the last decade, but reputable information sources like research journals and factual news reporting have been unable to keep pace.
We are genuinely in a crisis of media literacy, with ever fewer genuinely factual resources available in the style and language used by contemporary audiences.
It may sound condescending, but we genuinely need to remind people, or worse, explain to them for the first time that art is not evidence of real world behaviour.
So, thank you, for this reminder. Genuinely.
You're correct:
Art does not need to feature exclusively morally pure characters. Art is not proof of the creator's secret, violent desires.
ETA; Yes, the links are US American; no your country is not immune to propaganda. Be POLITE in asking, and I will help you find the data for your own country as well.
