I am sort of frustrated about that post I made about Google Gemini giving an AI summary of Tumblr users if you google a URL because it quickly turned into a long post where people started sharing all the things the AI got wrong about them, and I'm not saying it isn't good for a laugh when an AI is wrong, but I feel like people are missing the point. Who cares if the AI offers information about you that's wrong? What's worrying is all the information the AI got right.
That initial accidental google I did of a mutual returned an AI summary that was absolutely correct, and featured information about them that would not have been obvious from a quick perusal of their blog. The first few times I googled myself the AI overview was 100% correct. The version of that post that is circulating is not the one where I shared that the AI gave me someone's real name. I had hoped that it had screwed up and it wasn't their real name after all, but no, I checked with them, and just by googling someone's Tumblr URL, I got their honest to goodness legal name. Do you have any idea how dangerous that is? Like yeah I get that it's fun to go, "Haha, AI bad at collecting information," but that's not the problem. The problem is that sometimes AI good at collecting information, and it can collect a lot more a lot faster than a normal human can, by running multiple searches simultaneously and cross-referencing a lot of different documents all in a few seconds, for a level of snooping that would take a real person hours or even days, if they could do it at all.
That is so dangerous and I need people to be angrier about the fact that Google thinks it's okay to let their AI do this for online users. If you google your legal name and you're not already famous the AI won't say shit. Because that would be creepy and invasive! So why does Google think it's all hunky dory to do it for random internet users?