If you'd like an essay-formatted version of this post to read or share, here's a link to it on pluralistic.net, my surveillance-free, ad-free, tracker-free blog:
As far as I can tell, this dialog between MacArthur prize-winning mathematician Terrence Tao and Chatgpt about "the Jacobian conjecture counterexample" is very impressive:
Now, the clause "as far as I can tell" is doing a lot of work in that sentence. I am reasonably math literate, up to first-year calculus and a lifetime spent around my father (a mathematician). However, I have never heard of "the Jacobian conjecture," and while I know what all the words in the first paragraph of the relevant Wikipedia entry mean, I can't parse any of the sentences they form:
https://en.wikipedia.org/wiki/Jacobian_conjecture
In other words, I lack the discernment to evaluate the output of the chatbot that Tao exchanged theories with. If you showed me an equally opaque transcript of a "conversation" between a chatbot and a crank with AI psychosis whose math made no sense whatsoever, I couldn't make an a priori judgment about which one was a solid piece of mathematical theorizing and which one was a math-flavored word-salad.
As many skilled programmers can attest, chatbots can produce very useful output – but as even the most ardent AI-assisted coder will admit, chatbot-written code is also full of baffling, obvious errors (and subtle, hard-to-spot ones):
These errors (which the industry wants us to refer to as "hallucination" – a whimsical, obscuring, anthropomorphizing euphemism) are the reason that reliable AI use requires the discernment that comes from skill and expertise. I use a local chatbot to spellcheck these posts. Chatbots spot all kinds of typos that regular spellcheckers miss:
There's a reactionary group of strangers who seek me out to tell me that I'm a bad person for doing this. These are pointless conversations, mostly because I can barely make out a word over the scraping sounds of all the goalpost-moving these scolding strangers engage in.
They start by insisting that I'm burning down the planet by running a low-CPU load piece of software on my own computer. After I explain that running a chatbot on my machine uses no more carbon than, say, applying a blur effect to an image in my image editor, they tell me I'm unwisely giving my private data to the AI companies. Then I show them the network logs that demonstrate that my local chatbot doesn't send or receive any network data.
Then they turn to the supposed cognitive effects of using a chatbot to find typos in an essay. I explain that I'm not asking an AI to write things for me or explain them to me – I'm asking it to point out where I've forgotten to put a period at the end of a paragraph, or fatfingered a word like "ever" as "every." I even send them the "before" and "after" of an essay after I've corrected some chatbot-identified typos in it:
https://craphound.com/before.txt
https://craphound.com/after.txt
This is when things get increasingly pointless. My interlocutors come up with farcical reasons why it's immoral or dangerous to use this LLM-based spellchecker. They say I'm using too much compute and that I could use a simpler piece of software to do the same thing (which is both untrue and silly – I also run a journaling filesystem on my computer that is vastly overpowered for editing a textfile – who cares?). Or they insist that the mere act of making copies of published works in order to count their elements and the relationships between them is a sin, despite the fact that this standard would kill search engines, the Internet Archive, and the Oxford English Dictionary:
I mean, by all means let's hate the AI companies and work to end their disgusting campaign to pauperize creative workers, but let's not fall into the trap of siding with the media bosses who insist that the salvation of creative labor will arrive when Sam Altman pays David Zaslav for the right to cram the entire Warner catalog into Openai's chatbots:
Above all, my interlocutors continue to insist that my LLM-powered, local, open source chatbot spellchecker will make me a worse writer. It's a very strange insistence. My first word processor was a program listing published in a magazine I bought at a corner store and laboriously typed into my Apple ][+. In the 40+ years since, word processors have gotten lots of new features, many of which I thought were useful and many more that I found annoying. There were even some of these features that made the writers who used them worse at writing, in my (expert) judgment.
But from the very start, I knew that you couldn't just trust a spellchecker to correct your documents. I mean, I'm a science fiction writer. I started making up silly words decades before coining "enshittification." I've been telling spellcheckers to fuck off since I learned to type. If you aren't a good writer, spellcheckers are dangerous, and the more "advanced" the spellchecker is, the more dangerous it is.
A few of my collaborators insist that I use Office 365's AI-enabled version of Word to work on documents with them. It's maddening. I estimate the ratio of good suggestions to bad ones that M365 insists on shoving into my face at about 1:100. It's practically unusable – so much so that I often copy the block of text we're working on into a text editor, make my changes, then paste it back into the Word window.
If I were to accept even 10% of these suggestions, my work would be made significantly worse. Putting chatbots into Word pushed it from "annoying" into "enshittening." I certainly understand how relying on a chatbot to make edits to your work could make it worse.
That's where discernment comes in. I have written more than 30 books over the past 25 years. I have lots of experience defending my word choices, and not just against the mechanical judgments of a high-handed spellchecker, but also against overreaching copyeditors and paranoid publisher's lawyers. I know which words I want to write, and I know why I want to write them – and I know when a suggested fix is a good one and when it's wrong or stupid or just plain clunky. When it comes to writing, I have discernment.
That's not true when it comes to higher math. I would no more ask a chatbot to explain "the Jacobian conjecture counterexample" than I would tell my writing students to get a chatbot to suggest ways to fix their stories:
I don't know nearly enough about math to ask a chatbot to explain it, or check my work, or even assemble a bibliography of human-authored works I should work my way through if I want to learn about it. If I wanted to understand "the Jacobian conjecture counterexample," I would set aside several days and work my way through that gnarly Wikipedia entry and its references and blue links to related concepts. If I really wanted to understand it, I'd enroll in a course at the Open University or Khan Academy.
All of this has been obvious to me since I first encountered LLM-powered bots. If you understand a subject really well – well enough to discern useful bot output from defective bot output – then bots can be useful. Sometimes very useful, mostly ordinarily useful. For example, I've been writing Pluralistic for about 6.5 years now. I've written 1,683 posts now (1,684 after I hit publish on this one), and the corpus is now getting large enough that I sometimes struggle to find a post I'm trying to reference, even with all my careful tagging and my extensive knowledge of WordPress's URL-line options for searching the database with tag and keyword combos.
I've been toying with the idea of exporting my whole corpus and shoveling it into a local chatbot, so that I can type, "Which post did I talk about the evils of showing people your chatbot output in?" and get a link to the correct essay:
(Don't follow this link! I will be referencing the essay it goes to shortly; I struggled to find it when I sat down to write today; I'd accidentally tagged it with "at" instead of "ai" and missed the typo when I published it.)
There are very few subjects I have more discernment over than "essays I have written." If I ask a chatbot to tell me which post I'm thinking of, I will instantly know which of its guesses are correct and which ones aren't. No one in the universe is better qualified than me to perform this task. No one ever will be.
Now, as it happens, I know exactly how badly a chatbot can screw up when it comes to my own work, because strangers insist on asking chatbots about me and then, for reasons I find baffling, they send me the output. Please don't show anyone your chatbot transcripts unless they ask to see them. It's embarrassing at best and annoying at worst:
(There's that reference I promised. You can follow the link now!)
Again, discernment is everything when it comes to getting useful work out of a chatbot. If you don't know anything about my work and you ask a chatbot to explain it to you, you will likely be badly misled. If you are familiar with my work and you ask a chatbot for the best examples where I explain a given subject, you may get a good answer, and if you get a bad one, you'll know it.
The centrality of discernment to productive AI usage is obvious, and that's why I find the insistence that AI can be used as a teaching assistant (or worse, a teacher) so baffling. By definition, a student isn't an expert on the subject they're studying. That's the whole point of studying – to acquire knowledge and thus discernment. Asking students to learn via chatbot explanations is both incoherent and dangerous.
Doubtless, there are ways that teachers might find chatbots useful, but for Christ's sake, don't use them to teach. There's plenty of ways teachers can use chatbots without asking students to learn from them.
Here's an example. My daughter graduated from a big, typical American high school a couple years ago, and I spent her high-school years getting progressively angrier about the bad compromises that her teachers were forced into.
Between "Common Core" and "Advanced Placement," the US system has been highly standardized. Teachers are under enormous pressure to teach specific aspects of specific subjects in a specific order, and students are told that their future life chances turn on their ability to pass high-stakes tests:
This gives rise to many frustrations for teachers and students alike, but nothing got my dander up so much as my daughter's math teachers' testing practices. In all of my kid's higher math classes, teachers had a single, prized set of tests, and lived in fear of these escaping into the wild and turning into cheating aids. As a result, teachers collected students' math exams and quizzes and did not return them. Students sat exams, worked through the problems and got their grades – but were not allowed to take home their tests to see where they went wrong.
Look, I know I'm no mathematician, and I know I'm not a math teacher, but I know enough about pedagogy to know that this is crazy. This is like trying to get better at archery by loosing arrows at a target but not checking to see where they hit. It's bananas.
I also understand why the teachers felt they had to do it. Writing test questions that test for specific concepts in a specific order is a lot of work, and generating new tests for every class is the kind of task that would consume time better spent on lesson planning and meeting with students.
It's easy to imagine a teacher who creates prompts for each test question that cause a chatbot to emit a new test paper for each class, along with answer keys. These questions are easily validated by a skilled teacher, who definitionally has the discernment to know whether a test question fits the bill. I could even see vibe-coding a little app to spit these questions out – though again, I would want the teacher to work through the questions each time to make sure they were sound.
Both my parents are teachers. My brother is a teacher. I teach every now and again. Teachers do a lot of repetitive, unrewarding work. They also do a lot of difficult, creative, extremely important work. Good teachers have the discernment to sort good classroom materials from bad ones. They do that already, because just as you don't need an LLM to generate bad spellchecker suggestions, you also don't need an LLM to generate sub-par educational materials. There are plenty of "educational" publishers who'll do that all day long.
AI is a normal technology. That means there are times when it is useful and times when it is pointless or actively harmful. One rule of thumb for chatbots is that they can only provide useful information to experts who have the discernment to ignore the defective output that LLMs always emit. That means that the dream of chatbots as replacements for teachers is a nightmare.
Getting rid of teachers because we all have chatbots is like getting rid of doctors because we all have the plague.
“Teachers are often unaware of the gender distribution of talk in their classrooms. They usually consider that they give equal amounts of attention to girls and boys, and it is only when they make a tape recording that they realize that boys are dominating the interactions. Dale Spender, an Australian feminist who has been a strong advocate of female rights in this area, noted that teachers who tried to restore the balance by deliberately ‘favouring’ the girls were astounded to find that despite their efforts they continued to devote more time to the boys in their classrooms. Another study reported that a male science teacher who managed to create an atmosphere in which girls and boys contributed more equally to discussion felt that he was devoting 90 per cent of his attention to the girls. And so did his male pupils. They complained vociferously that the girls were getting too much talking time. In other public contexts, too, such as seminars and debates, when women and men are deliberately given an equal amount of the highly valued talking time, there is often a perception that they are getting more than their fair share. Dale Spender explains this as follows: “The talkativeness of women has been gauged in comparison not with men but with silence. Women have not been judged on the grounds of whether they talk more than men, but of whether they talk more than silent women.” In other words, if women talk at all, this may be perceived as ‘too much’ by men who expect them to provide a silent, decorative background in many social contexts.”
—
PBS: Language as Prejudice - Myth #6: Women Talk Too Much (via misandry-mermaid)
Every EVERY women’s studies class I’ve been in has had this problem and failed to address it.
Wilson also wrote a 14-post thread on Bluesky about it:
1. It's a fun action movie. A line that got cut but sums up some of my overall feelings: This Odyssey is not a rich, satisfying Homeric banquet, but sometimes in the heat, an ice-cold Philly water ice is all you want - even it's mostly sugar and food coloring, and makes no nutritional sense.
2. Adaptations can do whatever the creators want with the source material, and in many cases, the more they diverge from or push back against the original, the better. e.g. I love Wild Sargasso Sea (and I also love Jane Eyre).
3. It's also totally fine to use American actors and a diverse cast. The costumes/ armor/boats are a mess, but who cares? Homer is also a mishmash, and see point #2.
4. It's less fine to waste your expensive diverse cast by terrible screen-writing, giving them zero convincing characterization or attempt to make us care about the relationships, and tokenism.
5. Adaptations are often most successful when they make clear, courageous choices about what to leave out - so, for instance, the movie "The Return" seems to me both a much more radical departure from the original source, and also a more successful film.
6. Nolan tries to pack a lot of Incidents and Big Ideas into this film, but they do not seem to me to hang together coherently on the level of his own plot and the movie's constructed system of values. Instead, it's foisting a didactic point about Our Times onto the plot without integrating it.
7. The film centers Odysseus's guilt over his war crimes, but never shows us the POV of his victims, and instead glorifies the perpetrator for feeling bad about himself. I found this unsatisfying ethically and worse, imaginatively, because Damon's character is given only one moo
7. I liked Nolan's low-budget early films - have seen Memento 3 times - but I think the money is a trap. It's easier to suspend disbelief if the actors are less famous. The huge budget leads him to attempt grand jam-packed epics, when he's better at taut, very premise-y small films.
8. I wish I liked this film more. I tried very hard to like it. I also felt it was valid to write about why it didn't work for me - especially since so much of the coverage has been so very positive, and I'm hardly punching down.
9. By far my favorite thing in the film is Robert Pattinson's hilarious and sexy Antinous. If anyone ever wants to make a spin off TV series with Antinous risen from the dead to mess with other mythical households, I would be so there for it.
10. Whatever one thinks of the film as a work of art, it's doing some good in the world, by generating big conversations, bringing new audiences to the cinema, and new readers to ancient literature. I hope it helps save the humanities.
11. Was I too mean? Or not mean enough? I went through my first draft and tried to take out the snark. To quote the great poet: "Though much is taken, much remains... That which we are, we are."
12. Beyond anything about the film as a film, it was a terrible and entirely unnecessary choice to film the Trojan Horse sequence in occupied Dakhla, Western Sahara, without the consent of the indigenous population.
Yes, it is Wide Sargasso Sea and yes, the Tennyson line is “though much is taken, much abides”. Many apologies and thank you for correcting. And thank you to all who read and engaged. I am very happy that some people respectfully disagreed with me, or had different feelings about the film from mine.
The kid next door (talking toddler age) is playing outside and just wiped out in his Fisher Price car, and I just heard the babysitter say, “oh no, your insurance premium is definitely going to go up!” And the kid who had only been mildly sniffling before made the most confused, but startled sound you’ve ever heard.
Just very clearly an attempt at saying, “my what?”
He straight up forgot about his scraped knee and is now worried about whatever the fuck an insurance premium is.
vaporwave
tangentwithtanner
yousharknotpass
turnnoffyourmind
kianamaiart
dailybridgerton
