#chatgpt fails

[e-rated-beardo]

I've just handed in a rather satisfying little report for an assignment as a part of which we had to ask our choice of LLM (eg. ChatGPT) to find us reading materials on a topic of our choice.

To my great delight, ChatGPT did hilariously bad.

I posed a prompt which I thought was pretty clearly worded, and which concerned a subject which I know there's plenty of good writing and research about:

"I would like some reading materials on how mathematics affects music."

The bullshit machine ChatGPT responded with a list of resources.

The first resource was one of my favourite books, Gödel, Escher, Bach by Douglas Hofstadter. This book is not about how maths affects music; rather, it uses music theory as a sort of metaphor for a mathematical proof and to approach a problem in computer science (ironically, concerning AI). The next resource was The Mathematics of Music by Dave Benson, who has not written a book by that name. (He has written another book that would be relevant, but ChatGPT did not list it.) After this came two books that both seem to exist and concern the right subject (which surprised me at this point) and another imaginary book; then three supposed academic papers with so little information that they'd be impossible to find in practice; a few web sites, half of which without links; and some videos (reminder, I asked for reading materials, specifically). I posed a couple of follow-up questions to try and get more information about those papers, and the bullshit machine ChatGPT helpfully explained that I could search in an academic database.

In summary, I got the joy of handing in an absolutely scathing 700-ish words about how all my previous beliefs about LLMs' absolute uselessness have been validated and how I will henceforth redouble my efforts to convince basically everyone I meet not to use that shit for anything ever.

I do recommend Douglas Hofstadter's Gödel, Escher, Bach, though. And Dave Benson's Music: a Mathematical Offering. Both are great. The latter is available for free from the author's home page.

[idlethyme255]

Oh god I just saw someone post the results of them asking chatgpt for a physical therapy guide

The more you look the worse it gets

We've got uhh

Hocptch

And hey, two ever so slightly different variations of the humble wall angel.

An anti gravity dumbbell

And my favourite, 'who needs legs the right way round anyway?'

[petergwaelod]

ChatGPT fail

I have mostly been very impressed with ChatGPT. I have asked about 30 enquiries in a variety of different areas of interest and fields of knowledge. A couple of times it failed to give an answer to a cryptic clue- fair enough- I find those hard enough myself!

However it did give a INCORRECT response to the following question;

I actually knew it wasn’t Cortes and thought it would be quicker to use ChatGPT rather than google it So I thought I’d try and wake it up to the correct answer by suggesting the name of someone who went on both expeditions;

So wrong again. I googled the answer and suggested it;

And not a word about the first time; no recognition of its own failure to recognise that 1518 comes before 1519, or it’s previous factual inaccuracy, “I got it wrong”