I wrote a script to make a rudimentary predictive text generator for Worm:
It's not an ai or LLM, it's just a Markov chain that I built by splitting all of Worm into a list of words, then saving it as a dictionary of each one, two, three, four and five-word sequence that appears in worm, overlapping (the dict is 5M items long) along with each word that comes after each sequence. Then I just use that to generate probabilities and it can spit out something that's almost coherent!
It can (sort of) do dialogue because when parsing the text I had it look for words wrapped in quotes and mark them with a special character. When generating text it removes the character and adds the quotes back in. This means that technically, "the" and "the"(spoken in dialogue) are two different words from the script's point of view (RIP file size)
