The trouble with AI

[eller]

AAARGH. I just wanted chatgpt's help to structure a text. You know - what should be in the introduction, how long should each part be for easy reading, and so on. Unsurprisingly, I'm shit at this stuff, but usually, the AI is of great help - at least when it comes to nonfiction with clear structural requirements. (Letting the AI write texts is, of course, hopeless, so I won't even try. Letting the AI organize text structures before I just write stream-of-consciousness stuff, however? I mean, that could save me some headaches.) Trying to let it organize fiction, however? Wow. WOW. Today, I learned that chatgpt is really Very Fucking American.

Things I learned:
- The AI will not just try to reorganize the plot around an acceptable novella structure (which, after all, is what I asked it to do) but flag any character behavior for editing that does not conform to American cultural standards.
- The AI told me that my characters are too obsessed with honor and duty and I should consider editing that. I'm like... WAIT... I'm actually writing a Fantasy!Medieval!North!Germany setting. With Fantasy!Medieval!North!German characters with according cultural background and mindset. (Come on. It's fucking Germany. At least some of the characters take their oaths seriously...) Apparently, Germany written by a German is not acceptable by genre standards...
- The AI completely unasked (!) changed a scene description from a male character making tea for the group to a female character making the tea. Thanks for the casual sexism, I guess.
- The AI described a female character as "flirtatious". She's... not. She is, however, speaking to male characters. In, you know, plot-related ways. Apparently, that's yet another thing the AI can't handle. (Not a problem with the technology itself, I know, but definitely with the training dataset. WTF.)
- The AI completely unasked (!) tried to give a genderfluid character an issuefic subplot centered around Gender!Angst!American!Style. I mean, I onbviously don't expect an American piece of software to understand historical German ways of gender expression... which is why I didn't ask it to. This character has a perfectly acceptable subplot centered around military technology and espionage, and.no gender issues whatsoever, thanks.
- The AI really wants to change the magic system (which is, of course, North German as fuck, considering the setting) to something ripped off Tolkien.
- The AI is shit at interpreting character motivations in ways that are actually pretty hilarious.

Thanks for the non-help. -_-

Comments

[sabotabby]

It's complicated, and I have dyscalculia and probably never would have been good at math. But at least I learned enough, back in the day when rote learning was mixed with problem solving, that I can kind of figure out what the problem is. I think there's some middle ground between whatever the US is doing, what Canada's doing, and what South Korea is doing.

Weirdly, the GM isn't using AI-generated text. It's just images, which are completely unnecessary and just for flavour. He's got two artists in the group. But also, I just don't regard any of these expressions—art, writing, gaming—as needs, so when I weigh it against the ethical horrors of AI, I just kinda go, "well, no one made you do it."

[yhlee]

I would argue from a design standpoint that 70% of any game is "game feel" or "flavo(u)r," but that's a separate argument. (Edit: "70%" is a shitty made-up statistic.)

It's not that I don't think there aren't ethical considerations around AI (licensing, resource use, monetization and interaction with venture capitalism and commodity tech). It's that I find a number of the arguments in this space are (as detailed in other comments here) frustratingly ill-formed, alongside the ones that worry me (generalized fucked human attention spans caused by, as you say, affordances; "where do people get entry-level experience to get to higher levels of experience if no one does entry-level anymore?" raised by castiron) weighed e.g. against AI as accessibility aid. I know of someone who uses AI aids for writing as a government-permitted accommodation for weapons-grade dyslexia (not in the US or Canada).