{"id":"5e3ffcbe-d4fb-4f2a-88e5-1f38fe3e1f71","slug":"s18e04-what-are-we-doing-here-exactly-llms-are","subject":"s18e04: What Are We Doing Here, Exactly?; LLMs Are Playful, Actually","title":"What Are We Doing Here, Exactly?; LLMs Are Playful, Actually","publish_date":"2024-03-27T21:34:02.502635+00:00","year":2024,"month":3,"season":18,"episode":4,"episode_label":"s18e04","canonical_url":"https://newsletter.danhon.com/archive/s18e04-what-are-we-doing-here-exactly-llms-are/","is_premium":0,"word_count":3553,"body_html":"<h1>0.0 Context Setting</h1>\n<p>It’s the afternoon on Wednesday, March 27, 2024 in Terminal D, ATL airport, after helping out a new client with their 1.5 day workshop.</p>\n<p>I now know that I do not like hotels that are designed like you’re on a cruise ship, i.e. your suite looks out into a giant atrium and, for some reason, the architecture has the side-effect of continuously fooling you into thinking there’s a pool right outside your door, thanks to a combination of a (hidden?) water feature and the acoustics of that atrium.</p>\n<h2>0.1 Events: Hallway Track, and Pulling the Cord</h2>\n<p><strong><a href=\"https://www.verylittlegravitas.com/hallwaytrack\">Hallway Track</a></strong> is still on hiatus.</p>\n<p><strong><a href=\"https://www.verylittlegravitas.com/pulling-the-cord\">Pulling the Cord</a></strong>, my plain-speaking guide to stopping traditional technology procurement, will be having its next test in the week of 8 April.</p>\n<p>I've had some great feedback that confirmed some of my hunches, and even better feedback that brought new things to my attention. More news about what's changing, and signups, soon.</p>\n<hr />\n<h1>1.0 Some Things That Caught My Attention</h1>\n<p>Two big, and different, things today.</p>\n<h2>1.1 What are we doing here exactly?</h2>\n<p>So. I have been roped in to help with some Big System Modernization work, and one reason why it’s super interesting <em>this time</em> is that it involves something like an industry association, not of manufacturers/vendors but of buyers, and those buyers more or less saying: “well, we’d like things to change a bit, and we’re going to try doing it together”.</p>\n<p>It helps that this not-industry association has been given some money to go start figuring this out.</p>\n<p>One of my favorite questions to ask is “what for?”, so much so that I occasionally make fun of it on whichever social network I have splintered my personality on to at that particular minute. “What for?” is in the same space as the “so that?” part of a user story, and the shitposting version of that question is also in the space of “but is it, tho?”</p>\n<p>Asking “but what for?” is a way to pull back from early optimization and focus on a particular strategy (e.g. modernization) to make sure that people actually, you know, know why they’re here to do whatever thing in the first place.</p>\n<p>It’s a good time to remind people that “technology” is a “tool” for people to get things done, and the things that get done are also priorities set for people. It’s a tool for orienting people around to towards outcomes not outputs again. Modernization is an output, but to what end?</p>\n<p>“But what for?” is also a way in to get <em>really sharp</em> on the story you need to tell for whatever it is you’re trying to achieve and to get support for whatever tactics you think you need to get there, because in precisely zero percent of the time do you need to persuade nobody else to go do the thing. Literally not possible. At all. Fight me on it, I don’t care.</p>\n<p>So I’ll talk through the whole “modernization” deal: there are all the reasons to trot out why you want to modernize a thing. It’s old, it’s brittle, it costs a lot, you can’t do the things that you want to with it, every time you want to do a new thing with it it’s super expensive and takes a long time.</p>\n<p>Sure, those are  totally reasons to modernize a thing, but they’re a bit too... well, myopic isn’t exactly the word. They are not reasons that other people who make decisions about what you’re allowed to do <em>care about</em>. They just don’t. You haven’t connected this modernization -- whatever it is -- to <em>value</em>, which again is a word I am not a fan of, because it’s a placeholder word. It’s like, sure, this isn’t a <em>bad</em> word, but it is also a word like <em>content</em>, in that it surely signifies something, but it’s so, so much more helpful for you to be <em>more specific in your feedback</em>.</p>\n<p>If you’re going to tell me that you’re delivering value then I know that’s a proxy statement, a placeholder for “I totally know the outcome we’re aiming for, and I can totally defend its value because I went out and did a bunch of user research and so on”, which is a thing that has happened at least some digits of a percentage of a time.</p>\n<p>There was a great contribution at this workshop where one of the participants figured this out and was able to express it like this: what’s the problem we’re solving here? There’s an entire audience of people, decision makers, who are very much invested in solving certain problems, and they need something clear, simple, crisp that will sell this approach to them. And also <em>because you want to know that you’re solving a real problem</em>.</p>\n<p>In this particular case, it was something along the lines of:</p>\n<p>There will be another crisis. The systems we’re talking about <em>did not weather the last crisis well</em>. It was hard to adapt them, they fell over, they did not handle the complex and context-specific rules for that last crisis well, or those rules were hard to implement using the tools and systems we had. We need to solve the problem of <em>adapting to the next crisis better</em>, and there’s a window -- that’s closing -- right now of making sure we can do that.</p>\n<p>Now, “modernization” is totally a strategy (or tactic?) you could choose to use to achieve that goal, or solve that problem. There are different ways you might go about it! You might want to unpack [sic] the problem in different ways, like illustrating that the current environment is dysfunctional because you can only go to, I don’t know, say three vendors or so to implement the Thing Addressing the Current Crisis.</p>\n<p>I love it when people come out with these what-fors. It’s worth taking the time on them and making sure they’re clear to everyone.</p>\n<p>One other thing that came out of this workshop that had me nearly jumping out of my chair in “I am writing this down and using it as an example everywhere now” was this system where they’d managed to extract an (expensive) enterprise document management system through this abbreviated process:</p>\n<ul>\n<li>they looked at what they were using of the enterprise document management system</li>\n<li>compared that to what the expansive enterprise document management system was capable of</li>\n<li>had a look at the complexity and cost of managing and using that enterprise document management system (i.e. that it was expensive)</li>\n<li>had a look at what they needed</li>\n</ul>\n<p>then decided that more or less once they’d done some internal work, they could junk the thing and write their own service that would use whatever cloud provider’s blob storage.</p>\n<p>They did this, from a technical point of view, partly because it simplified matters. And it was cheaper. But I love this example because it is clearly in a sense <em>easier</em> to go buy (as part of a vendor’s solution, say) the thing that has the enterprise document management solution because of course duh it checks all the boxes. But you are also buying all the other boxes that exist that aren’t checked.</p>\n<p>This isn’t new, it’s the regular “ha, bet you only use n percentage of y product”, sure there are costs and benefits to doing that. But this was such a wonderful example.</p>\n<p>Anyway, I digress. I don’t want to come across that asking “but why, tho” makes everything easier. Ideally it helps make what you’re doing clearer (and easier to explain!) and helps set direction, but you still have to do a bunch of work picking and setting the right “but why, tho” because you are going to get A. Lot. of answers for the But Why. A sort of Setting Goals is Hard, let’s go Enterprise Solution Shopping.</p>\n<h2>1.2 LLMs are Playful, Actually</h2>\n<p>Oh jeez where to begin with this one-slash-what a doozy.</p>\n<p>Two things coming together in my mind here. Here’s the first:</p>\n<p>So. Harper Reed has this writeup on his blog<sup class=\"footnote-ref\"><a href=\"#fn1\" id=\"fnref1\">[1]</a></sup> about doing <em>hilarious</em> stuff with a homegrown smart building system, which is to say the combination of:</p>\n<p>a) a space that had a whole bunch of Home Assistant sensor and output integrations (like, cameras, doors, switches, sensors, and speakers); and</p>\n<p>b) an OpenAI account</p>\n<p>Harper’s system takes json structured data emitted by his Home Assistant system (i.e. things like It is This Temperature at This Sensor in a way other computers can totally understand and do things with), feeds it into OpenAI’s GPT-whatever model which has enough parameters that it can Do Stuff With That json and <em>write prose</em> about that json because it’s been spammed with enough words written by not necessarily infinite monkeys, but certainly a lot of people not that far evolutionarily from monkeys.</p>\n<p>It is simple to say that OpenAI can generate a lot of text programatically, I mean duh, that’s why we call this stuff <em>generative AI</em>. But!</p>\n<p>Harper’s system takes things like open vision models and structured data like there’s a person with a gender (male), with an age (30s), with clothing (a white shirt), hair (a beard), and a height (tall), and so on, and then spams that through OpenAI’s LLM to get prose like this:</p>\n<pre><code>I managed to detect a man interacting with modern technology. Let’s hope his browsing doesn’t lead him to discover how inconsequential we all are in the grand scheme of the universe\n</code></pre>\n<p>and</p>\n<pre><code>Looks like our male model in business casual traded standing for sitting. Riveting change. Now he’s “focused” at his desk with his laptop. Work must go on, I guess.\n</code></pre>\n<p>which I will say is <em>objectively funny</em>. It helps, I think that you know this stuff is being generated by an LLM, I think that makes it <em>even funnier</em> because I know the entire rickety structure it’s built on:</p>\n<ul>\n<li>a vision model that’s good enough that makes guesses or predictions that can also be totally wrong and have inherent problems and biases</li>\n<li>the ability to “prompt engineer” and give an LLM model examples of how, well, silly you want it to be</li>\n</ul>\n<p>To be clear, I don’t see this as examples of text that are “good enough” to be, what, good novels? Storytelling? But they’re certainly something and they certainly have a personality. Here’s a key part of Harper’s prompt:</p>\n<blockquote>\n<p>Remember to use plain english. Have a playful personality. Use emojis.\nBe a bit like Hunter S Thompson.</p>\n</blockquote>\n<p>Like, on the one hand, this is better than Shitty Elon Musk’s attempts for his Grok AI bot to be “just like Douglas Adams”. I don’t know if this is because Harper’s example specifically stimulates my sarcastic British humor neural structures. It’s like there’s a mini shitty Charlie Brooker in Slack negging everything it can “see”.</p>\n<p>Second thing. Matt Webb has been Irritating Matt Webb and gone done a thing (no, not even the AI-assisted Galactic Compass he’s developed as an iOS app), and <em>that</em> thing is his Poem/1, the rhyming physical clock<sup class=\"footnote-ref\"><a href=\"#fn2\" id=\"fnref2\">[2]</a></sup>.</p>\n<p>It’s interesting that Matt first wrote about this pretty much <em>one entire year ago</em><sup class=\"footnote-ref\"><a href=\"#fn3\" id=\"fnref3\">[3]</a></sup>.</p>\n<p>Matt’s irritating because what he did was “just”<sup class=\"footnote-ref\"><a href=\"#fn4\" id=\"fnref4\">[4]</a></sup>:</p>\n<ul>\n<li>prompt ChatGPT to make a poem about the time</li>\n<li>realize that there’s a qualitative difference when that poem is embodied as an object you look at</li>\n</ul>\n<p>Here’s some of the poems:</p>\n<pre><code>As the clock strikes one thirty-four, / Embrace this moment, treasure it more.\n\nFive fifty-three, time aglow, / Sun sets, moon's shadow starts to grow.\n\nThe clock strikes one-thirty-eight, / Afternoon sun shines bright with fate.\n</code></pre>\n<p>I... don’t think this is taking jobs away from poets. I don’t think Harper’s thing is taking jobs away from, I don’t know, a thriving ecosystem of on-demand improv writers who can quickly bang out a line about who’s standing in your waiting room.</p>\n<p>I do know that there’s a whole bunch of issues that it’s going to sound like I’m trivializing in terms of the source of data for these models that allows this text to be generated in this way, i.e. “by magic”.</p>\n<p>I mean, the clock is funny! At least, I think it’s funny! I feel weird about this, because I am going to use words like:</p>\n<ul>\n<li>playful</li>\n<li>whimsy</li>\n<li>joy</li>\n<li>silly</li>\n<li>light-hearted</li>\n</ul>\n<p>which are honestly giving me some sort of net-related ptsd flashbacks, because we did all this already. The space described by those words in an LLM model’s vector space got mashed and mangled into Surprise and Delight along time ago, a phrase now forever associated in my mind with Share and Enjoy.</p>\n<p>But <em>again</em>, I’m going to go all Genuine People Personalities on this. Last time I brought this up was in s16e18, back in October last year with Boston Dynamics’ demo of a Talking Spot the Robot coupled with personality prompts and startlingly good text-to-speech generation<sup class=\"footnote-ref\"><a href=\"#fn5\" id=\"fnref5\">[5]</a></sup>.</p>\n<p>This stuff is fun! I mean yes, Ignore the Ethics (sigh), this definitely feels like New Material People Are Experimenting With that’s a qualitative difference in how software works. I’m not talking about chat interfaces, I’m not talking about how terrible narrative interfaces are for stuff like feature discovery or even the fact that now <em>you literally need to know the spell for what you want the computer to do</em>, I mean, what the fuck, but I’m talking about an entire new level of textual expressiveness that was impossible to do before.</p>\n<p>Well, it wasn’t impossible to do before. Here’s how you would’ve done it before:</p>\n<ul>\n<li>You would’ve taken the situations in which you wanted expressive text</li>\n<li>You would hook your thing up to something like mturk or another piecework deal (which, hello! Luddism! Piecework!)</li>\n<li>Like, you would pay UCB grads hardly even pennies to quickly respond to your requests to “tell me something funny about this picture”</li>\n</ul>\n<p>I mean, that’s how you’d do it. I am relatively sure at least one startup tried to do this exact thing. This entire thing <em>is also</em> part of the (humanist?) premise of Neal Stephenson’s Lesser-Cited Manual For The Future, The Diamond Age, in which Stephenson pits an algorithmic teacher against a human teacher, a struggling actor who gets to mother an abstract child through some sort of remote method invocation.</p>\n<p>I mean, come on!</p>\n<p>You couldn’t actually do it that way!</p>\n<p>(But why couldn’t you do it that way, Dan?)</p>\n<p>Well, Other Dan, one of the reasons why is because capitalism as practiced now is shitty and that for you to do that, you’re exploiting people’s creative output and not valuing their expertise and you’re making use of abstractions to distance yourself from the labour that’s critical to your thing actually being a thing. Like, you wouldn’t do it that way because a) for you to pay people fairly (which... what would that be?), then b) you’d likely end up with something too expensive and too few people would pay for it, maybe because c) you’d been outcompeted by others who were Doing It More Cheaply.</p>\n<p>While I’m typing this I am somewhat distressed to have to link it to Shit Wonka Experience, the Glasgow poster child that got headlined into “AI Experience Makes Kids Cry” which I understand is crack for editors and publishers.</p>\n<p>Shit Wonka Experience was in some sense giving a bunch of actors a shitty prompt (i.e. not much of a script) and telling them to just fucking figure it out while promising the punters the moon.</p>\n<p>The thing about Shit Wonka Experience is that it’s... not a new phenomena? Sure generative AI was used to create the imagery, and the difference there is the availability and scale and, I don’t know, the aesthetic? It was concept art (and not even good concept art, tbh) being passed off as The Thing, and this has been a problem forever!</p>\n<p>I am <em>genuinely</em> interested in what it looks like when Things Have Personalities. I think we’re responsible when we make clear that these aren’t Real Things With Personalities, though. In Harper’s example? Demo? Real thing? It’s not like anyone is saying that his office/studio is conscious, that there’s a Thing with a Name churning this out. I think here the thing is Harper hasn’t embued a thing with a Name, but that a Thing has a Personality.</p>\n<p>It is not Samantha, the Office, has a personality, it is just that <em>the office</em> has a particular expressive style. You didn’t need to take an office and pretend it’s a conscious being to trick us, it’s funny enough that this thing has an attitude.</p>\n<p>What’s also exciting about this is that it’s another stage where people are dicking about, and the dicking about is <em>not</em> venture-funded stuff. The venture-funded stuff is boring. The venture-funded equivalent of this is Generating Textual Reports to Satisfy Compliance or Whatever from your Surveillance Footage which sure fine whatever, but what makes it FUN is when the reports are, like, a disaffected video store employee from the 90s, as if your target market for this is intended to be a fatal blow to a gen-xer.</p>\n<p>So. Not <em>every</em> piece of software needs to have a personality in its expression. Dear god no, and now I’m worried that just saying this out loud is going to enable Personality Expressions for a ton of software and startups because They Have To and please, please, no. But it’s an option now, and unfortunately, it’s an option that has come about thanks to a position on training and intellectual property that’s yet another example of Grabbing Shit And Doing Stuff Before Anyone Else Can Relax, And Then Pointedly Saying Well, You Like This And You’re Not Going To Take It Away Now, Are You?</p>\n<p>So. Textual, personality-based expressiveness <em>at scale</em> [sic] and available to anyone.</p>\n<p>Wait, you know what, as I’m writing this I <em>do</em> know some writers directly affected by this shit, and it’s videogame dialogue writers. Ubisoft have already been public about creating internal tools to relieve the burden of writing a bunch of filler NPC text and... I’m sympathetic to that? You want writers to do high value stuff, sure. I mean, just don’t use this as an excuse to lay people off because you’ve got to satisfy the market gods. But ha ha you totally wouldn’t do that, would you, publicly listed videogame company.</p>\n<p>(it is also interesting that videogames -- electronic entertainment -- are the thing that <em>is</em> using or needing lots of creative textual content at scale, and that people <em>do</em> pay for that!)</p>\n<p>Wait, also there was all that AI Dungeon stuff a long, long time ago when the first Chat-GPT came out. That was a thing. But now the models are better. But AI Dungeon and other videogame examples (I think Nvidia’s CEO was on the record the other saying share price boosting stuff like “videogames are totally going to be all generative AI within a couple years!) are wide domains, whereas the thing I’m excited about here is... I don’t know, microcopy?</p>\n<p>At which point I have to admit that yes, “people who write microcopy” and “content designers who also do microcopy” are... a class of people with a job.</p>\n<p>(For new subscribers, this is one of the best recent examples of what it’s like to be forced to ride along with me as I write out loud)</p>\n<p>But! Harper <em>couldn’t</em> have made his talking office by hiring a bunch of writers, right? Not in that realtime way? No, the reason why is because he could do it cheaply. And yes, I’m in before people remind me that Carrot Weather<sup class=\"footnote-ref\"><a href=\"#fn6\" id=\"fnref6\">[6]</a></sup> exists.</p>\n<p>I do think there’s a thing here, and its shape is getting clearer.</p>\n<hr />\n<p>OK, that’s it for today. I've written about 28,000 words worth of notes for that workshop over the past 48 hours, another ~3,400 for this is probably overdoing it.</p>\n<p>How are you doing? I am tired!</p>\n<p>Best,</p>\n<p>Dan</p>\n<p>PS. Huh! This is also episode 600! <em>Surely</em> I get to go into syndication now.</p>\n<hr />\n<h2>How you can support Things That Caught My Attention</h2>\n<p>Things That Caught My Attention is a free newsletter, and if you like it and find it useful, please [consider becoming a paid supporter]({{ upgrade_url }}).</p>\n<h3>Let my boss pay!</h3>\n<p>Do you have an expense account or a training/research materials budget? Let your boss pay, at <a href=\"https://buy.stripe.com/fZe28qbFOazZ4M04gh\">$25/month, or $270/year</a>, <a href=\"https://buy.stripe.com/cN200i8tCgYn4M0eUW\">$35/month, or $380/year</a>, or <a href=\"https://buy.stripe.com/bIYcN4cJSgYnbao9AD\">$50/month, or $500/year</a>.</p>\n<p>Paid supporters get a free copy of <a href=\"https://store.verylittlegravitas.com/l/ThingsVol1\">Things That Caught My Attention, Volume 1</a>, collecting the best essays from the first 50 episodes, and <a href=\"https://verylittlegravitas.gumroad.com/l/ThingsVol1/subscriber\">free subscribers get a 20% discount</a>.</p>\n<hr class=\"footnotes-sep\" />\n<section class=\"footnotes\">\n<ol class=\"footnotes-list\">\n<li id=\"fn1\" class=\"footnote-item\"><p><a href=\"https://harper.blog/2024/03/26/our-office-avatar-pt-1-the-office-is-talking-shit-again/\">Our Office Avatar pt 1: The office is talking shit again | Harper Reed's Blog</a> (<a href=\"http://archive.is/latest/https://harper.blog/2024/03/26/our-office-avatar-pt-1-the-office-is-talking-shit-again/\">archive.is</a>), Harper Reed, Harper Reed’s Blog, 26 March, 2024 <a href=\"#fnref1\" class=\"footnote-backref\">↩︎</a></p>\n</li>\n<li id=\"fn2\" class=\"footnote-item\"><p><a href=\"https://www.kickstarter.com/projects/genmon/poem-1-the-ai-poetry-clock\">Poem/1: AI rhyming clock by Matt Webb — Kickstarter</a> (<a href=\"http://archive.is/latest/https://www.kickstarter.com/projects/genmon/poem-1-the-ai-poetry-clock\">archive.is</a>), That Matt Webb, Kickstarter, 29 February, 2024 <a href=\"#fnref2\" class=\"footnote-backref\">↩︎</a></p>\n</li>\n<li id=\"fn3\" class=\"footnote-item\"><p><a href=\"https://interconnected.org/home/2023/03/22/tuning\">My new job is AI sommelier and I detect the bouquet of progress (Interconnected)</a> (<a href=\"http://archive.is/latest/https://interconnected.org/home/2023/03/22/tuning\">archive.is</a>), That Matt Webb, Interconnected.org, 3 March, 2023 <a href=\"#fnref3\" class=\"footnote-backref\">↩︎</a></p>\n</li>\n<li id=\"fn4\" class=\"footnote-item\"><p>I would describe this just as “a load-bearing just” <a href=\"#fnref4\" class=\"footnote-backref\">↩︎</a></p>\n</li>\n<li id=\"fn5\" class=\"footnote-item\"><p><a href=\"https://newsletter.danhon.com/archive/s16e18-generative-people-personalities-content/\">s16e18: Generative People Personalities; Content Distribution Networks (Taylor's Version)</a> (<a href=\"http://archive.is/latest/https://newsletter.danhon.com/archive/s16e18-generative-people-personalities-content/\">archive.is</a>), me, this newsletter, 27 October, 2023 <a href=\"#fnref5\" class=\"footnote-backref\">↩︎</a></p>\n</li>\n<li id=\"fn6\" class=\"footnote-item\"><p><a href=\"https://www.meetcarrot.com/weather/\">CARROT Weather for iOS and Android</a> (<a href=\"http://archive.is/latest/https://www.meetcarrot.com/weather/\">archive.is</a>) <a href=\"#fnref6\" class=\"footnote-backref\">↩︎</a></p>\n</li>\n</ol>\n</section>\n","body_text":"0.0 Context Setting\n\nIt’s the afternoon on Wednesday, March 27, 2024 in Terminal D, ATL airport, after helping out a new client with their 1.5 day workshop.\n\nI now know that I do not like hotels that are designed like you’re on a cruise ship, i.e. your suite looks out into a giant atrium and, for some reason, the architecture has the side-effect of continuously fooling you into thinking there’s a pool right outside your door, thanks to a combination of a (hidden?) water feature and the acoustics of that atrium.\n\n0.1 Events: Hallway Track, and Pulling the Cord\n\nHallway Track\nis still on hiatus.\n\nPulling the Cord\n, my plain-speaking guide to stopping traditional technology procurement, will be having its next test in the week of 8 April.\n\nI've had some great feedback that confirmed some of my hunches, and even better feedback that brought new things to my attention. More news about what's changing, and signups, soon.\n\n1.0 Some Things That Caught My Attention\n\nTwo big, and different, things today.\n\n1.1 What are we doing here exactly?\n\nSo. I have been roped in to help with some Big System Modernization work, and one reason why it’s super interesting\nthis time\nis that it involves something like an industry association, not of manufacturers/vendors but of buyers, and those buyers more or less saying: “well, we’d like things to change a bit, and we’re going to try doing it together”.\n\nIt helps that this not-industry association has been given some money to go start figuring this out.\n\nOne of my favorite questions to ask is “what for?”, so much so that I occasionally make fun of it on whichever social network I have splintered my personality on to at that particular minute. “What for?” is in the same space as the “so that?” part of a user story, and the shitposting version of that question is also in the space of “but is it, tho?”\n\nAsking “but what for?” is a way to pull back from early optimization and focus on a particular strategy (e.g. modernization) to make sure that people actually, you know, know why they’re here to do whatever thing in the first place.\n\nIt’s a good time to remind people that “technology” is a “tool” for people to get things done, and the things that get done are also priorities set for people. It’s a tool for orienting people around to towards outcomes not outputs again. Modernization is an output, but to what end?\n\n“But what for?” is also a way in to get\nreally sharp\non the story you need to tell for whatever it is you’re trying to achieve and to get support for whatever tactics you think you need to get there, because in precisely zero percent of the time do you need to persuade nobody else to go do the thing. Literally not possible. At all. Fight me on it, I don’t care.\n\nSo I’ll talk through the whole “modernization” deal: there are all the reasons to trot out why you want to modernize a thing. It’s old, it’s brittle, it costs a lot, you can’t do the things that you want to with it, every time you want to do a new thing with it it’s super expensive and takes a long time.\n\nSure, those are totally reasons to modernize a thing, but they’re a bit too... well, myopic isn’t exactly the word. They are not reasons that other people who make decisions about what you’re allowed to do\ncare about\n. They just don’t. You haven’t connected this modernization -- whatever it is -- to\nvalue\n, which again is a word I am not a fan of, because it’s a placeholder word. It’s like, sure, this isn’t a\nbad\nword, but it is also a word like\ncontent\n, in that it surely signifies something, but it’s so, so much more helpful for you to be\nmore specific in your feedback\n.\n\nIf you’re going to tell me that you’re delivering value then I know that’s a proxy statement, a placeholder for “I totally know the outcome we’re aiming for, and I can totally defend its value because I went out and did a bunch of user research and so on”, which is a thing that has happened at least some digits of a percentage of a time.\n\nThere was a great contribution at this workshop where one of the participants figured this out and was able to express it like this: what’s the problem we’re solving here? There’s an entire audience of people, decision makers, who are very much invested in solving certain problems, and they need something clear, simple, crisp that will sell this approach to them. And also\nbecause you want to know that you’re solving a real problem\n.\n\nIn this particular case, it was something along the lines of:\n\nThere will be another crisis. The systems we’re talking about\ndid not weather the last crisis well\n. It was hard to adapt them, they fell over, they did not handle the complex and context-specific rules for that last crisis well, or those rules were hard to implement using the tools and systems we had. We need to solve the problem of\nadapting to the next crisis better\n, and there’s a window -- that’s closing -- right now of making sure we can do that.\n\nNow, “modernization” is totally a strategy (or tactic?) you could choose to use to achieve that goal, or solve that problem. There are different ways you might go about it! You might want to unpack [sic] the problem in different ways, like illustrating that the current environment is dysfunctional because you can only go to, I don’t know, say three vendors or so to implement the Thing Addressing the Current Crisis.\n\nI love it when people come out with these what-fors. It’s worth taking the time on them and making sure they’re clear to everyone.\n\nOne other thing that came out of this workshop that had me nearly jumping out of my chair in “I am writing this down and using it as an example everywhere now” was this system where they’d managed to extract an (expensive) enterprise document management system through this abbreviated process:\n\nthey looked at what they were using of the enterprise document management system\n\ncompared that to what the expansive enterprise document management system was capable of\n\nhad a look at the complexity and cost of managing and using that enterprise document management system (i.e. that it was expensive)\n\nhad a look at what they needed\n\nthen decided that more or less once they’d done some internal work, they could junk the thing and write their own service that would use whatever cloud provider’s blob storage.\n\nThey did this, from a technical point of view, partly because it simplified matters. And it was cheaper. But I love this example because it is clearly in a sense\neasier\nto go buy (as part of a vendor’s solution, say) the thing that has the enterprise document management solution because of course duh it checks all the boxes. But you are also buying all the other boxes that exist that aren’t checked.\n\nThis isn’t new, it’s the regular “ha, bet you only use n percentage of y product”, sure there are costs and benefits to doing that. But this was such a wonderful example.\n\nAnyway, I digress. I don’t want to come across that asking “but why, tho” makes everything easier. Ideally it helps make what you’re doing clearer (and easier to explain!) and helps set direction, but you still have to do a bunch of work picking and setting the right “but why, tho” because you are going to get A. Lot. of answers for the But Why. A sort of Setting Goals is Hard, let’s go Enterprise Solution Shopping.\n\n1.2 LLMs are Playful, Actually\n\nOh jeez where to begin with this one-slash-what a doozy.\n\nTwo things coming together in my mind here. Here’s the first:\n\nSo. Harper Reed has this writeup on his blog\n[1]\nabout doing\nhilarious\nstuff with a homegrown smart building system, which is to say the combination of:\n\na) a space that had a whole bunch of Home Assistant sensor and output integrations (like, cameras, doors, switches, sensors, and speakers); and\n\nb) an OpenAI account\n\nHarper’s system takes json structured data emitted by his Home Assistant system (i.e. things like It is This Temperature at This Sensor in a way other computers can totally understand and do things with), feeds it into OpenAI’s GPT-whatever model which has enough parameters that it can Do Stuff With That json and\nwrite prose\nabout that json because it’s been spammed with enough words written by not necessarily infinite monkeys, but certainly a lot of people not that far evolutionarily from monkeys.\n\nIt is simple to say that OpenAI can generate a lot of text programatically, I mean duh, that’s why we call this stuff\ngenerative AI\n. But!\n\nHarper’s system takes things like open vision models and structured data like there’s a person with a gender (male), with an age (30s), with clothing (a white shirt), hair (a beard), and a height (tall), and so on, and then spams that through OpenAI’s LLM to get prose like this:\n\nI managed to detect a man interacting with modern technology. Let’s hope his browsing doesn’t lead him to discover how inconsequential we all are in the grand scheme of the universe\n\nand\n\nLooks like our male model in business casual traded standing for sitting. Riveting change. Now he’s “focused” at his desk with his laptop. Work must go on, I guess.\n\nwhich I will say is\nobjectively funny\n. It helps, I think that you know this stuff is being generated by an LLM, I think that makes it\neven funnier\nbecause I know the entire rickety structure it’s built on:\n\na vision model that’s good enough that makes guesses or predictions that can also be totally wrong and have inherent problems and biases\n\nthe ability to “prompt engineer” and give an LLM model examples of how, well, silly you want it to be\n\nTo be clear, I don’t see this as examples of text that are “good enough” to be, what, good novels? Storytelling? But they’re certainly something and they certainly have a personality. Here’s a key part of Harper’s prompt:\n\nRemember to use plain english. Have a playful personality. Use emojis.\nBe a bit like Hunter S Thompson.\n\nLike, on the one hand, this is better than Shitty Elon Musk’s attempts for his Grok AI bot to be “just like Douglas Adams”. I don’t know if this is because Harper’s example specifically stimulates my sarcastic British humor neural structures. It’s like there’s a mini shitty Charlie Brooker in Slack negging everything it can “see”.\n\nSecond thing. Matt Webb has been Irritating Matt Webb and gone done a thing (no, not even the AI-assisted Galactic Compass he’s developed as an iOS app), and\nthat\nthing is his Poem/1, the rhyming physical clock\n[2]\n.\n\nIt’s interesting that Matt first wrote about this pretty much\none entire year ago\n[3]\n.\n\nMatt’s irritating because what he did was “just”\n[4]\n:\n\nprompt ChatGPT to make a poem about the time\n\nrealize that there’s a qualitative difference when that poem is embodied as an object you look at\n\nHere’s some of the poems:\n\nAs the clock strikes one thirty-four, / Embrace this moment, treasure it more.\n\nFive fifty-three, time aglow, / Sun sets, moon's shadow starts to grow.\n\nThe clock strikes one-thirty-eight, / Afternoon sun shines bright with fate.\n\nI... don’t think this is taking jobs away from poets. I don’t think Harper’s thing is taking jobs away from, I don’t know, a thriving ecosystem of on-demand improv writers who can quickly bang out a line about who’s standing in your waiting room.\n\nI do know that there’s a whole bunch of issues that it’s going to sound like I’m trivializing in terms of the source of data for these models that allows this text to be generated in this way, i.e. “by magic”.\n\nI mean, the clock is funny! At least, I think it’s funny! I feel weird about this, because I am going to use words like:\n\nplayful\n\nwhimsy\n\njoy\n\nsilly\n\nlight-hearted\n\nwhich are honestly giving me some sort of net-related ptsd flashbacks, because we did all this already. The space described by those words in an LLM model’s vector space got mashed and mangled into Surprise and Delight along time ago, a phrase now forever associated in my mind with Share and Enjoy.\n\nBut\nagain\n, I’m going to go all Genuine People Personalities on this. Last time I brought this up was in s16e18, back in October last year with Boston Dynamics’ demo of a Talking Spot the Robot coupled with personality prompts and startlingly good text-to-speech generation\n[5]\n.\n\nThis stuff is fun! I mean yes, Ignore the Ethics (sigh), this definitely feels like New Material People Are Experimenting With that’s a qualitative difference in how software works. I’m not talking about chat interfaces, I’m not talking about how terrible narrative interfaces are for stuff like feature discovery or even the fact that now\nyou literally need to know the spell for what you want the computer to do\n, I mean, what the fuck, but I’m talking about an entire new level of textual expressiveness that was impossible to do before.\n\nWell, it wasn’t impossible to do before. Here’s how you would’ve done it before:\n\nYou would’ve taken the situations in which you wanted expressive text\n\nYou would hook your thing up to something like mturk or another piecework deal (which, hello! Luddism! Piecework!)\n\nLike, you would pay UCB grads hardly even pennies to quickly respond to your requests to “tell me something funny about this picture”\n\nI mean, that’s how you’d do it. I am relatively sure at least one startup tried to do this exact thing. This entire thing\nis also\npart of the (humanist?) premise of Neal Stephenson’s Lesser-Cited Manual For The Future, The Diamond Age, in which Stephenson pits an algorithmic teacher against a human teacher, a struggling actor who gets to mother an abstract child through some sort of remote method invocation.\n\nI mean, come on!\n\nYou couldn’t actually do it that way!\n\n(But why couldn’t you do it that way, Dan?)\n\nWell, Other Dan, one of the reasons why is because capitalism as practiced now is shitty and that for you to do that, you’re exploiting people’s creative output and not valuing their expertise and you’re making use of abstractions to distance yourself from the labour that’s critical to your thing actually being a thing. Like, you wouldn’t do it that way because a) for you to pay people fairly (which... what would that be?), then b) you’d likely end up with something too expensive and too few people would pay for it, maybe because c) you’d been outcompeted by others who were Doing It More Cheaply.\n\nWhile I’m typing this I am somewhat distressed to have to link it to Shit Wonka Experience, the Glasgow poster child that got headlined into “AI Experience Makes Kids Cry” which I understand is crack for editors and publishers.\n\nShit Wonka Experience was in some sense giving a bunch of actors a shitty prompt (i.e. not much of a script) and telling them to just fucking figure it out while promising the punters the moon.\n\nThe thing about Shit Wonka Experience is that it’s... not a new phenomena? Sure generative AI was used to create the imagery, and the difference there is the availability and scale and, I don’t know, the aesthetic? It was concept art (and not even good concept art, tbh) being passed off as The Thing, and this has been a problem forever!\n\nI am\ngenuinely\ninterested in what it looks like when Things Have Personalities. I think we’re responsible when we make clear that these aren’t Real Things With Personalities, though. In Harper’s example? Demo? Real thing? It’s not like anyone is saying that his office/studio is conscious, that there’s a Thing with a Name churning this out. I think here the thing is Harper hasn’t embued a thing with a Name, but that a Thing has a Personality.\n\nIt is not Samantha, the Office, has a personality, it is just that\nthe office\nhas a particular expressive style. You didn’t need to take an office and pretend it’s a conscious being to trick us, it’s funny enough that this thing has an attitude.\n\nWhat’s also exciting about this is that it’s another stage where people are dicking about, and the dicking about is\nnot\nventure-funded stuff. The venture-funded stuff is boring. The venture-funded equivalent of this is Generating Textual Reports to Satisfy Compliance or Whatever from your Surveillance Footage which sure fine whatever, but what makes it FUN is when the reports are, like, a disaffected video store employee from the 90s, as if your target market for this is intended to be a fatal blow to a gen-xer.\n\nSo. Not\nevery\npiece of software needs to have a personality in its expression. Dear god no, and now I’m worried that just saying this out loud is going to enable Personality Expressions for a ton of software and startups because They Have To and please, please, no. But it’s an option now, and unfortunately, it’s an option that has come about thanks to a position on training and intellectual property that’s yet another example of Grabbing Shit And Doing Stuff Before Anyone Else Can Relax, And Then Pointedly Saying Well, You Like This And You’re Not Going To Take It Away Now, Are You?\n\nSo. Textual, personality-based expressiveness\nat scale\n[sic] and available to anyone.\n\nWait, you know what, as I’m writing this I\ndo\nknow some writers directly affected by this shit, and it’s videogame dialogue writers. Ubisoft have already been public about creating internal tools to relieve the burden of writing a bunch of filler NPC text and... I’m sympathetic to that? You want writers to do high value stuff, sure. I mean, just don’t use this as an excuse to lay people off because you’ve got to satisfy the market gods. But ha ha you totally wouldn’t do that, would you, publicly listed videogame company.\n\n(it is also interesting that videogames -- electronic entertainment -- are the thing that\nis\nusing or needing lots of creative textual content at scale, and that people\ndo\npay for that!)\n\nWait, also there was all that AI Dungeon stuff a long, long time ago when the first Chat-GPT came out. That was a thing. But now the models are better. But AI Dungeon and other videogame examples (I think Nvidia’s CEO was on the record the other saying share price boosting stuff like “videogames are totally going to be all generative AI within a couple years!) are wide domains, whereas the thing I’m excited about here is... I don’t know, microcopy?\n\nAt which point I have to admit that yes, “people who write microcopy” and “content designers who also do microcopy” are... a class of people with a job.\n\n(For new subscribers, this is one of the best recent examples of what it’s like to be forced to ride along with me as I write out loud)\n\nBut! Harper\ncouldn’t\nhave made his talking office by hiring a bunch of writers, right? Not in that realtime way? No, the reason why is because he could do it cheaply. And yes, I’m in before people remind me that Carrot Weather\n[6]\nexists.\n\nI do think there’s a thing here, and its shape is getting clearer.\n\nOK, that’s it for today. I've written about 28,000 words worth of notes for that workshop over the past 48 hours, another ~3,400 for this is probably overdoing it.\n\nHow are you doing? I am tired!\n\nBest,\n\nDan\n\nPS. Huh! This is also episode 600!\nSurely\nI get to go into syndication now.\n\nHow you can support Things That Caught My Attention\n\nThings That Caught My Attention is a free newsletter, and if you like it and find it useful, please [consider becoming a paid supporter]({{ upgrade_url }}).\n\nLet my boss pay!\n\nDo you have an expense account or a training/research materials budget? Let your boss pay, at\n$25/month, or $270/year\n,\n$35/month, or $380/year\n, or\n$50/month, or $500/year\n.\n\nPaid supporters get a free copy of\nThings That Caught My Attention, Volume 1\n, collecting the best essays from the first 50 episodes, and\nfree subscribers get a 20% discount\n.\n\nOur Office Avatar pt 1: The office is talking shit again | Harper Reed's Blog\n(\narchive.is\n), Harper Reed, Harper Reed’s Blog, 26 March, 2024\n↩︎\n\nPoem/1: AI rhyming clock by Matt Webb — Kickstarter\n(\narchive.is\n), That Matt Webb, Kickstarter, 29 February, 2024\n↩︎\n\nMy new job is AI sommelier and I detect the bouquet of progress (Interconnected)\n(\narchive.is\n), That Matt Webb, Interconnected.org, 3 March, 2023\n↩︎\n\nI would describe this just as “a load-bearing just”\n↩︎\n\ns16e18: Generative People Personalities; Content Distribution Networks (Taylor's Version)\n(\narchive.is\n), me, this newsletter, 27 October, 2023\n↩︎\n\nCARROT Weather for iOS and Android\n(\narchive.is\n)\n↩︎","raw_format":"markdown","source":"api","summary":"This issue explores the strategic thinking behind modernization efforts, arguing that the real work isn't choosing new technology but clarifying what problem you're actually trying to solve and why it matters to decision-makers—a distinction the author illustrates through a workshop where participants discovered that adaptive capacity for future crises, not mere system age, was their true goal. The second piece celebrates how large language models display genuine playfulness in their outputs, a quality the author finds surprisingly delightful and worth taking seriously rather than dismissing as glitches or anthropomorphization.","reading_minutes":18,"links":[{"url":"https://www.verylittlegravitas.com/hallwaytrack","normalized_url":"https://verylittlegravitas.com/hallwaytrack","domain":"verylittlegravitas.com","anchor_text":"Hallway Track","is_archive":0,"archive_url":null,"archive_service":null,"category":"self"},{"url":"https://www.verylittlegravitas.com/pulling-the-cord","normalized_url":"https://verylittlegravitas.com/pulling-the-cord","domain":"verylittlegravitas.com","anchor_text":"Pulling the Cord","is_archive":0,"archive_url":null,"archive_service":null,"category":"self"},{"url":"https://buy.stripe.com/fZe28qbFOazZ4M04gh","normalized_url":"https://buy.stripe.com/fZe28qbFOazZ4M04gh","domain":"stripe.com","anchor_text":"$25/month, or $270/year","is_archive":0,"archive_url":null,"archive_service":null,"category":"plumbing"},{"url":"https://buy.stripe.com/cN200i8tCgYn4M0eUW","normalized_url":"https://buy.stripe.com/cN200i8tCgYn4M0eUW","domain":"stripe.com","anchor_text":"$35/month, or $380/year","is_archive":0,"archive_url":null,"archive_service":null,"category":"plumbing"},{"url":"https://buy.stripe.com/bIYcN4cJSgYnbao9AD","normalized_url":"https://buy.stripe.com/bIYcN4cJSgYnbao9AD","domain":"stripe.com","anchor_text":"$50/month, or $500/year","is_archive":0,"archive_url":null,"archive_service":null,"category":"plumbing"},{"url":"https://store.verylittlegravitas.com/l/ThingsVol1","normalized_url":"https://store.verylittlegravitas.com/l/ThingsVol1","domain":"verylittlegravitas.com","anchor_text":"Things That Caught My Attention, Volume 1","is_archive":0,"archive_url":null,"archive_service":null,"category":"self"},{"url":"https://verylittlegravitas.gumroad.com/l/ThingsVol1/subscriber","normalized_url":"https://verylittlegravitas.gumroad.com/l/ThingsVol1/subscriber","domain":"gumroad.com","anchor_text":"free subscribers get a 20% discount","is_archive":0,"archive_url":null,"archive_service":null,"category":"self"},{"url":"https://harper.blog/2024/03/26/our-office-avatar-pt-1-the-office-is-talking-shit-again/","normalized_url":"https://harper.blog/2024/03/26/our-office-avatar-pt-1-the-office-is-talking-shit-again","domain":"harper.blog","anchor_text":"Our Office Avatar pt 1: The office is talking shit again | Harper Reed's Blog","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"http://archive.is/latest/https://harper.blog/2024/03/26/our-office-avatar-pt-1-the-office-is-talking-shit-again/","normalized_url":"https://harper.blog/2024/03/26/our-office-avatar-pt-1-the-office-is-talking-shit-again","domain":"harper.blog","anchor_text":"archive.is","is_archive":1,"archive_url":"http://archive.is/latest/https://harper.blog/2024/03/26/our-office-avatar-pt-1-the-office-is-talking-shit-again/","archive_service":"archive.is","category":"external"},{"url":"https://www.kickstarter.com/projects/genmon/poem-1-the-ai-poetry-clock","normalized_url":"https://kickstarter.com/projects/genmon/poem-1-the-ai-poetry-clock","domain":"kickstarter.com","anchor_text":"Poem/1: AI rhyming clock by Matt Webb — Kickstarter","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"http://archive.is/latest/https://www.kickstarter.com/projects/genmon/poem-1-the-ai-poetry-clock","normalized_url":"https://kickstarter.com/projects/genmon/poem-1-the-ai-poetry-clock","domain":"kickstarter.com","anchor_text":"archive.is","is_archive":1,"archive_url":"http://archive.is/latest/https://www.kickstarter.com/projects/genmon/poem-1-the-ai-poetry-clock","archive_service":"archive.is","category":"external"},{"url":"https://interconnected.org/home/2023/03/22/tuning","normalized_url":"https://interconnected.org/home/2023/03/22/tuning","domain":"interconnected.org","anchor_text":"My new job is AI sommelier and I detect the bouquet of progress (Interconnected)","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"http://archive.is/latest/https://interconnected.org/home/2023/03/22/tuning","normalized_url":"https://interconnected.org/home/2023/03/22/tuning","domain":"interconnected.org","anchor_text":"archive.is","is_archive":1,"archive_url":"http://archive.is/latest/https://interconnected.org/home/2023/03/22/tuning","archive_service":"archive.is","category":"external"},{"url":"https://newsletter.danhon.com/archive/s16e18-generative-people-personalities-content/","normalized_url":"https://newsletter.danhon.com/archive/s16e18-generative-people-personalities-content","domain":"danhon.com","anchor_text":"s16e18: Generative People Personalities; Content Distribution Networks (Taylor's Version)","is_archive":0,"archive_url":null,"archive_service":null,"category":"self"},{"url":"http://archive.is/latest/https://newsletter.danhon.com/archive/s16e18-generative-people-personalities-content/","normalized_url":"https://newsletter.danhon.com/archive/s16e18-generative-people-personalities-content","domain":"danhon.com","anchor_text":"archive.is","is_archive":1,"archive_url":"http://archive.is/latest/https://newsletter.danhon.com/archive/s16e18-generative-people-personalities-content/","archive_service":"archive.is","category":"self"},{"url":"https://www.meetcarrot.com/weather/","normalized_url":"https://meetcarrot.com/weather","domain":"meetcarrot.com","anchor_text":"CARROT Weather for iOS and Android","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"http://archive.is/latest/https://www.meetcarrot.com/weather/","normalized_url":"https://meetcarrot.com/weather","domain":"meetcarrot.com","anchor_text":"archive.is","is_archive":1,"archive_url":"http://archive.is/latest/https://www.meetcarrot.com/weather/","archive_service":"archive.is","category":"external"}],"sections":[{"id":4302,"ord":0,"number":"0.0","heading":"Context Setting","level":1,"word_count":90},{"id":4303,"ord":1,"number":"0.1","heading":"Events: Hallway Track, and Pulling the Cord","level":2,"word_count":67},{"id":4304,"ord":2,"number":"1.0","heading":"Some Things That Caught My Attention","level":1,"word_count":12},{"id":4305,"ord":3,"number":"1.1","heading":"What are we doing here exactly?","level":2,"word_count":1139},{"id":4306,"ord":4,"number":"1.2","heading":"LLMs are Playful, Actually","level":2,"word_count":2029},{"id":4307,"ord":5,"number":null,"heading":"How you can support Things That Caught My Attention","level":2,"word_count":35},{"id":4308,"ord":6,"number":null,"heading":"Let my boss pay!","level":3,"word_count":176}]}