31
Jan

In Praise Of Self-Hosting

One little trend that gives me hope in these times is that a lot of people are starting their own websites. People are trying to return to a time when the internet was more personal, and everything wasn't centralized and aggregated on the same 3-4 platforms. People are starting webrings (please invite me to your webring). People are even trying to bring RSS back!

I tend to have mixed feelings about looking back at early eras of the web with too much nostalgia. Among a certain set it's become popular to yearn for the return of web 1.0, but

Read more
3 min read
30
Jan

Some Things I Believe

I spent a while today working on adding animations to a Jupyter notebook in anticipation of writing a follow-up to yesterday's post, but in a self-own I will never stop repeating I forgot to push them to git and I don't want to spend another two hours rewriting the same code. I'll write that up eventually, but for today, I have been thinking a lot about what people believe and why they believe it. Obviously, the various ghouls and goblins currently in control of America are a big factor in that, as are their feckless opposition who appear to believe

Read more
4 min read
29
Jan

Programmatically Creating Styled Cells In Jupyter Notebooks

I've been playing around with the idea of using Jupyter notebooks as a narrative game interface for a while, and finally got around to doing some prototyping this week. One thing I really wanted to do was require users to run code cells in Jupyter to unlock story beats: Jupyter notebooks are usually presented as a step-by-step tutorial, which is perfectly fine if you're trying to teach someone how to run a linear regression in sklearn but less so if you're trying to build suspense over the course of a story.

It's pretty easy to get output from just running

Read more
3 min read
28
Jan

The Future Is Too Easy

It is rich cynics trying to make something lifeless grow in the way that living things do, and lock the dying present they rule in for the foreseeable future by effectively removing everyone from it but them. They are impatient not just because they are high-handed and avaricious, but because they know that the only future they can rule in the way they want is one that is passive, stupid, small and shrinking.

David Roth, excellent as always, on CES in Defector. I do think it's easy to get myopic about AI as someone who exists mostly in the spaces it does have genuine utility in (programming, games, and digital art) and thus is something to fear. This stuff is still mostly useless in practice! Roth also raises a point I think isn't made enough (because I have made it a bunch and no one listens to me). Most of the run-of-the-mill uses of AI as it is currently are the various and sundry tedium of life in late capitalism, things we shouldn't have to do in the first place: filling out forms, writing cover letters, desperately trying to get someone to fix your medical bills.

A point Roth doesn't make, but one I think ties into the quote above, is that by putting their own offal into the well of data they're drawing from, AI companies are effectively freezing usable data at around the year 2023. So much of the internet is already generated slop, and it's so difficult to actually determine which data is usable, that bot-free datasets can't stay up to date. The rich are freezing AI's knowledge of the world at the dying present, functionally preventing its growing from the same means it was created. I gave a somewhat tongue-in-cheek talk about this last year, and while I'm not sure how well some of the points I made there will hold up, I do think this is something to watch. Synthetic data and curated datasets may be a way out of this hole, and maybe the slop will get good enough that it can train on its own output (model distillation is a big thing right now) but I can't help but question how far that can take us. How useful is an LLM that can't grow at the pace human culture does? What will come of them endlessly consuming their output? Or will the proliferation of LLMs prevent us from growing at all?