Tag Archives: computing

Wisdom of the crowds, or lowest common denominator?

I liked this:

People have too inflated sense of what it means to “ask an AI” about something. The AI are language models trained basically by imitation on data from human labelers. Instead of the mysticism of “asking an AI”, think of it more as “asking the average data labeler” on the internet.

But roughly speaking (and today), you’re not asking some magical AI. You’re asking a human data labeler. Whose average essence was lossily distilled into statistical token tumblers that are LLMs. This can still be super useful of course. Post triggered by someone suggesting we ask an AI how to run the government etc. TLDR you’re not asking an AI, you’re asking some mashup spirit of its average data labeler.

Andrej Karpathy

Thanks to Simon Willison for the link.

Future Imperfect

As someone who has watched a few Star Trek episodes recently… well, OK, I admit it… a few dozen Star Trek episodes recently, I must express my concern about the quality of hardware engineers employed in the construction of Federation starships.

Why is it, that after several generations, they still build ships with computer consoles that explode at the slightest hint of enemy phaser fire? Perhaps Samsung had a watertight long-term supplier contract and the Federation couldn’t get out of it, but still, it does seem like a serious design flaw, especially on the bridge.

If you search the web, of course, you’ll find that I’m not the only person to have noticed this, indeed, there are many long discussions which might provide an answer if you’re a bit more interested than I was. If you’re considering a career as a Starfleet officer, however, it might be worth your while doing some more extensive research.

Perhaps the consoles are more robust than they might appear, though. Others have pointed out that a surprising number of them do seem to keep working after having exploded.

So the basic underlying manufacturing is sound. Like so many computer consoles, though, more work is needed to improve the user experience.

Preparing for the cybercrime of the future

My friend Frank helped organise what looked like a great event at the Computer Lab recently – called Cambridge2Cambridge, it’s a joint initiative between us and MIT, and they’ve done a splendid video about it.

More information here.

© Copyright Quentin Stafford-Fraser