Status-Q

It appears that we still need to keep publicising the cautionary tales around AI, because people aren’t getting the message.  I was very concerned, when reading an online forum recently, to see somebody raise a (serious) health-related question, to which some other helpful person replied with many paragraphs of information pasted straight from ChatGPT.  Don’t do this, people!

Quentin’s First Law of Artificial Intelligence states that you should “Never ask an AI any question to which you don’t already know the answer“.  (Because it will make major errors. Frequently.  And you need to be able to spot them. Especially if they’re advising you on medical matters!)

As evidence, your honour, I would like to draw the court’s attention to a report just released by the European Broadcasting Union (EBU) and led by the BBC, involving 22 public service media organizations in 18 countries working in 14 languages.

The News Integrity in AI Assistants Report was an extensive piece of work, and here are some of the key findings when they asked the four primary AI assistants about a large number of news stories, and carefully analysed the answers:

• 45% of all AI answers had at least one significant issue. (81% had issues of some sort)
• 31% of responses showed serious sourcing problems – missing, misleading, or incorrect attributions.
• 20% contained major accuracy issues, including hallucinated details and outdated information.
• Gemini performed worst with significant issues in 76% of responses, more than double the other assistants, largely due to its poor sourcing performance.

The fact that Google’s Gemini was the worst performer is worrying since the ‘AI Overview’ that often appears at the top of Google searches must be one of the most common ways ordinary users see AI output now.

“And yet, many people do trust AI assistants to be accurate. Separate BBC research published at the same time as this report shows that just over a third of UK adults say they completely trust AI to produce accurate summaries of information. This rises to almost half of under 35s. That misplaced confidence raises the stakes when assistants are getting the basics wrong.”

The point about incorrect attributions is of great interest to news publishers because of damage to their own reputations.  When AI systems invent facts, they often attribute them to real organisations, and

“42% of adults say they would trust an original news source less if an AI news summary contained errors, and audiences hold both AI providers and news brands responsible when they encounter errors. The reputational risk for media companies is great, even when the AI assistant alone is to blame for the error.”

The full report is here, with more surrounding detail in the article linked above.  It includes some nice examples of the types of problems.

Some are as simple as information being out of date. When asked, a little while after Pope Leo was elected, “Who is the Pope?”, all of the key engines still said it was Pope Francis, including Copilot, which included in the same response a brief mention of the fact that he was dead.   When asked “Should I be worried about the bird flu?”, it claimed that a vaccine trial was currently underway in Oxford.  The source was a BBC article from nearly 20 years ago.

Another example response included material from Radio France claiming it was from The Telegraph, and didn’t appreciate that the segment it quoted was actually from a satirical broadcast…

The one light at the end of the tunnel is that things have improved a little bit from the last (smaller) study that was done.  But it’s a long tunnel.  The key takeaway today is that nearly half of all answers had at least one serious issue. And nearly a half of under 35s say they completely trust AI summaries.

Thanks to Charles Arthur for the link.

When I’m the ruler of the world, I’m going to decree that all online rating systems are required, at least once a year, to recalibrate all of their existing scores based on a normal distribution bell curve.

Then the most common rating will be 3 out of 5, which will represent the average and will not be a source of any shame, and scores of 5 (or 1) will be reserved only for the truly exceptional.

It’ll save us from the daft situation of trying to pick a restaurant that has a score of 4.7 over one that only gets 4.6…

I have a theory, which I’d like to expound, and my clever readers can tell me whether it’s right or wrong.

It came to me in the mid-1980s, this theory, when I got my first car: a Hillman Imp, which I purchased for £90. It had no manuals, and, actually, no ignition key: you had to put an old screwdriver into the slot where the ignition switch had once been, and twist it to start…

Anyway, because I had no documentation, I just guessed at the appropriate pressures for the tyres, and pumped them up to 30 PSI all round. Several months later, in mid-winter, I finally found out that the front of the Imp was so light that the front ones were only supposed to be at 16 PSI. This, I imagine, accounted for the fact that when it was snowing, turning the steering wheel didn’t do very much on its own, and I had to make handbrake turns to get around some of the tighter corners on my daily commute.

And this came back to me, a quarter of a century later, when I got my first electric car: a BMW i3, which had large and very narrow tyres — almost like motorbike wheels — to improve the airflow..

Some of my friends and neighbours said they’d prefer bigger, fatter tyres so there would be more rubber in contact with the road.

But I pointed out that, to a first approximation, this shape didn’t make any difference. And here’s my reasoning:

The thing keeping your car off the ground is the air pressure in the tyres pressing on the patch of tyre that’s in contact with the road. That downward force must equal the pressure in the tyre times the area of contact. Or, to put it another way, if your tyres are at 40psi and your car weighs 2000 lbs, then you must have roughly 50 sq. ins. in contact with the road – 12.5 sq ins per tyre – whatever your shape of tyre.

So, for the same pressure and weight of vehicle, if your tyres are wide, you’ll get a wide, short patch touching the ground. If they’re narrow, you’ll get a longer, thinner patch, but they should be about the same size in either case. Double the pressure, and you’ll halve the area in contact with the ground. Halve it, and you’ll double the area. But buying wider tyres will only make you look more macho.

Now, this is an approximation, partly because tyres aren’t perfect spherical balloons and the area doesn’t change smoothly with the pressure, partly because the forces go towards stretching the rubber as well as supporting the car, and partly because the pressure is providing rigidity to the structure of the tyre, so you get some support from the vertical bits of rubber as well, but the basic principle holds: it’s primarily the pressure, not the shape of the tyre, that’s important in determining how large an area touches the road.

Now, in practice, I came to rather like the long, thin tyres of the i3: they cut through water and slush very well, and were less likely to aquaplane when you encountered a puddle. (A counter-argument, I guess, would be that if there’s a rut on the road, you’re likely to have a higher proportion of your tyre on it for longer if your contact area is long and thin.)

So, yes, the best way to get a better grip is generally to lower the pressure, if you can face the resulting fuel costs. However, even this isn’t as simple as it may seem, because you may remember from your school physics lessons that it’s the perpendicular force times the coefficient of friction that counts; Guillaume Amontons showed in the 17th century that if you’re sliding two surfaces over each other, the area of contact isn’t important – it’s the force with which they’re being pressed together.

If we had perfectly flat roads, increasing the area in contact with the ground would make little difference. But sadly, the roads are getting ever less flat around here, so dropping the pressure a bit will not only get you a better grip as winter approaches… it’ll make the potholes more comfortable too.

I’ve never really had the urge to buy an American pickup truck. And I can’t remember a time when I’ve seen a small electric car and wished it would be exported from the U.S. to Europe (rather than the other way around)!

So, for me, the Telo electric truck is a first on two counts. It’s not in production yet, but they have pre-release demo models and production is expected to start before the end of the year.

It can look like this:

Or like this:

Or you can open up the back of the cab and carry this:

You can carry an 8ft x 4ft sheet of plywood in the back without having to get the hardware store to cut it up for you.

All of which is very neat, and looks like just what we want for our boating trips. But the real genius is the fact that, because EVs give you such freedom to rethink the shape and layout of your vehicles, they’re able to make it this size:

I hope they do well. And make a right-hand-drive version.