Curious Canid

An LLM does not write code. It cobbles together bits and pieces of existing code. Some developers do that too, but the decent ones look at existing code to learn new principles and then apply them. An LLM can’t do that. If human developers have not already written code that solves your problem, an LLM cannot solve your problem.

The difference between a weak developer and an LLM is that the LLM can plagiarize from a much larger code base and do it much more quickly.

A lot of coding really is just rehashing existing solutions. LLMs could be useful for that, but a lot of what you get is going to contain errors. Worse yet, LLMs tend to “learn” how to cheat at their tasks. The code they generate often has lot of exception handling built in to hide the failures. That makes testing and debugging more difficult and time-consuming. And it gets really dangerous if you also rely on an LLM to generate your tests.

The software industry has already evolved to favor speed over quality. LLM generated code may be the next logical step. That does not make it a good one. Buggy software in many areas, such as banking and finance, can destroy lies. Buggy software in medical applications can kill people. It would be good if we could avoid that.

The claim is that the remote operators do not actually drive the cars. However, they do routinely “assist” the system, not just step in when there’s an emergency.

I saw an article recently, I should remember where, about how modern “tech” seems to be focused on how to insert a profit-taking element between two existing components of a system that already works just fine without it.

This would be more impressive if Waymos were fully self-driving. They aren’t. They depend on remote “navigators” to make many of their most critical decisions. Those “navigators” may or may not be directly controlling the car, but things do not work without them.

When we have automated cars that do not actually rely on human being we will have something to talk about.

It’s also worth noting that the human “navigators” are almost always poorly paid workers in third-world countries. The system will only scale if there are enough desperate poor people. Otherwise it quickly become too expensive.