The Questions · the second mind · Controlism
What’s everybody actually frightened of?
Strip the argument of its benchmarks and its timelines and something older is underneath it — a fear that has nothing to do with how well the thing performs.
Not a benchmark. The possibility that there is somebody in there — or that there isn’t and we won’t be able to tell.
It’s a claim about the reach, and it’s an old reach. Anybody can make an object. Making a being — something with an inside that reaches back at the world on its own account — was always the other thing.
What this settles
So the panic is not about capability at all, which is why more capability never settles it. What is being reached for is not a better object. It is the line between making a thing and making a someone, and the fear survives every benchmark because no benchmark was ever measuring it.
Not this question
Have we crossed the line?
Also in this footing, and a different question. That one answers: we built a mind, not a self. This one asks what the crossing would have meant to us if we had.
Also asked as
- Is that a claim about what the builders intend, or about what the thing is?
Where this is worked out
What Is the Second Mind Doing to the First?
Items without a link are sessions, shorts, strand reads or frameworks that live as video or audio rather than as pages. Everything Philosophy Zero puts out is listed on the Shelf.
Nothing on this page is composed. Every sentence in the answer is drawn from the pieces listed above. Where a claim is compressed, it is compressed from one of them and adds nothing they do not say.
The second mind
What was actually built, what it is doing to the first mind, and the tell that the warning sign and the value proposition are the same sensation. 3 of the 5 here have been worked through; the rest are on the map and not yet walked.
- Have we crossed the line?walked
- Isn’t it good that it helps me think things through?walked
- Does AI make you smarter?answered, not written up
- What is the second mind doing to the first?answered, not written up