Ted Chiang says AI is not conscious. The debate refuses to die.

Ted Chiang published a piece arguing AI is not conscious, and the HN thread predictably goes in circles. The more interesting signal is not the consciousness debate itself, but that this question keeps returning with increasing urgency as AI systems get more capable. The linked story about 'They're made out of weights' is a riff on the classic science fiction story about perception, and it's generating its own discussion about whether the analogy holds.

The pattern: as AI outputs become more sophisticated, the question of what is actually happening inside these systems stops being philosophy and starts being a product and policy question. Anthropic is building containment systems for Claude. Researchers are testing whether LLMs can hack software. Educators are watching students offload cognition to models. All of these debates are downstream of the unresolved question of what these systems actually are.

Chiang is a careful thinker and his argument is worth reading on its own terms. But the HN thread shows that even people who agree with his conclusion can't fully articulate why, which tells you how unresolved the foundational question is.