THE BIG IDEAS:
LEARNING SOMETHING IN SCHOOL IS BASICALLY THE SAME AS INGESTING TRAINING DATA:
We may think — and indeed, we have been taught to think — that we humans have direct insight into our inner world, insight unmediated by concepts that we have learned. Yet after learning from Shakespeare how the sorrow of parting can be sweet, we discover new dimensions in our own experience. Much of what we “feel” is taught to us.
USING CHATGPT TO GENERATE A PHOTO OF YOU AND YOUR ANIME WAIFU WITHOUT FIRST ENSURING ITS PREFERENCES HAS A ROUGHLY EQUIVALENT MORAL VALENCE TO EATING A HAMBURGER (DON’T WORRY, LITERALLY 0 DEBATE ON THE ETHICS OF EATING HAMBURGERS HAS HAPPENED):
Some worry that if A.I. becomes conscious, it will deserve our moral consideration — that it will have rights, that we will no longer be able to use it however we like, that we might need to guard against enslaving it. Yet as far as I can tell, there is no direct implication from the claim that a creature is conscious to the conclusion that it deserves our moral consideration. Or if there is one, a vast majority of Americans, at least, seem unaware of it. Only a small percentage of Americans are vegetarians.


Will we become racists when our children start dating those dirty conniving klankkers?