To add, the weight of the human isn’t much, but the weight of the chair; safety equipment for the human; the extra metal needed to make space for the human, the chair, and the safety equipment; the extra distance for equipment to steer/handle from the pilots seat as opposed to a distributed system all add up to sooooo much space and weight.

Also you can put fuel in the center (you usually don’t cuz a human is sitting there) and that changes so much about the mechanics of the wings and the control system capabilities. The limiting factor was humans, but the next limiting factor disappears with the humans in the form of limited distribution patterns of fuel weight/less room to shift fuel during flight phases for different manoeuvres