To put it very simplyโweโre going to be living among digital minds of all shapes and sizes. So how do you determine who gets a vote? How do you deal with the fact that to reproduce, it takes a human 9 months to make 1 copy of itself, while it takes a digital mind 1 second to make 100,000 copies of itself? Can we have a democracy when the AI population grows to 300 ๐ก๐๐๐๐๐๐๐ while the human population stagnates at 300 ๐๐๐๐๐๐๐?
Moreover, how do you deal with 10000x intelligence differences? We donโt give frogs a vote over human affairs; are we supposed to give 100 IQ beings a vote when it affects those with 1000 IQโs? What if a single mind ends up with 99% of the intelligence/compute (which seems likely)?
Above all, everyone is failing to think about the downstream consequences of this new world we are entering and just how weird and different itโll be.