![](/static/66c60d9f/assets/icons/icon-96x96.png)
![](https://fry.gs/pictrs/image/c6832070-8625-4688-b9e5-5d519541e092.png)
No need to clarify what you meant with the oligarchs theres barely any exaggeration there. Ghouls is quite accurate.
Considering the context of a worst case possible scenario (hostile takeover by an artificial superior) which honestly is indistinguishable from general end of the world doomerism prophecies but very alive in the circles of Sutskeva i believe safe ai consistent of the very low bar of
“humanity survives wile agi improves the standards of living worldwide” of course for this i am reading between the lines based on previously aquired information.
One could argue that If ASI is created the possibilities become very black and white:
-
ASI is indifferent about human beings and pursues its own goals, regardless of consequences for the human race. It could even find a way off the planet and just abandon us.
-
ASI is malaligned with humanity and we become but a. Resource, treating us no different then we have historically treated animals and plants.
-
ASI is aligned with humanity and it has the best intentions for our future.
For either scenario it would be impossible to calculate its intentions because by definition its more intelligent then all of us. Its possible that some things that we understand as moral may be immoral from a better informed perspective, and vice versa.
The scary thing is we wont be able to tell wether its malicious and pretending to be good. Or benevolent and trying to fix us. Would it respect consent if say a racist refuses therapy?
Of course we can just as likely hit a roadblock next week and the whole hype dies out for another 10 years.
If after 12 monty they actually comply then thats still a positive.
However i fear they may “fix” it with malicious compliance at 11 months and then the cycle repeats.
Instead what i think should happen is they should need to obtain “verified compliance” within a year. (Minus the time europe takes to check) and if the term expires the penalty goes up to eventually forced splitting up.