Suffering risks
Suffering risks, known as s-risks for short, are future events with the potential capacity to produce a huge amount of suffering.[2] These events may generate more suffering than has ever existed on Earth, in the entirety of its existence.[3] Sources of possible s-risks include embodied artificial intelligence[4] and superintelligence,[2] as well as space colonization, which could potentially lead to "constant and catastrophic wars"[5] and an immense increase in wild animal suffering by introducing wild animals, who "generally lead short, miserable lives full of sometimes the most brutal suffering", to other planets, either intentionally, or inadvertently.[3]

Steven Umbrello, an AI ethics researcher has warned that biological computing may make system design more prone to s-risks.[6]
References
- Sotala, Kaj (June 14, 2018). "AI Alignment Podcast: Astronomical Future Suffering and Superintelligence with Kaj Sotala" (Interview). Interviewed by Lucas Perry. Future of Life Institute. Retrieved June 4, 2022.
- Sotala, Kaj; Gloor, Lukas (2017-12-27). "Superintelligence As a Cause or Cure For Risks of Astronomical Suffering". Informatica. 41 (4). ISSN 1854-3871.
- Kovic, Marko (2021-02-01). "Risks of space colonization". Futures. 126: 102638. doi:10.1016/j.futures.2020.102638. ISSN 0016-3287. S2CID 230597480.
- Umbrello, Steven; Sorgner, Stefan Lorenz (June 2019). "Nonconscious Cognitive Suffering: Considering Suffering Risks of Embodied Artificial Intelligence". Philosophies. 4 (2): 24. doi:10.3390/philosophies4020024.
- Torres, Phil (2018-06-01). "Space colonization and suffering risks: Reassessing the "maxipok rule"". Futures. 100: 74–85. doi:10.1016/j.futures.2018.04.008. ISSN 0016-3287. S2CID 149794325.
- Umbrello, Steven; Sorgner, Stefan Lorenz (2019-05-17). "Nonconscious Cognitive Suffering: Considering Suffering Risks of Embodied Artificial Intelligence". Philosophies. 4 (2): 24. doi:10.3390/philosophies4020024. ISSN 2409-9287.
Further reading
- Baumann, Tobias (2022). Avoiding the Worst: How to Prevent a Moral Catastrophe. ISBN 979-8359800037.
- Metzinger, Thomas (2021-02-19). "Artificial Suffering: An Argument for a Global Moratorium on Synthetic Phenomenology". Journal of Artificial Intelligence and Consciousness. 08: 43–66. doi:10.1142/S270507852150003X. ISSN 2705-0785.
- Minardi, Di (2020-10-15). "The grim fate that could be 'worse than extinction'". BBC Future. Retrieved 2021-02-11.
{{cite news}}
: CS1 maint: url-status (link) - Baumann, Tobias (2017). "S-risks: An introduction". Center for Reducing Suffering. Retrieved 2021-02-10.
{{cite web}}
: CS1 maint: url-status (link) - Althaus, David; Gloor, Lukas (2016-09-14). "Reducing Risks of Astronomical Suffering: A Neglected Priority". Center on Long-Term Risk. Retrieved 2021-02-10.
{{cite news}}
: CS1 maint: url-status (link)
See also
- AI control problem
- Ethics of artificial intelligence
- Ethics of terraforming
- Existential risk from artificial general intelligence
- Global catastrophic risk
- Suffering-focused ethics
- Wild animal suffering