Ivanliuks t1_irt83i8 wrote on October 10, 2022 at 9:21 PM

I think this post exposes a weakness in the common definition of consciousness as "awareness of oneself" and other variations of that definition. Is conscious experience necessarily tied to having awareness? And is awareness necessarily needed for an ASI to perform the feats of the singularity?

I agree with what OP used as a definition in another comment, consciousness defined as the capacity to experience. Under this definition, there's really no reason to assume that a super intelligent AI would need to be conscious. There is nothing explicitly telling us that conscious EXPERIENCE is a necessity towards intelligence

ftc1234 t1_irtkd52 wrote on October 10, 2022 at 10:53 PM

Experience is a necessity for intelligence. All AIs are trained with real world data which is an experience of reality.

red75prime t1_irtqydo wrote on October 10, 2022 at 11:45 PM

Data is a necessity for intelligence. Whether that data feels like anything (that is becomes experience) probably depends on the way that data is processed. Blindsight is an example in humans. Disruption of visual processing circuits causes visual data to not create experience, while it still influences behavior.