AI is a classic case of Gell-Man amnesia

and not just too many words, but first complaining about meaningless repetition and then immediately says hey just repeat these words exactly

i like to imagine it says

we don’t use this, but if you delete it everything in this file breaks

and not only that. in your example of choosing to address the hull first over the engine, the engine problem is actually prescient. when taking time to debate about AGI, it is to debate a hypothetical future problem over real current problems that actually exist and aren’t getting enough attention to be resolved. and if we can’t address those, why do we think we’ll be able to figure out the problems of AGI?

guess they forgot the “don’t make any mistakes” at the end of the prompt