

3·
2 months agoIsn’t it pretty clear that human intelligence isn’t only high-dimensional statistical modelling by showing how even small children have “context windows” vastly surpassing even the most advanced and resource intensive models, and their brains only take a few snacks every few hours to power?
Is it not an apt analogue to describe the behavior, though? After all, one well known failure mode of LLMs has been formally dubbed “hallucination”.