Layered memory decides what the agent recalls now, this session, and forever. Getting the layers wrong shows up as forgetfulness or as context windows blown on stale detail.