I think it'd be impossible for memories to remain dormant forever if they still existed. We'd have to lose everything, permanently, to eliminate the risk of resurfacing. Maybe transferring them to possibly be returned if we come back.