His lack of memory could be explained as 'you had a really bad injury while you were deployed in Iraq/some modern conflict' Hydra just finds ways to explain his weird memories that don't make sense. Like 'yeah you used to be pretty sick when you were younger but then you bulked up'