The wipes dont' really work anymore and Bucky just pretends that he's all dumbed down asset. Consequently over time he's progressively recovering memories as he emerges from cryo for each mission. He's going through all of the things he would be going through in recovery (ideally) but pre CATWS. He's just having to hide it, play dead eyed assassin, and bide his time.
Meanwhile he's carefully trying to orchestrate rape so that it's only one person who rapes him. Maybe he tries to appeal (non verbally, still pretending to be dumbed down/brainwashed asset) to one particular agent for a 'protection' type of relationship, where that person is the only one who gets to fuck him. Could be Rumlow, could be someone else. They may or may not realize there's more to the asset than what most people notice but since it works to their advantage and Bucky pleases them in every way he can think of, they don't mention it to anyone.
Just not Pierce because honestly I'm tired of Pierce's old ass.

You can do recovery trash too if you like. Bucky trying not to fawn to Steve but he's so used to it by now that it comes out sometimes. Bucky kneeling at Steve's feet and nuzzling his way into Steve's lap in front of Avengers.