The Hammers came from two goals down to draw 2-2 with Vincent Kompany’s men thanks to Danny Ings’ last-gasp strike.
But despite claiming a late point, Moyes felt his side did enough to pick up the victory.
“We didn’t start fast and we got punished. I think the second goal, conceding it just before half-time, was a real blow.
“We didn’t give ourselves a chance to get in the game. We missed a tackle but the boy [Fofana] scores a wonder goal and the other one is an own goal. They scored two goals which could have been stoppable, but they were strange goals to lose.
“But nevertheless, we fought incredibly hard to get back in the game and we probably created enough chances to win.”