He does keep them as he used them against Sylar at Mohinder's apartment.
DAMN... can't reveal something without spoiling it for others as I have no idea where the series is on BBC....
This should warn anyone off...
Spoiler: You find out Peter keeps them when he is being trained by Claude... he is able to use various powers without anyone else being around therefore he retains them.
xx