I'm not sure what happened...
If you have insufficient amount of badges and try to exchange it (or possibly try to exchange but cancel right after), it still consumes the badges. I did not buy anything, yet my badges were consumed from me.
Anyway I can get them back? I had about ~20