When a guy says "i'm not that little..." ?

It depends on whether you want to stroke his ego or not? You could be like "well, I think we BOTH know that." or "Ehh, I've seen better lately."