Will I look dumb if...?

ahahah nooo thats prefectly fine especially if he sees you taking off the jacket, however you could wear a scarf ( not the warm kind) or a cardigan if you want to look a little more wintery