What does it mean when a guy calls you silly?

He is probably just joking around, which would mean he feels like he can be himself around you. This is a good thing!