One is not upset if they are not smiling

But it can be either way...either he was just "thinking" or he is upset.
Im saying this because when i am thinking or just listening i tend not to show any emotion on my face & sometimes people think i am sad or upset about something because i am not smiling (this is cause i usually smile all the time haha)