Why are we allowed to call people skinny, but not fat?

It seems perfectly socially acceptable to call others “skinny” because we deem this to be a positive thing or compliment.