Should Men Take Hats Off at the Dinner Table? [POLL]

It's pretty much accepted these days for men/boys to leave their hats and caps on at the dinner table. I know some older people though that find this to be a bit disrespectful. However, I know some older folks who do it themselves and I know some younger folks who are "throwbacks", so to speak, and insist on there removal at the table. So what do you think?