You have every right to dress easily in your own house - but don't be a schlub either.
Wherever you being in the organizational structure or hierarchy you can impact organizational culture in a positive (or unfavorable - however why would you wish to do that?) method.