Not at all. I wear what is comfortable, even when I dress up, which doesn’t happen often.
When I was a child, I went to schools where we either had uniforms or had to wear dresses all year long. I couldn’t wear heels higher than an inch or inch and a half, due to issues with my feet and ankles. And I didn’t have the money to be fashionable anyway. I learned to disregard fashion in favor of what I wanted to wear early, and I still stick to it.