I have nothing at all against the word 'casual' and its meaning. But it is not to be conflated with inappropriate attire, such as pajamas at work.