Some people can't leave work early just due to weather. The odd time it happens, I'm forgiving, life happens and I'd want that same courtesy extended to me. There are times I've been late to various things due to weather so I get it.

However, if you feel that reason is being abused than yes, charge your late fee!