I experience this all the time!
Part of my cultural baggage that makes me different is my use of English. I never realised how many versions of 'English' there were! I speak Canadian English as my L1/mother tongue, however when in Scottish classrooms this can get me into trouble.
For example, in Canada, every type of container can be called a 'bin' - garbage bin, laundry bin, plastic bin, etc. However when I say to put something in a 'bin' in Scotland I am telling the children in my class to throw it out!
The other one that has given me issues is 'pants'. In Canada, pants are normal, casual wear, trousers are dressy clothes (like part of a suit), underwear is what you wear under your clothes, etc. In Scotland however this is not the case as 'pants' is what you wear under your 'trousers'. So if stressed or tired, etc and a child comes in having splashed in puddles I may say they wet their 'pants' instead of their 'trousers' thinking that the bottoms of their legs are wet... however the children don't like having a teacher say they had an accident and wet themselves!
There is a popular Canadian kids joke which, in Scotland, I would get in trouble for telling - "Q. Why do firefighters wear red suspenders? A. To hold their pants up" (FYI - Suspenders in Scotland are what we know in Canada as garters (they hold your stockings or socks up), in Scotland they are called braces!)
Oh, all the fun Canadianisms! There are so many, but these are the typical ones that come up over and over again!
Cultural Baggage is fun!