Actually having run into one of my high school teachers in a situation wherein she was wearing a bikini, it really is a remarkably awkward thing. Especially since the expected semi-formality of addressing them as “Miss So-and-so” clashes terribly with the “basically wearing underwear” part of the conversation.