What is there in the mode of address?

The referee keeps calling me "Ma'am" on the recording (see my previous post).

"Ma'am" is usually the mode of address to a female stranger.

Referee Sirkin surely knew (1) my name; (2) my title - "counselor" or "counsel".

He even used the term "counselor" sometime down to the middle of our interaction in the recording.

Yet - surprise! - referee Sirkin has NEVER ONCE used this term "Ma'am" when addressing Ms. Gasparini.

Or - is it a surprise at all?