They are being polite - they assume you don’t actually know Japanese. I went decades ago, with very little Japanese, and discovered that if I attempted to speak Japanese first, it allowed them to speak English without losing face. Sounds like that hasn’t changed ;)
Comments
Honestly, sometimes I'm not even sure it's conscious. Some people are so startled to deal with a non-Japanese face that they don't fully process the interaction they're in.