Of course, anything will go when you're a foreigner (the so-called "gaijin smash"). But I can definitely see them taking offense when a fellow Japanese person makes this mistake.