Hmm. I'm actually an outer borough kid -- northeast Queens, 30 minutes by bus past the Main Street stop of the 7. I don't refer to the lines by color (unless it's a simplification to explain things to tourists). On the other hand, I'm older, and will sometimes say/think things like "Lexington Avenue IRT" or something.