I have, I'm fairly certain, some level of on the spectrum behavior in regards to reading tone of voice. I just can't do it for people I don't know really well. Instead over the years, I've trained myself to really pay attention and understand facial expressions and body language. So any time I have to be on the phone with someone I don't know very well, it cranks up my anxiety to max. People I've known for a long time are no problem. My wife, my kids, my parents, my brother, no problem.
The main reason I know it is specifically audio only is that for my work I do video conference meetings all the time and it never bothers me. Cause I can see people's faces. Like, I still get the base level of anxiety I get for anything social, but it isn't anything like being on a phone call.
I think the reason that it doesn't bother me with emails and text is that the playing field is leveled. Like, I can't read their emotion well, but they can't read mine either, so it never feels like as big of a deal.