Stress
Although the job of an audiologist isn't a particularly stressful one—you're not normally swinging from rooftop to rooftop with your bag of diagnostic tools, saving Spider-man or Batman from impacted ear wax—you'll work with emotional people.
Some people are born with hearing loss and they're used to it. Not that it's fun or something they'd choose, but they've grown accustomed to it. But when you're working with people who've suffered some sort of hearing disability due to an illness, aging, or even one single exposure to a loud noise (such as a bomb or a Beastie Boys concert), there will probably be some tension, emotion, and fear. That's where you'll need to be part audiology doctor and part therapist.