Stress
Bad advice. That's the downside. Give it, and you're dead. And one client tells two others who tell two others and the next thing you know, you're next to the wide receiver washing windows. That faith that was placed in you may be snatched away just as quickly, and you may make some enemies.
The key to being in the game a long time is just to research and be on top of the market as much as possible so that you can rest assured that you did your due diligence and advised your clients to the best of your abilities. Although, even we know that buying 5,000 shares of HotNewCraze.com is just plain foolish.