How can I stop my shaking voice?

When I open my voice, my voice very often shakes and sounds nervous. I am nervous because my voice sounds nervous so it is self-reinforcing. I find that if I breathe deeper, then it is less bad. It is really annoying. Would breathing exercises stop this? Strengthen the diaphragm during exhale?