@MacFinch
出す originally means “to produce something (out of nothing)” “to release”. By extension of that, it has come to mean “to start” something, but with a nuance of something happening abruptly and regardless of the speaker’s will.
始める doesn’t have those nuances. It simply means “to start” something.
I think that a widow suddenly bursting with tears at a funeral is good example expressing both abruptness and uncontrollably. 出す is also often emphasized with expressions like どっと or 突然 (suddenly).
Because generally verb[stem] + 出す verb is “beyond” will of humans, that is cannot be controlled, it usually feels unnatural to ask someone to do verb[stem] + 出す action, while it is ok to ask the same with 始める, in other words the 始める action can be controlled. Also, commands don’t work well with 出す. It’s hard to ask someone to laugh, and even harder to order him to do so (in normal circumstances ). Because of this nuance 笑い出す is much more common than 笑い始める. Laugh is (usually) beyond our will and abrupt.
Example:
話し出してください Please, start speaking. <— natural
話し出してください <— less natural
Of course, the choice in the end (between 出す and 始める) belongs to the way how the speaker sees the situation.
I hope it helps,
Cheers