To configure your Chatbox, go to Config → Helpdesk → Chatbox:

From the drop-down menu, select a sound for new messages in the chatbox. Click the play button to preview the selected sound. When it's done, click Save.

For more information, please read Chatbox notifications