If your power supply has a standard size USB socket, insert an unpowered USB hub (1.1 0r 2 is fine) and then insert power cable to it. This will now connect normally to the Pi. Get a USB powered speaker with separate 3.5mm jack. Insert the speaker USB into the hub and the jack into the Pi. Job done with minimum clutter.
I originally had the jack connected to my monitor, but it sounded like a strangled cat at the bottom of a well !!