Does using raspbian and deleting the GUI have any effects?

[Jordandi]

Question more or less says it. I have heard that disabling the Raspbian GUI can increase speed or at least the amount of programs I can run at a time before it starts to lag. The controversy is whether deleting the GUI entirely whether from a preinstalled image or manually after installing it on the SD card has any speed affects besides just more space on the card. I am running the model B with a wireless adapter in a headless mode connected to a 2TB HDD. The projects I want to get all working together are as following:
Openvpn server
BitTorrent sync or other cloud/FTP remote access to HDD
DLNA/upnp server to stream media to mobile devices and various consoles
BitTorrent client
Maybe try to add Adblock to the VPN setup

I am also considering the project to turn it a portable FM station and also trying a pen testing suite I found, but probably will have a separate SD cards for those, and need to get a female jumper cable for the radio atenna

So, in summary should I delete the GUI permanently or no, and any guides you recommend?

[gkreidl]

If X, windows manager and Desktop don't run, they don't consume processor cycles. No need to remove them. And sometimes it may be much easier to use GUI programs to modify some settings etc.

[Jordandi]

If X, windows manager and Desktop don't run, they don't consume processor cycles. No need to remove them. And sometimes it may be much easier to use GUI programs to modify some settings etc.

Okay. Thank you. One problem I had was that the bar on the bottom was missing, and openbox errored out on me, so I disabled it, but now I have more problems so I'm going to start from scratch with a new image now.