I think Pikrellcam uses broadcast mode over the network.
By using a circular buffer you can get pre trigger events, but I don't think that is what you want.
If you use Linux then NC (netcat) works on Pi's, you don't need a full client/server app.
This could get as simple as a single line in shell script.
For faster response, some way to keep a socket open all the time?
I have done simple modbus on TCP/IP.
Using lower levels like this and telnet means it is not as secure as higher HTTP etc which use SSH/SSL.
Not as secure generally means faster
Latencies can be much lower than 100ms if you can figure out the Windows side of it, which may be the biggest issue.
Older version of Windows were less secure, ie easier to hack up things like this.
The simple ping test will give you an idea of possible speeds.
A version of ping that does something?
You don't even need 64 bytes but watch out for the "ping of death"
Perhaps start with Netcat?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges