After a lot of testing I eventually installed the latest version (ferm 2.3-2) from the debian testing repository and after a
it is all working correctly.
Checking the ferm changelog there have been fixes for problems relating to systemd and ferm starting after other services.