I needed to run
/etc/init.d/server zap
one the service died. Otherwise it gives you a warning that a program is already running with start and with stop it says it can not properly shut it down.
My problem with this is that I can not tell where the warning comes from. Not from the script. openrc is doing something before even the first line in the script is read.