It seems that almost every idea which is great for development is horrible for production. 
With the help of this and another issue against rancher I was able to write a script that built a Rancher server and a Rancher host, with the host running Convoy. Still have not yet figured out how to properly mount devicemapper on Convoy, hoping another forum exchange will hold the secret.