Female led relationships discussion

Greetings CM! I hold the key to a submissive man in our polyamorous setup. His other partners aren’t particularly kinky and prefer not to have him locked up during their dates. I’m struggling to balance my Domme/keyholder lifestyle with his time being unlocked several days each week. Has anyone else managed this equilibrium? What strategies worked for your households?