If you say
that you are not
, you mean that you are not responsible for what they do or for what happens
'I don't know where he is,' Hughes replied. 'I'm not his keeper.'
COBUILD Advanced English Dictionary. Copyright © HarperCollins Publishers