Then add a security lock you can close from the inside.

Hang it at the top of the door so it can’t be used by children.

Or just discipline your children to not barge into occupied bathrooms.