This is used to describe when an action you take triggers an onward problem, usually unforeseen and out of your control.
e.g. “Let’s not do that, because it may start hares running”, or
e.g. “By stopping free milk for the younger kids, the Principal really started a hare running, with parents camped outside the entrance, demonstrating for their children’s balanced diet.”