打草驚蛇（だそうきょうだ）

Japanese vocabulary

Meaning: prodding the unknown may bring about unnecessary trouble; brushing a patch of grass may startle a snake

See it used in real works