Were in the bible does it say when evil people are stopped from doing evil the good rejoice?
I don't think there is any verse which says that. Here is what it made me think of though:
[Pro 29:2 NIV] 2 When the righteous thrive,
the people rejoice; when the wicked rule, the people groan.
[Pro 29:3 NIV] 3 A man who loves wisdom brings joy to his father, but a companion of prostitutes squanders his wealth.
[Pro 29:4 NIV] 4 By justice a king gives a country stability, but those who are greedy for bribes tear it down.
[Pro 29:5 NIV] 5 Those who flatter their neighbors are spreading nets for their feet.
[Pro 29:6 NIV] 6 Evildoers are snared by their own sin,
but the righteous shout for joy and are glad.
[Pro 29:7 NIV] 7 The righteous care about justice for the poor, but the wicked have no such concern.
[Pro 29:8 NIV] 8 Mockers stir up a city, but the wise turn away anger.
[Pro 29:9 NIV] 9 If a wise person goes to court with a fool, the fool rages and scoffs, and there is no peace.