The silence of the "good people" is how we got where we are now. It's absolutely their fault.
I'll be the first to admit that no small part of how this happened was mass media, social media, etc all worked together with the nazis to help them, but it doesn't change that so many people watched this stuff happen and just... pushed it aside in their minds.