I think you're absolutely right, but I'd frame it with one important difference:

"Some people" have overshadowed "most people" to become most people in the eyes of society simply because "most people" are quiet.