It is because of the large number of unvaccinated people that the virus keeps on having opportunities to mutate into more virulent and deadly forms, which sooner or later will include one that the vaccines don't protect us from, at which point we'll be back to ground zero.
When German bombers were conducting nighttime raids, England enforced curfews and blackouts. Did their government have the right to tell people they couldn't drive around or keep their houses lighted up? Damn straight they did, because the safety of their cities was at stake.
If the ignoranuses were just endangering themselves, I'd say let them. We would obviously be better off without them.