When Does An Unfollow Need To Become A Block?

In optimising my stream, I’ve found that the comfort network size for me is to follow somewhere between three to five hundred people. Above that number and I feel that there’s too much going on, and everything moves a little too fast, which means I end up filtering out people and following lists or groups, which means I probably shouldn’t be following the excluded people at all.