I know this has been mentioned before, but I'm going to be bothered until I bring it up again.
It should be possible to search, but with all follows filtered out.
You can already do the reverse, and search only within the followed list.
Surely you could just invert the filter?