Store family lists more efficiently

Looking at the analysis, our storage for family lists accounted for 1.3MB out of 24.9MB total allocation. That's around 5% of our total allocation, not counting malloc overhead.

Fortunately, this will be pretty easy to fix.