Lessons from scraping at scale

Full write-up in progress — this is placeholder content for the redesign.