Load-balancing and caching for collection selection architectures