Scalable communication protocols for dynamic sparse data exchange