Towards Lightweight and Robust Large Scale Emergent Knowledge Processing