Closing the loop in scene interpretation