Mixed symbolic representations for model checking software programs