Arithmetic optimization for custom instruction set synthesis