"The people at CBS who have manipulated and handled this are going to be embarrassed,” the former 'Late Show' host says.