Stephen Colbert joked that the president "is really dragging down broadcast television" with lower ratings for Tuesday's State of the Union than last year's address.