Dame Maggie Smith, who stars as Dowager Countess of Grantham on the hit PBS series "Downton Abbey," will depart the program after its sixth season, according to Variety.