Lack of interest, a person’s disability and restrictions on their time have been highlighted as the main reasons why people in England