The family of a killer who was found hanging in his cell at a prison near York seven years after stabbing to death his wife, two children and three other people believe he should have been in a psychiatric hospital rather than prison, an inquest has heard.