One of the few things those across the party divide generally agree on is that Britain’s asylum system is broken.