Relevance is such a broad term that the criticism of being irrelevant could refer to many different kinds of failure or shortcoming in an argument.