It is not easy to evaluate the listening comprehension ability of beginners in foreign language learning because they don’t have sufficient linguistic input data to be tested. In this study on the listening comprehension tests of DELE A1, A2, which are elementary level tests in Spanish as a foreign language, we intended to understand how to measure the communicative language ability of the low listening proficiency group. But in this research we not only took into account the positive aspects of the exam, but the inappropriate points with respect to the validity of the test, because both sides of the analysis results help us orient the guidelines for making questions in this kind of exam and for the teaching of listening comprehension skills. For a qualitative analysis we counted on six elements that make up the form and contents of the test: question presentation (before-question vs. after-question) and relation between the listening text and questions (one question for a text or multi-questions for a text), genre of listening text, types of listening(intensive, responsive, selective, extensive listening), the necessary skills for resolving the questions, linguistic ability like vocabulary and grammar, and background knowledge.