This study of 87 Saudi female university students aimed to discover whether they experience difficulties learning to listen to spoken English. Acknowledging that listening is an important part not just of learning a new language but also of day-to-day communication, data was collected using an online questionnaire. Participants were asked to respond to a series of statements designed to test four constructs relating to their attitudes to learning English language skills in general (a); learning listening skills specifically (b); their attitudes towards listening activities (c); and (d) their attitudes towards improving their listening skills. The results showed that most of participants felt that speaking and listening were the most important skills to learn, but listening was also the most challenging. Reading was felt to be the most effortless skill to learn, as well as the most commonly used, suggesting that frequency of use contributes to students' perceptions of the ease of learning a skill. Participants' difficulties with learning to listen to English were associated with speech rate, pronunciation, nervousness, limited vocabulary, and lack of background information. However, students also expressed positive attitudes towards improving their listening skills. Understanding students' attitudes to listening skills and their problems with listening may help teachers improve the way they teach these skills. This may in turn improve students' listening comprehension not only in universities but also in schools.