The More Complex the Less Success in Online Library Services: Evaluating the User Experience for International Students
Abstract
Website developers are in charge of creating usable, useful and satisfactory products for their target audiences. Library websites are a crucial asset to the students, faculty, and staff at the colleges. User experience and usability testing play a significant role in the successful delivery of services and user satisfaction of libraries’ online services.
The goal of this research study was to determine the issues with the one of the Midwestern college’s library website and to come up with the design recommendations to enhance services for not only for the college but also all online library service developers.
This study uses a mixed method to collect quantitative and qualitative data, to make the evaluation more reliable and evaluates three dimensions of User Experience (UX) which include effectiveness, efficiency, and user satisfaction. The data were collected through multiple phases including demographics of participants, pre-defined task test, subjective satisfaction survey, and a semi-structured interview.
The research results indicate that the complexity in design increases the task completion time and leads users to quit. Additionally, advanced search capability increases the success of the library’s online services. The results would be of great importance to the library web developers to create user-friendly services that provide more benefits to the students as well as the academic community.
DOI:10.2458/azu_itet_v6i2_demir
Keywords
References
Alroobaea, R. & Mayhew, P. J. (2014). How many participants are really enough for usability studies? Science and Information Conference (SAI), London, UK.
Barisic, A. (2017). Framework support for usability evaluation of domain-specific languages. In Proceedings Companion of the 2017 ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity (SPLASH Companion 2017). ACM, New York, NY, USA, 16-18.
Barnum, C., Bevan, N., Cockton, G., Nielsen, J., Spool, J. & Wixon, D. (2003). The “Magic Number 5â€: Is It Enough for Web Testing? In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 698-699. DOI=http://dx.doi.org/10.1145/765891.765936
Chanling, F. & Hung, M. (2016). Usability and evaluation of a library mobile website. The Electronic Library, 34(4), 636-650.
Clark, M., De Leon, E. Edgar, L. & Perrin, J. (2012). Library Usability: Tools for Usability Testing in the Library, Retrieved from http://www.txla.org/sites/tla/files/conference/handouts/448cLibraryUsabilityTools.pdf
Demir, F. (2011). Technology use in community policing: Usability evaluation by eye tracking method. Germany: Lambert Academic Publishing.
Jabli, N., Alghamdi, H., Demir, F. (2018). The usability of King Khalid University website: Assessing efficiency, effectiveness, and user satisfaction. International Journal of Arts, Humanities and Social Sciences, 3(7), 10-16.
Demir, F., Ahmad, S., Calyam, P., Jiang, D., Huang R. &Jahnke, J. (2017). A next-generation augmented reality platform for mass casualty incidents (MCI). Journal of Usability Studies, 12(4), 193-214.
Demir, F., Karakaya, M., &Tosun, H. (2012). Research methods in usability and interaction design: Evaluations and case studies (2nd ed.). Germany: Lambert Academic Publishing.
Ghinea, G. & Chen, S. (2006) Digital Multimedia Perception and Design. Hershey, PA: Idea Group Publishing.
Hashim, K.F., Tan, F.B. & Rashid, A. (2015). Adult learner’s intention to adopt mobile learning: a motivational perspective. British Journal of Educational Technology, 46(2), 381-390.
Jeng, J. (2005). Usability Assessment of Academic Digital Libraries: Effectiveness, Efficiency, Satisfaction, and Learnability. Libri., 55. 92-96.
King, D. (2003). The Mom-and-Pop Shop Approach to Usability Studies. Computers in Libraries, 23(1), 13-29.
Lah, U., & Lewis, J. R. (2016). How expertise affects a digital-rights-management-sharing application’s usability. IEEE Software, 33(3), 76–82. https://doi.org/10.1109/MS.2015.104
Liu, Y.Q., & Briggs, S., (2015). A library in the palm of your hand: mobile services in top 100 university libraries. Information Technology and Libraries, 34(2), 133-146.
Matthew M, Gilok C., and Lindsay C. (2012). Comparison of three digital library interfaces: open library, Google books, and Hathi Trust. In Proceedings of the 12th ACM/IEEE-CS joint conference on Digital Libraries (JCDL '12). ACM, New York, NY, USA, 367-368.
Mikkelsen, S. & Davidson, S. (2011). Inside the iPod, outside the classroom. Reference Services Review, 39(1), 66-80.
Nielsen, J. (1993). Usability engineering. San Diego, CA: Academic Press.
Nielsen, J. (2012). How Many Test Users in a Usability Study? Retrieved from https://www.nngroup.com/articles/how-many-test-users/
Peterson, A. (2007). Usability Theory, Practice and Evaluation for Learning Objects. In Koohang and Harman (Eds.). Koohang, A. & Harman, K. Learning Objects: Theory, Praxis, Issues, and Trends. Santa Rosa, (p.337-370). California: Informing Science Press.
Porat, L. (2016). User Feedback as a Management Tool in Academic Libraries: a review performance. Measurement and Metrics, 17(3), 214 – 223.
Reese, H., Y., F., Dickson, K. W., Eddie, H. T., Kewin, K. W. & Patrick, L. (2016). Heuristic usability evaluation of university of Hong Kong libraries’ mobile website. The Journal of Academic Librarianship, 42, 581-594.
Sauro, J. & Lewis, J. (2016). Quantifying the user experience: Practical statistics for user research. Amsterdam; Waltham, MA: Elsevier/Morgan Kaufmann.
Shumova, V. (2017). The role of usability evaluation in the process of media management. In Focus: Helsinki Library Website (HELMET). Helsinki. Thesis. Retrieved from https://www.theseus.fi/bitstream/handle/10024/136094/Shumova_Varvara.pdf?sequence=1
Silva, M. & Wijayaratne, I. (2015). Usability evaluation of University of Colombo library website: A case study. Annals of Library and Information Studies, 62, 40-47.
Stone D., Jarrett, C., Woodroffe M. & Minocha S. (2005). User Interface Design and Evaluation. The Morgan Kaufmann Series in Interactive Technologies.
VandeCreek, L. M. (2005). Usability analysis of Northern Illinois University library’s website: a case study. OCLC Systems & Services, 21(3). 181-192.
Warwick, C., Rimmer, J., Blandford, A., & Buchanan, G. (2005). User centred interactive search in the humanities. In Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries (JCDL '05). ACM, New York, NY, USA, 400-400.
Zhang, X., Liu, J., Li, Y., & Zhang, Y. (2009). How usable are operational digital libraries: a usability evaluation of system interactions. In Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems (EICS '09). ACM, New York, NY, USA, 177-186.