Dominique Burns e-Portfolio

Introduction

The ability to evaluate collections, current trends, programs, and services in the library is a necessary skill for all librarians. It is important to constantly evaluate and re-evaluate any organization.  There are two goals of evaluation, which are proving and improving (Applegate, 2013, p. vii). Evaluations can help prove the library’s value and improve the library’s programs and services (Applegate, 2013, p. vii). How librarians evaluate and measure programs and services is critical to the success of the library. It’s essential that librarians ask themselves why they should evaluate something, how they evaluate, and whom they are evaluating for?

 

Evaluation

An evaluation is the processes of gathering “Data for managerial decision making” (Applegate, 2013, p. vii). These decisions may be for internal purposes or for external services that the organization offers. Librarians may evaluate services through internal feedback in order to gain employee buy-ins to the company. Giving a voice to employees helps to create a sense of ownership in the work they do. Evaluations may also be done through surveying patrons to find out more about their information needs and wants. The purpose of the library is to serve their communities and they can’t successfully do that if they don’t evaluate or measure their services. Whatever it is that is being assessed or measured, librarians should continually evaluate their libraries in order to prove value to their stakeholders and improve the quality of their services.

 

The next question then is how do librarians evaluate or measure services? One-way is through surveys, which are sets “Of questions, most of which have fixed answer sets, asked of one individual” (Applegate, 2013, p. 1). Surveys are a great way to ask someone about their thoughts on the library’s collection, website services, programs in the physical library, and/or their information needs.  Surveys are unique and allow librarians to “Get descriptive information about respondents” (Applegate, 2013, p. 2). According to Applegate (2013) there are three ways to design a successful survey, which are:

 

1. Designing the survey: Content, Individual question design, Overall questionnaire design.

2. Administering the survey: Selecting, Sending, Receiving.

3. Analyzing results (Applegate, 2013, pp. 3-4).

 

Surveys can be dichotomous, which are questions that require yes/no answers (Applegate, 2013, p. 6).  There are also multiple-choice questions, which provide several choices to pick from. Librarians may want to use surveys before and after technology related classes to better understand how much individuals learned in the class. This can be done through a rating or likert-type scale survey (Applegate, 2013, p. 7).

 

 

​

​

​

​

​

​

​

​

​

​

​

​

Figure 1: Likert-Type Scale Adjectives

(Applegate, 2013, p. 7)

 

Surveys can also include ask-exact questions or open-ended questions, which require “A very brief answer to be written” (Applegate, 2013, p. 8). This kind of survey is useful for asking patrons about which books they like or what they like about the library. It also allows patrons or employees to explain answers to other survey questions.  Surveys are just one of many ways to evaluate services.

 

There are also different evaluation approaches, such as formative and summative assessment techniques (McClure, 2008, p. 179). Formative assessments are “Done on an ongoing basis to monitor a program or service” (McClure, 2008, p. 179). Examples of this include librarian or staff made observations in the library during reference transactions or various programs. Summative assessments are “Done at the end of program or service” in order to determine “Success, impact, results, cost...or other factors” (McClure, 2008, p. 179). Surveys are often associated as a type of summative assessment in the library. How librarians choose to effectively evaluate services is extremely important, because it provides information that is valuable for long-term planning. How librarians measure or interpret quantitative and qualitative data found in evaluations depends on the information collected. In order to assess the data collected through evaluations, librarians need a measurable criteria. McClure (2008) suggests that librarians look at extensiveness, efficiency, effectiveness, service quality, impact, and usefulness as criteria for measuring evaluations (pp. 182-183). As, well look at other resources such as American Library Association or Institute of Museum and Library Services. Here are links for evaluation criteria resources to help with budgets, collections, and programs.

 

• American Library Association Program and Budget Evaluation Criteria: http://www.ala.org/alsc/program-and-budget-evaluation-criteria

 

• American Library Association Evaluating Websites for Information: http://www.ala.org/aasl/sites/ala.org.aasl/files/content/conferencesandevents/ecollab/lpd/EvaluatingWebsites.pdf

 

• Institute of Museum and Library Services: Evaluation Resources: https://www.imls.gov/research-evaluation/evaluation-resources

 

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

Figure 2: Importance of Evaluation

(McClure, 2008, p. 181)

 

Lastly, it is important to not forget who we evaluate library services for. Librarians evaluate services for library stakeholders. Stakeholders are individuals “Who directly benefit from the library (American Library Association, n.d.). Primary library stakeholders are children of all ages, parents and their surrogates, educational partners, and organizations serving youth (American Library Association, n.d.). Secondary library stakeholders are people of influence, government agencies, business people, support groups, special interest organizations, and non-profits (American Library Association, n.d.). Libraries exist for the communities they serve and that is why it is important for librarians to evaluate collections, current trends, programs, and services in the library.

 

Evidence

The following evidence includes MLIS coursework that I have completed during my time at San Jose State University.

 

1. INFO 204 Information Professions: Developing a Strategic Plan for LA as Subject

2. INFO 210 Reference and Information Services: RUSA Reference Interview Transcript and Analysis

3. INFO 233 School Media Centers: Vision Project

4. INFO 266 Collection Management: Community and Collection Evaluation

 

INFO 204 Information Professions: Developing a Strategic Plan for LA as Subject

 

Evidence:

• Part 1: Mission, Vision & Value Statements, Environmental Scan, and SWOT Analysis

• Part 2: Strategic Goals, Assessments, and Annotated Bibliography

​

This project required me to work with group members in order to create a new strategic plan for the organization LA as Subject (LAAS). Each group member took on different roles and responsibilities for the successful completion of the project. We assessed and evaluated the organization through an environmental scan, literature review, and STOW analysis.

 

INFO 210 Reference and Information Services: RUSA Reference Interview Transcript and Analysis

 

Evidence:

• RUSA Reference Interview Transcript and Analysis

 

I created a pretend reference interview using the RUSA “Guidelines for Behavioral Performance of Reference Information Service Providers.” In this imaginary transcript I addressed an ethical and legal related issue between a reference librarian and patron. I then evaluated the transcript by using the criteria for reference services from RUSA “Guidelines for Behavioral Performance of Reference Information Service Providers.”

 

INFO 233 School Media Centers: Vision Project

 

Evidence: Vision Project Parts

• Final Project – Presentation on Youtube

(https://youtu.be/S2spW7ehVII?list=PLZlaVD6h0zDbEFy68y3esauNhQUf3Z7Ym)

• Community Input Paper

• Mission Paper

• Budget Paper

• Assessment and Advocacy Plan

​

This semester long vision project required me to research my ideal school library and create a vision plan. Throughout the semester I designed different parts to my ideal school library, which included creating a community plan, mission statement, budget, and assessment and advocacy plan. After each part of my vision project was approved I created a video on YouTube discussing the different parts to my vision project. The vision project required me to include fundamental principles of librarianship in my design preparation, such as planning, management, marketing, and advocacy. I evaluated and assessed different aspects of librarianship in relation to successful school libraries.

 

INFO 266 Collection Management: Community and Collection Evaluation

 

Evidence:

• Community and Collection Evaluation

 

This assignment required me to evaluate a school library’s collection. I researched the school’s demographics to better understand their clientele and services. I then evaluated the school library’s collection. I measured the collection based off of how diverse it was. I looked for different fiction and non-fiction genres, books with reading levels, and technology. 

​

Conclusion

The evidence above reflects my abilities to evaluate collections, current trends, programs, and services in the library. In some of my evidence I address the two main goals of evaluation, which are proving and improving (Applegate, 2013, p. vii). I prove the value of the services provided or I looked at ways to improve those services. As a future librarian it is important to have the skills to evaluate internal library operations and external services. I feel the above coursework is evidence of my ability to do both.  I also understand the importance of continually evaluating services and even my own work. I recognize that it is key to always evaluate and assess different things in order to grow as an individual or organization.

 

References

American Library Association. (n.d.) Identifying key stakeholders. Retrieved from

http://www.ala.org/everyday-advocacy/engage/identify-key-stakeholders

 

Applegate, R. (2003). Practical evaluation techniques for librarians. Santa Barbra, CA: Libraries Unlimited.

 

McClure, C. (2008). Learning and using evaluation: A practical introduction In Haycock, K. & Sheldon, B. E. (Eds.).

The portable MLIS: Insights from the experts (pp. 179-191). Westport, CT: Libraries Unlimited.