We offer these resources describing evaluation processes and methods to assist LLL stakeholders in their evaluation efforts. We include sites that provide a broad overview of evaluation, as well as links that target particular evaluation methods with an emphasis on ease-of-use and practicality. Click on a topic to jump to a detailed section.
Evaluation Overview Resources
Evaluation Methods
- Evaluation project overview
- Student learning outcomes (development/assessment)
- Writing SLOs
- Assessing SLOs
Data Collection Methods
- Methods overview
- Ethics
- Questionnaire/surveys
- Increasing online survey response rates
- Interviews
- Focus groups
- Observation
- Document analysis
Reporting Data
Using Findings for Program Change
Evaluation Overview Resources
These user-friendly guides include overviews of evaluation processes, as well as “quick tips” or short explanations of different evaluation methodologies.
- University of Texas Instructional Assessment Resources (IAR)
- Pennsylvania State University Extension Program Evaluation Site
- University of Wisconsin Extension, Program Development and Evaluation Site
- National Foreign Language Research Center, Foreign Language Program Evaluation Project (NFRLC, FLPEP) A comprehensive resource for foreign language program evaluation
Evaluation Methods
These resources cover more specific aspects of evaluation with a focus on educational contexts.
Evaluation project overview
- University of Texas (IAR) A step-by-step guide to planning evaluation projects including checklists, worksheets and example evaluation plans
- Linking the how to the why: Methods decisions in foreign language program evaluation” [.pdf] A brief, useful description of evaluation project planning and implementation (Yukiko Watanabe and Castle Sinicrope, 2008, NFRLC FLPEP)
Student learning outcomes (development/assessment)
- NFLRC/FLPEP collection of SLO assessment websites A collection of SLO development/assessment how-to sites
- North Carolina State: Internet Resources for Higher Education Outcomes Assessment Links to various higher education outcomes assessment sites
- UHM Office of Assessment Useful suggestions for developing and assessing program-level learning outcomes
- Writing SLOs University of Texas (IAR) A guide to conceptualizing and writing student learning outcomes, with additional resources and links
- Assessing SLOs University of Michigan, College of Engineering Developing and assessing SLOs from UM’s Handbook on student learning outcomes assessment
Data Collection Methods
Methods overview
- University of Texas (IAR) A list of data collection methods with descriptions and step-by-step instructions on instrument planning, implementation, data analysis and reporting
- Penn. State University Extension Program Evaluation Site Links to many different kinds of evaluation data collection methods
- Overview of common evaluation methods (Sinicrope & Watanabe, NFLRC/FLPEP) [.pdf] A comprehensive list of data collection methods including a brief description of each tool, its purpose, advantages, and challenges
Ethics
- University of Texas (IAR) A description of ethical issues related to the collection and storing of data from human subjects
Questionnaire/surveys
- Using Surveys in Language Program Evaluation (NFRLC, FLPEP) A comprehensive treatment of survey/questionnaire methods
- University of Texas (IAR) A brief description of how to plan, develop, administer, analyze and report data for survey instruments
- University of Michigan College of Engineering: Assessment for Curricular Improvement How to develop surveys as well as advice on choosing samples (i.e., groups to administer the survey to)
- Creative Research Systems – survey design Description of survey development including tips on ‘dos and don’ts’
- University of Reading Statistical Services Centre Describes approaches to the analysis of survey data
Increasing online survey response rates
- Investigating strategies for increasing student response rates to online-delivered course evaluations (Norris & Conn, 2005) [.pdf] A published in The Quarterly Review of Distance Education
- Online survey response rates and times: background and guidance for industry (Hamilton, 2003) A white paper from a private consultant
- Advice from the College of LLL Evaluation Resource Team [.pdf] Recommendations for maximizing survey response rates
Interviews
- Online Advice on Designing and Analyzing Interviews A comprehensive listing of links to interview techniques, hosted on the NFLRC/FLPEP webpage
- University of Texas (IAR) A brief description of how to plan, develop, conduct and report data for interviews
- Penn. State University Extension Program Evaluation Site Documents and links on interview techniques
- Online Evaluation Resource Library: Preparing interviews
- Online Evaluation Resource Library: Administering interviews
Focus groups
- University of Texas (IAR) Focus group planning, implementation, data analysis and reporting
- University of Arizona Detailed description of focus group data collection methods
Observation
- University of Wisconsin Extension, Program Development and Evaluation Site [.pdf] Discusses how to collect direct observation data
Document analysis
- University of Texas (IAR) Document analysis planning, data gathering, and reporting results
Reporting Data
- Gene Shackman’s Program Evaluation Resource Page Many links for presentation/reporting of results
- University of Texas (IAR) A guide to data analysis and reporting practices for different types of evaluation data
Using Findings for Program Change
- UHM Office of Assessment Tips for using evaluation results
- Penn. State University Extension Program Evaluation Site [.pdf] Tips for using evaluation data to write evaluation impact statements and stating program value
