Ó£ÌÒÊÓƵ

Ìý




Assessment at University of Ó£ÌÒÊÓƵ

Assessment should be   . . .

 natural - flowing from teaching and learning, program and course outcomes, and college and university mission statements

 purposeful - monitoring learning, teaching, program efficacy, institutional effectiveness, or public accountability

 feasible - maximizing the use of technology, while minimizing time and effort

 informative – utilizing findings to make decisions regarding learning, teaching, program efficacy, institutional effectiveness, or public accountability

picture of student presenting research to faculty member Ó£ÌÒÊÓƵ engages in ongoing assessment of student learning as part of our commitment to students' educational outcomes.

Ó£ÌÒÊÓƵ Institutional Outcomes

The University of Ó£ÌÒÊÓƵ’s Institutional Outcomes serve as an umbrella for all student learning outcomes across the University. These include outcomes in co-curricular, undergraduate, graduate, and professional programs, as well as in the undergraduate core curriculum. These Institutional Outcomes are the knowledge, skills, abilities, and habits of mind that students are expected to develop as a result of their overall experience at Ó£ÌÒÊÓƵ.

Ó£ÌÒÊÓƵ Institutional Outcomes (pdf)

Mapping of Core Curriculum Outcomes to Institutional Outcomes (pdf)

Mission Alignment of Institutional Outcomes

I. JESUIT & MERCY VALUES

Students will be able to apply Jesuit and Mercy Values to their personal and professional responsibilities.

II. DIVERSITY & CULTURAL AWARENESS

Students will value multiple perspectives of diversity and human difference through exposure to a variety of cultures, communities, and contexts that prepare them to work and live in diverse settings, and to engage as citizens of the world.

III. CRITICAL THINKING & PROBLEM SOLVING

Students will be able to comprehensively explore a problem; make connections between information before accepting or formulating an opinion, solution, or conclusion; and conduct ongoing evaluation.

IV. COMMUNICATION

Students will be able to communicate effectively within academic, professional, and civic contexts using genres and/or modalities appropriate for their purpose and audience.

V. PROFESSIONALISM & ETHICS

Students will behave in a professional and ethical manner, exhibiting honesty, fairness, equality, dignity, integrity, and respect for individual rights and differences in all interactions.

VI. LIFELONG LEARNING

Students will develop foundational skills for lifelong learning, including curiosity, transfer, independence, initiative, and reflection.

Assessment

Assessment is an on-going process aimed at understanding and improving student learning. It involves making our expectations explicit and public; setting appropriate criteria and high standards for learning quality; systematically gathering, analyzing and interpreting evidence to determine how well performance matches those expectations and standards; and using the resulting information to document, explain, and improve performance. See Assessment Terms section of this webpage for national definitions of frequently used assessment terms.

University Assessment Team

The  is the primary oversight body for the student outcomes assessment programs of the University. The Assessment Team reports to the vice president for Academic Affairs and is comprised of

  • One representative from each of the colleges or schools.
  • One representative from the library.
  • One faculty member from the McNichols Faculty Assembly.
  • Two administrative representatives.

The  is responsible for

  • Developing a mechanism for sharing best practices around the University regarding assessment.
  • Reviewing the assessment methodologies being used by each school and identifying those schools in which assessment activities require improvement.
  • Providing ongoing reports to and consultation with the academic vice president and provost.
  • Keeping the University community informed of team activities.

Continuous Improvement

Assessment of Student Learning

Assessment of student learning is the systematic collection of information about student learning, using the time, knowledge, expertise and resources available, in order to inform decisions about how to improve learning (Walvoord, Assessment Clear and Simple). At the heart of our assessment efforts is the work of Barbara Walvoord who states the three steps of assessment are:

  1. Articulate goals for student learning.
  2. Gather evidence about how well students are meeting the goals.
  3. Use the information for improvement.

The defining feature of Walvoord's approach to assessment is her emphasis on the course-embedded assignment and on the professional expertise of the individual professor, whose experience in grading student work is the foundational assessment act. Walvoord suggests that professors become intentional, reflective, and explicit in identifying and sharing criteria for students’ expected level of performance on each assignment. She asks professors to develop rubrics that specify levels of performance across various criteria, to use the rubrics to score student work, and then to analyze the distribution of scores to discover patterns of strengths and weaknesses in student performance. When these patterns are reported at a department meeting, the ensuing faculty discussion often leads to suggested improvements in teaching methods, assignments, course design, or curricular coverage to ameliorate weaknesses. A department's assessment plan consists of student learning outcomes, assessment methods (embedded assignments) and criteria for success.

Higher Learning Commission - Student Learning, Assessment, and Accreditation

“Among the public’s many expectations of higher education, the most basic is that students will learn, and in particular that they will learn what they need to know to attain personal success and fulfill their public responsibilities in a global and diverse society. Student learning is central to all higher education organizations; therefore, these organizations define educational quality--one of their core purposes--by how well they achieve their declared mission relative to student learning. A focus on achieved student learning is critical not only to a higher education organization’s ability to promote and improve curricular and co-curricular learning experiences and to provide evidence of the quality of educational experiences and programs, but also to fulfill the most basic public expectations and needs of higher education” (HLC, 2007).

 The Higher Learning Commission’s Fundamental Questions for Conversations on Student Learning

 “In using these questions, an organization should ground its conversations in its distinct mission, context, commitments, goals and intended outcomes for student learning. In addition to informing ongoing improvement in student learning, these conversations will assist organizations and peer reviewers in discerning evidence for the Criteria and Core Components” (HLC, 2007).

  1. How are your stated student learning outcomes appropriate to your mission, programs, degrees, and students?
  2. What evidence do you have that students achieve your stated learning outcomes?
  3. In what ways do you analyze and use evidence of student learning?
  4. How do you ensure shared responsibility for student learning and for assessment of student learning?
  5. How do you evaluate and improve the effectiveness of your efforts to assess and improve student learning?
  6. In what ways do you inform the public and other stakeholders about what students are learning---and how well?

 Regional Accreditation and Assessment Organizations

 American Association of Colleges and Universities

 Association for the Assessment of Learning in Higher Education

 Higher Learning Commission

 National Institute for Learning Outcomes Assessment

Colleague Development Days Professional Development

Program Assessment Plan Form

This form is used to capture the student learning outcomes of the program, the assessment methods, benchmarks/criteria for success, and assessment cycle. It was originally due to the University Assessment Team on December 15, 2020 and should be updated when the program makes changes to any of the assessment plan components. The program must keep a copy of the plan for their records (a copy is sent via email upon form completion). The University Assessment Team will also retain a copy.  
 
RESOURCE: Assessment of Student Learning Overview

RESOURCE: Curriculum Outcomes Assessment Matrix

RESOURCE: PDF of Blank Assessment Plan

RESOURCE: Worksheet: Developing a Program Assessment Plan

FORM:

Assessment Plan Rubric

The University Assessment Team uses a rubric to review and provide feedback to program faculty regarding their Program Assessment Plans.

Program Assessment Plan Rubric

Annual Assessment Report Form - Academic Programs

This report is completed annually by all academic programs and submitted by December 15th of the year following the assessment. This document will serve as evidence of student learning. A PDF of the document will be posted to the Academic Affairs website and the program should keep a copy for their records (a copy is sent via email upon report completion). 
Due date for Annual Assessment Report: December 15th


RESOURCE: PDF of Blank Annual Assessment Report 

RESOURCE: Worksheet: Annual Program Assessment Form

FORM:

Annual Assessment Report Rubric

The University Assessment Team uses a rubric to review and provide feedback to program faculty regarding their Annual Assessment Program Report.

Link to Annual Assessment Report Rubric

Assessment Reports

University Assessment Team Reports

Co-Curricular Programs

Co-Curricular Programs at Ó£ÌÒÊÓƵ are “Learning activities, programs and experiences that reinforce the institution’s mission and values and complement the formal curriculum” (HLC). Quality co-curricular experiences begin with program assessment plans that articulate intended student learning and methods of assessment. Annual assessment reports capture student performance and actions for continuous improvement.

Co-Curricular Sub-Committee 

Table contains a list of five co-curricular programs with their and annual reports.
Program Outcomes Assessment Plan on File Annual Assessment
Emerging Leaders Program Program Goals and Objectives

yes

Assessment Summary Report
Internationally Based Education Programs Program Goals and Objectives

yes

Assessment Summary Report
Service Immersion Program Program Goals and Objectives yes Assessment Summary Report
Service Learning Program Program Goals and Objectives

yes

Assessment Summary Report
The Writing Center Program Goals and Objectives

yes

Assessment Summary Report

Core Curricular Outcomes

University of Ó£ÌÒÊÓƵ's mission statement describes an education that integrates “the intellectual, spiritual, moral and social development” of its students. As the shared academic experience of all Ó£ÌÒÊÓƵ undergraduates, the Core Curriculum is the foundation for achieving this mission, and for ensuring that each of its graduates will understand, pursue, and live out that mission. For more details visit the Core Curriculum webpage.

The Core Curriculum Assessment Committee oversees the assessment of Core Curriculum Student Learning Outcomes and uses the schedule listed in the Core Curriculum Assessment Plan. The process used to assess student learning in each knowledge area or integrating theme involves faculty assessing random samples of student artifacts collected from core approved courses. Rubrics are developed using the core curriculum outcomes and the AAC&U VALUE Rubrics. 

Core approved courses must fulfill all of the learning outcomes listed for a core knowledge area or integrating theme, thereby affording students the opportunity to demonstrate their level of learning core outcomes. The Policy for Continuous Improvement of Core Curriculum Courses focuses on the effectiveness of courses that have been approved for inclusion in the core curriculum. Courses categorized as core assessment criterion partially met or core assessment criterion not met lead to a faculty action plan and subsequent assessments.

Knowledge Areas

Table of Communication Skills Core Areas and Assessment Reports
Knowledge Area A – Communication Skills Assessment
A1: Oral Communication Rubric Assessment Report
A2: Written Communication Rubric Assessment Report

 

Table of Mathematics and Statistical Knowledge Core Areas and Assessment Reports
Knowledge Area B – Mathematics / Statistical Knowledge Assessment
B1:Quantitative and Symbolic Reasoning Rubric Assessment Report
B2: Statistical and Probabilistic Reasoning Rubric Assessment Report

 

Table of Scientific Knowledge Core Areas and Assessment Reports
Knowledge Area C – Scientific Knowledge Assessment

C1: Physical Sciences Rubric

Assessment Report
C2: Social Sciences Rubric  Assessment Report

 

Table of Religious and Philosophical Knowledge Core Areas and Assessment Reports
Knowledge Area D – Religious and Philosophical Knowledge  Assessment

D1 – Philosophical Knowledge Rubric

Assessment Report
D2 - Religious Knowledge Rubric Assessment Report
D3 - Philosophy Studies Rubrics Assessment Report
D3 - Religious Studies Rubric Assessment Report

 

Table of Essential Humanities Core Areas and Assessment Reports
Knowledge Area E – Essential Humanities Assessment

E1 - Historical Experiences Rubric

Assessment Report
E2 - Literary Experiences Rubric Assessment Report
E3 - Aesthetic Experiences Rubric Assessment Report

 

Table of Ethics & Social Responsibility Core Areas and Assessment Reports
Knowledge Area F – Ethics and Social Responsibility Assessment
F1 - Ethics Outcomes Rubric Assessment Report

 

Table of Integrating Themes and Assessment Reports
Integrating Themes Assessment
IT1 - Reading, Writing, and Research Across the University Rubric Assessment Report
IT1.1 & IT1.2 - Reading, Writing, and Research  Assessment Report
IT2 – Critical Thinking Rubric  Assessment Report
IT3 – Cultural Diversity Rubric Assessment Report
IT4 – Human Difference Rubric Assessment Report
IT5 – Personal Spiritual Development Rubric Assessment Report
IT6 – Spirituality and Social Justice Rubric Assessment Report

 

College of Business Administration

List of College of Business Administration Programs, Goals, Objectives, and Assessment Reports.
Programs Outcomes Assessment Plan on File Annual Assessment
Yes Assessment Summary Report
Yes Assessment Summary Report
Program Goals and Objectives Yes Assessment Summary Report

College of Engineering & Science

Undergraduate Engineering and Computer Science Programs Goals, Objectives, and Assessment Reports.
Undergraduate Engineering and Computer Science Programs Outcomes Assessment Plan on File Annual Assessment
yes Assessment Summary Report
yes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report

Program Objectives and Outcomes yes Assessment Summary Report
yes Assessment Summary Report
Graduate Engineering and Computer Science Programs Goals, Objectives, and Assessment Reports.
Graduate Engineering and Computer Science Programs Outcomes Assessment Plan on File Annual Assessment
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
yes Assessment Summary Report
Program Objectives and Outcomes Assessment Summary Report
Undergraduate Science and Mathematics Programs Goals, Objectives, and Assessment Reports.
Undergraduate Science and Mathematics Programs Outcomes Assessment Plan on File Annual Assessment
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report

College of Health Professions & McAuley School of Nursing

List of College of Health Professions & McAuley School of Nursing Programs, Goals, Objectives, and Assessment Reports
Undergraduate Programs, Goals, Objectives, and Assessment Reports.
Undergraduate Programs Outcomes Assessment Plan on File Annual Assessment
Program Objectives & Outcomes yes Assessment Summary Report
yes Assessment Summary Report
Graduate Programs, Goals, Objectives, and Assessment Reports.
Graduate Programs Outcomes Assessment Plan on File Annual Assessment
yes Assessment Summary Report
yes Assessment Summary Report

yes Assessment Summary Report

yes Assessment Summary Report

yes Assessment Summary Report

yes Assessment Summary Report

yes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
Program Objectives and Outcomes yes Assessment Summary Report
yes Assessment Summary Report
Program Competencies yes Assessment Summary Report

Please note that the following MSN programs have a common assessment plan:MSN, MSN FNP, MSN AGCNS, MSN NHL, MSN CNL

College of Liberal Arts & Education

List of College of Liberal Arts & Education Programs, Goals, Objectives, and Assessment Reports.

Undergraduate Programs, Goals, Objectives, and Assessment Reports.
Undergraduate Program Outcomes Assessment Plan on File Annual Assessment
Program Goals and Objectives yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
Program Goals and Objectives Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
yes Assessment Summary Report
Program Goals and Objectives Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
Graduate Programs, Goals, Objectives, and Assessment Reports.
Graduate Program Outcomes Assessment Plan on File Annual Assessment
Program Goals and Objectives yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
Intelligence Analysis (MS in Intelligence Analysis) Program Goals and Objectives Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
Program Goals and Objectives Assessment Summary Report
Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report

Psychology: Clinical Psychology - (PhD)

Program Goals and Objectives Assessment Summary Report
Program Goals and Objectives yes Assessment Summary Report
Program Goals and Objectives Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report

Interdisciplinary Programs

List of Interdisciplinary Programs, Goals, Objectives, and Assessment Reports.
Programs Outcomes Assessment Plan on File Annual Assessment
Leadership Minor Program Goals and Objectives yes Assessment Summary Report
Women's and Gender Studies Minor Program Goals and Objectives yes Assessment Summary Report

School of Architecture & Community Development

List of School of Architecture & Community Development Programs, Goals, and Assessment Reports
Programs Outcomes Assessment Plan on File Annual Assessment
Program Goals and Objectives Yes Assessment Summary Report
Program Goals and Objectives Yes Assessment Summary Report
Program Goals and Objectives Yes Assessment Summary Report

School of Dentistry

List of School of Dentistry Programs, Goals, Objectives, and Assessment Reports

Doctor of Dental Surgery Programs, Goals, Objectives, and Assessment Reports
Doctor of Dental Surgery Programs Outcomes Assessment Plan on File Annual Assessment

yes Assessment Summary Report
Dental Hygiene Programs, Goals, Objectives, and Assessment Reports
Dental Hygiene Programs Outcomes Assessment Plan on File Annual Assessment

yes Assessment Summary Report
Graduate Programs, Goals, Objectives, and Assessment Reports
Graduate Programs Outcomes Assessment Plan on File Annual Assessment
yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report
yes Assessment Summary Report

School of Law

List of School of Law Programs, Goals, and Assessment Reports
Programs Outcomes Assessment Plan on File Annual Assessment

yes Assessment Summary Report

Assessment Terms extracted from the National Institute for Learning Outcomes Assessment Glossary

Assessment

A participatory, iterative process that provides data institutions need on their students’ learning, engages the college and others in analyzing and using that information to confirm and improve teaching and learning, produces evidence that students are learning the outcomes the institution intended, guides colleges in making educational and institutional improvements, evaluates whether changes made improve/impact student learning, and documents the learning and institutional efforts.

Benchmark

A criterion-referenced objective performance data point that can be used for the purposes of internal or external comparison. A program can use its own data as a baseline benchmark against which to compare future performance. It can also use data from another program as a benchmark.

Capstone Courses and Projects

Whether they’re called “senior capstones” or some other name, these culminating experiences require students nearing the end of college to create a project that integrates and applies what they’ve learned. The project might be a research paper, a performance, a portfolio, or an exhibit of artwork. Capstones can be offered in departmental programs and in general education as well.

Criterion Referenced

A test in which the results can be used to determine a student's progress toward mastery of a content area. Performance is compared to an expected level of mastery in a content area rather than to other students' scores. Such tests usually include questions based on what the student was taught and are designed to measure the student's mastery of designated objectives of an instructional program. The "criterion" is the standard of performance established as the passing score for the test. Scores have meaning in terms of what the student knows or can do, rather than how the test-taker compares to a reference or norm group.

Direct Assessment of Learning

Direct assessment is when measures of learning are based on student performance or demonstrates the learning itself. Scoring performance on tests, term papers, or the execution of lab skills, would all be examples of direct assessment of learning. Direct assessment of learning can occur within a course (e.g., performance on a series of tests) or could occur across courses or years (comparing writing scores from sophomore to senior year).

Embedded Assessment

A means of gathering information about student learning that is built into and a natural part of the teaching-learning process. Often uses for assessment purposes classroom assignments that are evaluated to assign students a grade. Can assess individual student performance or aggregate the information to provide information about the course or program; can be formative or summative, quantitative or qualitative.

Evaluation

Both qualitative and quantitative descriptions of progress towards and attainment of project goals. Using collected information (assessments) to make informed decisions about continued instruction, programs, activities. Leads to statements of the value, worth, or merit of a program

Formative Assessment

Formative assessment is often done at the beginning or during a program, thus providing the opportunity for immediate evidence for student learning in a particular course or at a particular point in a program. Classroom assessment is one of the most common formative assessment techniques. The purpose of this technique is to improve quality of student learning, leading to feedback in the developmental progression of learning. This can also lead to curricular modifications when specific courses have not met the student learning outcomes. Classroom assessment can also provide important program information when multiple sections of a course are taught because it enables programs to examine if the learning goals and objectives are met in all sections of the course. It also can improve instructional quality by engaging the faculty in the design and practice of the course goals and objectives and the course impact on the program.

Indirect Assessment of Learning

Indirect assessments use perceptions, reflections or secondary evidence to make inferences about student learning. For example, surveys of employers, students’ self-assessments, and admissions to graduate schools are all indirect evidence of learning.

Performance-Based Assessment

Performance-based assessment is a test of the ability to apply knowledge in a real-life setting. Assessment of the performance is done using a rubric, or analytic scoring guide to aid in objectivity.

Reliability

How consistently a measure of the same phenomenon leads to the same result after multiple administrations or across multiple scorers/raters.

Portfolio

A systematic and organized collection of a student's work that exhibits to others the direct evidence of a student's efforts, achievements, and progress over a period of time. The collection should involve the student in selection of its contents, and should include information about the performance criteria, the rubric or criteria for judging merit, and evidence of student self-reflection or evaluation. It should include representative work, providing a documentation of the learner's performance and a basis for evaluation of the student's progress. Portfolios may include a variety of demonstrations of learning and have been gathered in the form of a physical collection of materials, videos, CD-ROMs, reflective journals, etc.

Rubric

A rubric is an evaluative tool that explicitly represents the performance expectations for an assignment or piece of work. A rubric divides the assigned work into component parts and provides clear descriptions of the characteristics of the work associated with each component, at varying levels of mastery. Rubrics can be used for a wide array of assignments: papers, projects, oral presentations, artistic performances, group projects, etc. Rubrics can be used as scoring or grading guides, to provide formative feedback to support and guide ongoing learning efforts, or both.

Self-Assessment

A process in which a student engages in a systematic review of a performance, usually for the purpose of improving future performance. May involve comparison with a standard, established criteria. May involve critiquing one's own work or may be a simple description of the performance. Reflection, self-evaluation, metacognition, are related terms.

Student Learning Outcome Statement

A specific description of what a student will be able to do at the end of the period during which that ability is presumed to have been acquired, and the focus of outcome assessment. (Note: some professional organizations may refer to these with different terms, such as objectives, indicators, abilities, or competencies).

Summative Assessment

Summative assessment is comprehensive in nature, provides accountability and is used to check the level of learning at the end of the program. For example, if upon completion of a program students will have the knowledge to pass an accreditation test, taking the test would be summative in nature since it is based on the cumulative learning experience. Program goals and objectives often reflect the cumulative nature of the learning that takes place in a program. Thus, the program would conduct summative assessment at the end of the program to ensure students have met the program goals and objectives. Attention should be given to using various methods and measures in order to have a comprehensive plan. Ultimately, the foundation for an assessment plan is to collect summative assessment data and this type of data can stand-alone. Formative assessment data, however, can contribute to a comprehensive assessment plan by enabling faculty to identify particular points in a program to assess learning (i.e., entry into a program, before or after an internship experience, impact of specific courses, etc.) and monitor the progress being made towards achieving learning outcomes.