Skip to McMaster Navigation Skip to Site Navigation Skip to main content
McMaster logo

Faculty of Health Sciences

Learning Technologies Lab

Evaluation

Evaluation of teaching needs can provide valuable opportunities for teachers’ inquiry into student learning. The feedback provided, whether positive or critical, can help instructors improve their courses and polish their teaching methods during or after the semester.

Having trouble finding the right resource? We can help.

Contact Us

Expandable List

Formative evaluations are used to evaluate a course or a program’s development which includes materials, exercises, and overall instructional design.

Summative evaluations are used to measure a course or a program’s success which includes measuring whether the design and implementation helped improve learning results.

You can conduct a formative evaluation by running a pilot program so you can fine-tune the course before rolling it out. You may learn that the instructions for a specific activity confused learners and what need to be revised. A summative evaluation could provide key statistics about the course once you rolled it out.  

There are four levels in the Kirkpatrick model to evaluate a course or a program.

  • Level 1 – Reaction: You can measure the reaction of learners to the course by conducting a post-survey with different survey analysis tools.
  • Level 2 – Learning: You figure out what participants learned in the training, for example, their acquired skills and attitudes through learning. Post-tests, simulations and post course assignments are commonly used for this level.
  • Level 3 – Behavior: New on-the-job behaviors as a result of the learning. You can conduct the on-the-job observation to understand what new skills they use and apply in the new scenarios.
  • Level 4 – The learning goals and results achieved: Your biggest challenge will be to identify which outcomes, benefits, or final results are most closely linked to the course design, and to come up with an effective way to measure these outcomes in the long term.

Educational practitioners often use the Kirkpatrick model backward, by first stating the outcomes that they desire to see, and then developing the learning activities that’s most likely to deliver them. This helps to prioritize the goals of the learning and make it more effective.

The data-driven decision usually comes with data interpretation and sharing among stakeholders. You can use different ways and tools to analyze data collected from the evaluation and present in data dashboards and reports.

There are different analysis buckets for you to consider when getting data on feedback:

  • Data composition: purpose of feedback, source of feedback, sentiment in feedback
  • Data gathering: feedback to be gathered, frequency, initiator, nature and validity of data
  • Data Reporting: Style and sentiment, delivery method
  • Data processing: insights gain, own ego, follow-ups to feedback

Source of content: Faculty Feedback workshop

  • Data is not aggregated
  • Data is not easily accessible
  • Maintaining anonymity of feedback
  • Lack of time Hierarchies and cultural influences
  • Reluctance for more paperwork
  • Fear of repercussions of feedback

Source of content: Faculty Feedback workshop

 

Resource Listing

POP-UP

Avenue To Learn

Avenue to Learn is a web-based course management system. It is designed to create a rich online learning environment for learners.

POP-UP

LimeSurvey

LimeSurvey is an extremely versatile and advanced online survey system used to create quality online surveys. It is very easy to learn how to use and user-friendly.

POP-UP

Mentimeter

Mentimeter is an interactive presentation platform that you can use to engage with and collect feedback from your students both synchronously and asynchronously.

POP-UP

Microsoft Forms

With Microsoft Forms, you can create surveys, quizzes, and polls, invite others to respond to it using almost any web browser or mobile device, see real-time results as they're submitted, use built-in analytics to evaluate responses, and export results to Excel for additional analysis or grading.

POP-UP

Microsoft Powerpoint

Microsoft PowerPoint turns your ideas into compelling presentations using professional-looking templates. With Live presentations in PowerPoint, audience members can see a presentation on their devices and read live subtitles in their preferred language while you speak.

POP-UP

Padlet

Padlet is a digital tool that can help teachers and students in class and beyond by offering a single place for a notice board.

POP-UP

REDCap

REDCap is a secure web application for building and managing online surveys and databases.

POP-UP

Tableau

Tableau is a business and analytical software tool to help understand, visualize, and make data driven decisions.