Real-time Feedback

Goals

• Enable students to provide instant feedback on key metrics regarding the lecture
• Engage students by incorporating their feedback on the lecture
• Allow lecturers to adapt their teaching based on key metrics impacting comprehension (speed and difficulty)

Scenario Description

large class

small class

frontal teaching

interactive lecture

exercise sessions

in-person teaching

remote teaching

hybrid teaching

You are a lecturer and would like to get instant feedback on key metrics like the speed and difficulty of your teaching. You start a session in the KlickerUZH after which students can provide feedback using the provided input sliders for speed and difficulty. During the lecture, you have the lecturer cockpit in your view, which displays the aggregated votes of the last 10 minutes, allowing you to continuously adapt your teaching to the circumstances. After the conclusion of your lecture, you view the timeline of the key metrics in its entirety, allowing you to visualize the development of the metrics and to pinpoint sections of your lecture that students found especially difficult or quick.

Implementation

Audience View

The audience can give you feedback on the speed and difficulty of the lecture by dragging the corresponding sliders to one of five possible positions (ranging from very slow to very fast and very easy to very hard). Each participant can provide feedback up to once a minute.

Metrics Gauges

To reflect the current situation, the metrics gauges on the lecturer view display an aggregate of each metric based on the incoming feedbacks of the last ten minutes. The number of feedbacks in the aggregate is displayed so that the reliability of the measure can be judged.

Lecturer Cockpit

The lecturer cockpit displays the real-time feedback gauges next to the pinned questions from Live Q&A. The bar on top of the window provides feedback at a quick glance, as it turns red when one of the gauges is in a red zone, and yellow when one of the gauges is in the orange zone.

Metrics Timeline

After the completion of a session, the development of real-time feedback metrics is plotted over time on the evaluation of the session. This allows lecturers to associate the development of the gauges with their lecture timing (e.g., to identify difficult parts).

Evaluation

To evaluate the viability of KlickerUZH Real-time Feedback in university teaching, we have created surveys for both lecturers and students for which we are currently gathering results. The surveys will remain active until and including spring 2022, and results will be updated periodically. Results shown here are not based on a statistically significant dataset or analysis.

Lecturers

I believe that the confusion barometer is helpful as a form of live feedback during the lecture (e.g., with the lecturer cockpit).

Own depicition based on preliminary data from 2 respondents.

I believe that the confusion barometer is helpful as an evaluation after the conclusion of the lecture (e.g., by analyzing the confusion time-series).

Own depicition based on preliminary data from 2 respondents.

Overall, how satisfied or dissatisfied are you with the Confusion Barometer?

Own depicition based on preliminary data from 2 respondents.

How likely will you be continuing to use the Confusion Barometer functionality in your future teaching?

Own depicition based on preliminary data from 2 respondents.

Students

Have you interacted with the Confusion Barometer (i.e., rating speed and difficulty)?

Name	Count
Yes	15
No	9
I did not know about the Confusion Barometer	5

Own depicition based on preliminary data from 29 respondents.

I find it worthwile to provide the lecturer with feedback using the Confusion Barometer.

Own depicition based on preliminary data from 12 respondents.

I am confident that my feedback can help lecturers improve their teaching.

Own depicition based on preliminary data from 12 respondents.

Feedback

If you have any feedback for us regarding this use case (e.g., extension ideas), please fill out the brief (2min) survey here. Thank you!