Course Evaluation Forms

1. No

2. CoursEval by Connectedu, about 2 ½ weeks to complete.

3. Has increased, Fall’s response 82%

4. Hold grades for 3 weeks

Stephen Patrick
Chief Information Officer Illinois College
1101 West College Avenue
Jacksonville, IL 62650
217.245.3399
www.ic.edu

Posted by: steve_patrick on December 19, 2011

Hi Dale,

There's a lot of discussion in the archives on this topic.

http://listserv.educause.edu/cgi-bin/wa.exe?S2=CIO&q=&s=evaluation&f=&a=&b=

We're using CoursEval3.

About a 2.5 week window for end-of-term evals. 10 days for courses that end before end of term.

Response rates are a struggle. People perceive them as being lower - but we have no data on response rates of the paper forms, just anecdotal. We track it and don't try to hide it http://www.augsburg.edu/ctl/evals.html .

Just reminders -- email, LMS portal widget, digital signs. Our campus culture does not favor incentives.

-- Scott

Scott Krajewski
Director, IT Services
Augsburg College
http://www.augsburg.edu/it/
The Link: IT Newsletter
http://augnet.augsburg.edu/thelink

>>> On 12/19/2011 at 03:01 PM, Dale Hochstein <dhochstein@SPC.EDU> wrote:

Dear Fellow CIO's,

I was wondering how many schools are still using paper Scranton forms for course evaluations. Saint Peter's College's faculty is resisting going electronic due to an expected lower return rate on responses. What I specifically want to know is:

Are you still using Scranton forms?

If not, what electronic system are you using and how many days to students get to fill out the form?

Has participation (or percentage of forms completed) decreased? By what percentage?

What incentives, if any, are you giving to encourage a higher percentage of participation?

Thanks so much for your response.

Dale Hochstein

CIO, Saint Peter's College, 104 Glenwood Avenue, Jersey City, NJ, 07306, W-201-761-7827,dhochstein@spc.edu

********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/groups/.

Posted by: krajewsk on December 19, 2011

We have custom online course evaluations mostly developed and managed by our e-learning office. Our faculty have largely represented that response rate is a departmental issue. Different departments here do different things to increase responses. I've heard all sorts of tactics, some are:

Telling the class that if there's 100% participation on the evaluations, everyone in the class will receive some defined extra credit.
Handing out online exam passwords upon screen-print proof that the student has completed the evaluation.
Including the link to online course evals in the online course materials.

Theresa

Posted by: rowe on December 19, 2011

Hi Dale,

You might want to take a look at these presentations from the Mid-Atlantic and NERCOMP Conferences for some ideas on helping faculty make the switch.

Implementing an Online Course Evaluation Solution: Navigating Faculty Governance and Endorsement, 2009

http://www.educause.edu/Resources/ImplementinganOnlineCourseEval/163753

Online Course Evaluation: If You Build It, Some Will Come, 2009

http://www.educause.edu/Resources/OnlineCourseEvaluationIfYouBui/163882

Please let me know if you have any questions, thank you.

Colleen Keller
Electronic Resources Librarian
EDUCAUSE - Uncommon Thinking for the Common Good

4772 Walnut Street, Suite 206
Boulder, CO 80301-2538
Phone (303) 939-0309

From: The EDUCAUSE CIO Constituent Group Listserv [mailto:CIO@LISTSERV.EDUCAUSE.EDU] On Behalf Of Theresa Rowe
Sent: Monday, December 19, 2011 3:02 PM
To: CIO@LISTSERV.EDUCAUSE.EDU
Subject: Re: [CIO] Course Evaluation Forms

We have custom online course evaluations mostly developed and managed by our e-learning office. Our faculty have largely represented that response rate is a departmental issue. Different departments here do different things to increase responses. I've heard all sorts of tactics, some are:

Telling the class that if there's 100% participation on the evaluations, everyone in the class will receive some defined extra credit.
Handing out online exam passwords upon screen-print proof that the student has completed the evaluation.
Including the link to online course evals in the online course materials.

Theresa

Posted by: ckeller on December 19, 2011

Dale, Answers and a comment below. Thanks, Jeff Jeffrey C. Cepull | Vice President for Information Resources and CIO | Philadelphia University | 215-951-2516 | 215-951-6852 - FAX Please consider the environment before printing this email

Posted by: cepullj on December 19, 2011

We use a custom online evaluation form. Use of the online version is optional.

If the evaluation is done in class, we have a high participation rate. If it is done optionally online, the participation rate drops substantially.

Since all our students have laptops, it is easy to require that students bring their computers and complete the evaluation in class.

Rick

--
Rick Matthews

Associate Provost for Technology & Information Systems

Posted by: rick1matthews on December 19, 2011

We have had an online process for entering evaluations and viewing evaluations for many years — see http://www.educause.edu/Resources/DotCOMMeetsDotEDUGivingLifetoO/155737 for a presentation we made in 2004 on our process. We have added several enhancements since then. For example, the forms are now generated dynamically and the questions customized based on course characteristics such as lecture, ensemble, online, lab, law, etc. We used to do evals only for fall and spring terms, but now we do them for all terms. We offer several incentives including letting students register a day early for the next fall or spring term and viewing final grades early. The ability to view final grades early actually helps us by splitting up the stampede of traffic on our portal. Last year, we added auto-alerts telling students that it is time to enter evaluations and then thanking those who entered 100% of their evals and reminding them that they will be able to view final grades early. We give students a "last chance" to enter evals before they view their final grades. In the "last chance" logic, they are required to complete at least 50% of their evals if it is X days since final grades became available. We have tried to create a culture in which students understand that teacher evaluations are important and that the info is actually used.

The best thing about going to online entry is that students provide more meaningful and detailed narrative comments. After all, it feels kind of like blogging vs. writing comments with paper and pencil. The quantitative results (summary) and one narrative question, "What do you want other students to know about your experience in this class?," are available to everyone on our intranet. The remaining narrative questions are only available to the instructor and his/her reporting line. We offer comparison reports for department chairs and deans. For the first several years of going to this process, an Associate Provost (Dr. Maurice Eftink) and I made presentations to our faculty senate on the changes, if any, in responses. Now the process is pretty much accepted.

PS. My son is a junior here, and he was proud this semester to have made an A in a course that was described as "a GPA killer" in teacher evaluation results (the narrative question that is available to students).

From: Dale Hochstein <dhochstein@SPC.EDU>
Reply-To: EDUCAUSE Listserv <CIO@LISTSERV.EDUCAUSE.EDU>
Date: Mon, 19 Dec 2011 16:01:14 -0500
To: EDUCAUSE Listserv <CIO@LISTSERV.EDUCAUSE.EDU>
Subject: [CIO] Course Evaluation Forms

Dear Fellow CIO's,

I was wondering how many schools are still using paper Scranton forms for course evaluations. Saint Peter's College's faculty is resisting going electronic due to an expected lower return rate on responses. What I specifically want to know is:

Are you still using Scranton forms?

If not, what electronic system are you using and how many days to students get to fill out the form?

Has participation (or percentage of forms completed) decreased? By what percentage?

What incentives, if any, are you giving to encourage a higher percentage of participation?

Thanks so much for your response.

Dale Hochstein

CIO, Saint Peter's College, 104 Glenwood Avenue, Jersey City, NJ, 07306, W-201-761-7827,dhochstein@spc.edu

********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/groups/.

********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/groups/.

Posted by: kgates on December 20, 2011

1. The “official” course evaluation method is online, but faculty may use alternative evidence of teaching and learning.

2. We are using the online evaluation system offered by campuslabs (formerly Student Voice) at http://campuslabs.com/ . The evaluations are open for two weeks.

3. Overall response rate was 55% for the first offering this Fall, and varies greatly by instructor. For enrollments over 5 students, response rates varied from 20% to 100%. We will follow up with the faculty who had the highest response rate (50 of the 480 faculty had 90% or higher response rate). Faculty had the option of in-class completion with mobile devices and laptops.

4. Incentives, if any, are decided by individual faculty.

--

Joel A. Cohen, Ph.D.

Associate Vice President for Library and Information Services

Canisius College

Buffalo,NY 14208

Fax: 716-888-8420

Phone: 716-888-8410

Posted by: cohenja on December 21, 2011

Message from dthibeau@post03.curry.edu

Dale,

We never used Scantron forms for course evaluations, though we did/do use them for exams – mostly in our Nursing program.

· We still have a handful of faculty using Scantron Forms, though we have certainly try to discourage that and encourage them to use other web-based (LMS) testing methods. We find the Scantron forms to be too unreliable.

· We use the Blackboard LMS for testing, and most faculty seem to like it.

As for our course evaluations, we used to do paper forms, distributed and collected by someone other than the faculty member during normal class time. Competition rates were less than 50% due to (a) people missing the one class in which they were given out (b) people who simply didn’t bother to do it –even though it was administered while they were in the room. In 2006 we started using a web-based system that loaded the results into our ERP system. It was tied to HOLDs on the student account which prevented them from seeing their grades until they were all completed. The return rates improved dramatically as soon as we started using the on-line approach. Completion rates jumped to 81.4% the first term, and within 18 months they were at 90%.

Dennis

Posted by: listserv-anon on December 22, 2011

Greetings and happy holidays one and all!

Are you still using Scranton forms?

The majority of our evaluations are still completed via Scantron. However, for the past two terms, we have been piloting an on-line form with our School of Business.

If not, what electronic system are you using and how many days to students get to fill out the form?

We are using our research management tool, Qualtrics for the pilot. We embed the survey within Blackboard for each Business class.

Has participation (or percentage of forms completed) decreased? By what percentage?

I’m told by the school that the response rate has remained static.

What incentives, if any, are you giving to encourage a higher percentage of participation?

I believe that students were awarded extra credit.

Best regards,

Art

Arthur J. Fridrich

Director of Strategic Management Services and Interim Director of Application Services

Technology Services

Virginia State University

1 Hayden Drive

Petersburg, VA 23806

Office (804) 524-5305

Google Voice (804) 504-1415

afridrich@vsu.edu

Change has a considerable psychological impact on the human mind. To the fearful it is threatening because it means that things may get worse. To the hopeful it is encouraging because things may get better. To the confident it is inspiring because the challenge exists to make things better.

King Whitney Jr.

“The information in this email and any attachments may be confidential and privileged. Access to this email by anyone other than the intended addressee is unauthorized. If you are not the intended recipient (or the employee or agent responsible for delivering this information to the intended recipient) please notify the sender by reply email and immediately delete this email and any copies from your computer and/or storage system. The sender does not authorize the use, distribution, disclosure or reproduction of this email (or any part of its contents) by anyone other than the intended recipient(s).

No representation is made that this email and any attachments are free of viruses. Virus scanning is recommended and is the responsibility of the recipient.”
********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/groups/.

Posted by: theoldman on December 22, 2011

Dale:

Here at TLU, the university went online about 7 years ago with a “home-made” system. Online responses averaged in the 70-77% range. Recently we switched to CourseEval because maintaining and changing our own became onerous plus CourseEval had integrationt for our portal as a plug-in and was very noticeable to the students each time they logged in. In the 2 semesters we have used it fully, response has been 81% and 82%. Some of our faculty remind students in class (along with the automated reminders), others give extra credit, and others require it be done to take the final. We give students 10 days to complete the evaluations and grades are not available until the survey is closed (per the faculty). As to how much better or worse than the paper forms, I can’t tell you for certain as I was not here when they made the switch. I can tell you that the resistance you are seeing was seen here but since then it has not been an issue.

Regards,

Bill

William R. Senter

Director of Information Technology

Texas Lutheran University

wsenter@tlu.edu

Posted by: w.senter on December 27, 2011

Message from ppettit@mail.millikin.edu

We changed to online evaluation forms two years ago (adapted a survey tool that integrates with our ERP, Banner) and our rate of completion has fallen for many of our faculty since then or at least they think it has. We do not have accurate data about the rate of completion before going online. We used to use scantron sheets that were distributed to students during a class period and collected by a proctor then processed and it would take several weeks to produce results. Even though the online completion rates are lower for some faculty, they have commented that students are more complete in their responses and thoughtful in commenting on the course and instruction.

We are going to implement a more persistent communication strategy for the next semester that alerts students about evaluations through our portal. We hope that by "hounding" them with pop ups and alerts, they will be more responsive. Our faculty and VPAA believe that withholding grades until evals are filled out is too egregious and worry that it would affect the evaluations negatively if implemented.

Pat Pettit, Director of Information Technology, Millikin University

1184 W. Main Street

Decatur, IL 62522

217-362-6488

ppettit@millikin.edu

CONFIDENTIALITY NOTICE: This message along with any included attachments may contain information that is confidential and privileged. Unless you are the addressee (or authorized to receive for the addressee,) you may not use, copy, or disclose to anyone any information contained in this message. If you have received this message in error, please notify the sender and immediately delete the message and any attachments. Thank you for your cooperation.

>>> Kathy Gates <kfg@OLEMISS.EDU> 12/20/2011 4:14 PM >>>

We have had an online process for entering evaluations and viewing evaluations for many years - see http://www.educause.edu/Resources/DotCOMMeetsDotEDUGivingLifetoO/155737 for a presentation we made in 2004 on our process. We have added several enhancements since then. For example, the forms are now generated dynamically and the questions customized based on course characteristics such as lecture, ensemble, online, lab, law, etc. We used to do evals only for fall and spring terms, but now we do them for all terms. We offer several incentives including letting students register a day early for the next fall or spring term and viewing final grades early. The ability to view final grades early actually helps us by splitting up the stampede of traffic on our portal. Last year, we added auto-alerts telling students that it is time to enter evaluations and then thanking those who entered 100% of their evals and reminding them that they will be able to view final grades early. We give students a "last chance" to enter evals before they view their final grades. In the "last chance" logic, they are required to complete at least 50% of their evals if it is X days since final grades became available. We have tried to create a culture in which students understand that teacher evaluations are important and that the info is actually used.

The best thing about going to online entry is that students provide more meaningful and detailed narrative comments. After all, it feels kind of like blogging vs. writing comments with paper and pencil. The quantitative results (summary) and one narrative question, "What do you want other students to know about your experience in this class?," are available to everyone on our intranet. The remaining narrative questions are only available to the instructor and his/her reporting line. We offer comparison reports for department chairs and deans. For the first several years of going to this process, an Associate Provost (Dr. Maurice Eftink) and I made presentations to our faculty senate on the changes, if any, in responses. Now the process is pretty much accepted.

PS. My son is a junior here, and he was proud this semester to have made an A in a course that was described as "a GPA killer" in teacher evaluation results (the narrative question that is available to students).

From: Dale Hochstein <dhochstein@SPC.EDU>
Reply-To: EDUCAUSE Listserv <CIO@LISTSERV.EDUCAUSE.EDU>
Date: Mon, 19 Dec 2011 16:01:14 -0500
To: EDUCAUSE Listserv <CIO@LISTSERV.EDUCAUSE.EDU>
Subject: [CIO] Course Evaluation Forms

Dear Fellow CIO's,

I was wondering how many schools are still using paper Scranton forms for course evaluations. Saint Peter's College's faculty is resisting going electronic due to an expected lower return rate on responses. What I specifically want to know is:

Are you still using Scranton forms?

If not, what electronic system are you using and how many days to students get to fill out the form?

Has participation (or percentage of forms completed) decreased? By what percentage?

What incentives, if any, are you giving to encourage a higher percentage of participation?

Thanks so much for your response.

Dale Hochstein

CIO, Saint Peter's College, 104 Glenwood Avenue, Jersey City, NJ, 07306, W-201-761-7827,dhochstein@spc.edu

********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/groups/.

********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/groups/.

Posted by: listserv-anon on January 4, 2012

Main Nav

Publications

Research

Major Conferences

Online Events

Special Topic Events

Events for all Levels and Interests

Career Center

Leadership and Management Programs

Fellowships and Awards

Getting Involved

Jump Start Your Career Growth

Latest Topics

EDUCAUSE organizes its efforts around three IT Focus Areas

Join These Programs If Your Focus Is

From the Blogs

Find Others

Share Ideas

Get on the Higher Ed IT Map

2013 Strategic Priorities

Membership

Who We Are

Stay Informed

Uncommon Thinking for the Common Good™

Course Evaluation Forms

Comments

Recommend

Research and Publications

Conferences and Events

Career Development

Focus Areas and Initiatives

Connect and Contribute

About EDUCAUSE

Publications

Research

Major Conferences

Online Events

Special Topic Events

Events for all Levels and Interests

Career Center

Leadership and Management Programs

Fellowships and Awards

Getting Involved

Jump Start Your Career Growth

Latest Topics

EDUCAUSE organizes its efforts around three IT Focus Areas

Join These Programs If Your Focus Is

From the Blogs

Find Others

Share Ideas

Get on the Higher Ed IT Map

2013 Strategic Priorities

Membership

Who We Are

Stay Informed

Uncommon Thinking for the Common Good™