![]() |
|
![]() |
![]() |
|
EDUCAUSE Quarterly
|
![]() |
Using the PAIR-up Model to Evaluate Active Learning SpacesUsing the PAIR-up Model to Evaluate Active Learning Spaces
Amidst the evolving IT infrastructure and new space and course design principles, higher education has elevated the conversations around the importance of how and where people learn.1 In Michael Wesch’s Spring 2007 Introduction to Cultural Anthropology class at Kansas State University, students trapped in a 19th century-like higher education learning environment created a video to illustrate what their walls would say if they could talk. How we build “these classroom walls” was a crucial conversation at the recent EDUCAUSE Learning Initiative September 2008 Fall Focus Session. Attendees probed how today’s emerging technologies, diverse learners, strategic campus issues, new course and space design methods, and new learning science findings have created new opportunities for the design of learning spaces. As experts led discussions throughout the two-day session, a key theme emerged: It is critical to PAIR-up to design learning spaces. That is, as we work on designing new learning spaces it is critical to:
At the University of Minnesota, two central units did exactly that. The Office of Classroom Management (OCM) and the Office of Information Technology PAIR’ed-up to assess how learning is impacted in new learning spaces. OCM successfully integrates all general classroom-related issues into one accountable office. As the single point of contact for more than 300 classrooms and 22,000 student seats in 55 buildings, OCM is responsible for the university’s course database and scheduling, as well as facilities coordination, technology, support, design/standards, coordination, planning, and operations in all central classroom learning spaces. The synergy that routinely occurs among OCM functional units, close daily contact with teaching faculty, and the constant challenges of designing and accomplishing an average of 70 learning space projects annually have fostered a future-focused view of classrooms that in turn produced the Active Learning Classroom (ALC) pilot initiative. The pilot initiative built two new demonstration classroom spaces that allowed for flexible construction techniques and promoted active learning. OIT serves as a catalyst for innovatively leveraging technology to advance and support extraordinary education, breakthrough research, and dynamic public engagement. OIT manages a diverse range of learning spaces, including learning studios, training and seminar facilities, student computing classrooms, and a state-of-the-art Usability Lab. For the 38 campus-wide student computing classrooms alone, OIT administers more than 1,200 microcomputers. OIT also provides over 100 individual computing kiosks with Internet connectivity. Additionally, OIT designed new innovative, student-centered Tech Stop technology centers that allow walk-in consultations and assistance. This set of robust services and spaces positions OIT well as a campus leader that readily serves the various needs of administrators, faculty, staff, and students both inside and outside the classroom. Additionally, the OIT’s Digital Media Center (DMC) advances the thoughtful application of digital technologies by faculty, staff, and students through research, design, training, programs, professional development, consultation services, and evaluation services. One specific service, Research and Evaluation Services, designs and conducts research projects related to the use of educational technology at the University of Minnesota, often in collaboration with faculty and other staff members. In spring 2007, OCM asked OIT to PAIR-up and share expertise from the Research and Evaluation Services team to evaluate and learn about instructor and student attitudes and expectations regarding the teaching and learning in these new ALC spaces as well as how the spaces were used. Read on to learn more about the ALCs, role of the ALC Pilot Evaluation Team, specific research questions and methods, key findings, and future recommendations. About the Active Learning ClassroomsIn 2006, OCM explored two major threads in conceptualizing future designs that would respond to emerging requirements of teaching and learning in University of Minnesota classrooms: The first was the need to include space flexibility in classrooms as a high priority in renovation and construction projects, using flooring and wall-system technologies that were increasingly used in industrial, lab, and commercial applications. The second was recognition of the potential value of a new, collaborative, more student-centered classroom model exemplified by Professor Robert Beichner’s development at North Carolina State University of the SCALE-UP (Student-Centered Active Learning Environment for Undergraduate Programs) classroom2 and the TEAL (Technology Enabled Active Learning) project at the Massachusetts Institute of Technology. Planning and design work followed for what was initially called the U of M “Future Flexible Classroom,” and later the “Active Learning Classroom.” The idea for a pilot project emerged as a valuable way to demonstrate the viability of the new construction technologies to university capital-planning officials and senior administrators, and to allow necessary vetting and approval by university building code officials. OCM also recognized that the pilot would be of great interest and benefit to faculty and students who were interested in the unfolding active learning classroom concept. Selection of appropriate candidate spaces followed, which was a difficult process constrained by availability, physical factors, location, renovation potential, and building-level cost issues. Two pilot project classrooms were identified for separate sequential renovation projects. The first was a 36-capacity fixed-bench classroom in the Twin Cities Minneapolis campus Electrical Engineering/Computer Science (EE/CSci) building. The second was created by merging two existing general classrooms and one Biology computer lab into one classroom in the Biological Sciences Center (BioSci) building on the St. Paul campus.
EE/CSci 2-260 and BioSci 64 before renovation Photos courtesy of University of Minnesota Office of Classroom Management Funding was obtained by combining planned life cycle, replacement, technology upgrade, and other funds from the multiple rooms involved. During spring and summer 2007, the General Purpose Active Learning Classroom initiative constructed two pilot project classrooms that are designed as student-centered, integrated, flexible, active learning spaces — Electrical Engineering/Computer Science (EE/CSci) 2-260, which seats 45, on the East Bank and Biological Sciences Center (BioSci) 64, which seats 117, on the St Paul campus.
EE/CSci 2-260 and BioSci 64 after renovation Photos courtesy of University of Minnesota Office of Classroom Management Goal for the ALCs: To create a student-centered space that supports active learning using flexible design and innovative construction techniques that allow instructors and students to experience new classroom designs and experiment with different teaching and learning strategies. The ALC pilots were intended to stimulate interest in innovative classroom design, to demonstrate flexible classroom construction techniques, and to allow assessment of learning outcomes. For more information on the two rooms following renovation, watch UMN's quicktime video and see the sidebars on Active Learning Classroom EE/CSci 2-260 and Active Learning Classroom BioSci 64. The ALCs emerged in fall 2007 from renovation as a pilot project to support active engagement of both instructors and students. The rooms are modifications of the original SCALE-UP and TEAL designs and are built upon the technology foundation of the University of Minnesota Projection Capable Classroom (PCC) standard. This classroom technology standard was implemented in 2000 by OCM in close coordination and collaboration with the University of Minnesota Twin Cities campus community. Today, the laptop-based PCC standard is a proven success in 285 University of Minnesota general-purpose classrooms and more than 125 other instructional spaces. The control systems in the ALCs use variants of the same user-friendly PCC operator protocol with which teachers are familiar all over campus, with additional modules and capability for the added switching and functionality. Both ALCs are covered by the University of Minnesota’s campus-wide wireless network, which includes over 1,700 wireless access points. As a fundamental part of its design, the PCC-based ALC is predicated on student-provided laptops or computing devices. The ALC design looks forward to the time when “person-based” mobile computing overtakes room-based installed computing infrastructure in many classroom situations. The rapid increase in person-based mobile computing using laptop/notebook/netbook/browser-equipped cell phone devices is increasingly apparent, fueled by both technology development and convergence. Therefore, the ALC design does not provide installed student computers or laptops. Instead, the design emphasizes the use of the classroom’s basic tech infrastructure using campus-wide standards, interfaces, and protocols, to provide seamless and user-friendly integration of student-provided devices, along with the ability to project and share both student and teacher information. The ALC classroom design assumes that in the future there will be an institution-wide personal computing solution and that student personal computing devices will become as ubiquitous as are cell phones today. However, it is recognized that while a number of individual departments and programs currently have student laptop standards, the university today does not have such a standard for all students. The campus remains in transition to this future of person-based computing. In support of the ALC pilot initiative, OIT and OCM engaged in a laptop initiative/partnership to provide student laptops as an interim solution in ALC pilot classrooms. This laptop initiative/partnership provides temporary transitional support and will accommodate as many requests as possible, subject to resource constraints and other requirements. In the OIT Laptop Initiative, OIT technicians deliver the laptops at the beginning of class and pick them up at the end of class. In addition, technicians re-image the laptops regularly, which helps protect them from security issues. Future plans include additional collaborations and partnerships with colleges, departments, and other units to ease the transition to more person-based devices and to enhance the learning initiatives in ALCs. The ALCs feature large, round tables that seat nine students each in teams of three. Three switchable laptop connections at the table allow the students to select which laptop displays on the adjacent 42- or 50-inch wall-mounted LCD. The instructor at the podium can select any table display for projection on the room’s large dual display screens as well as selecting any specific display on the large projection and student screens from an instructor station. These rooms also feature a 360-degree glass marker board around the circumference of the classroom. Both ALCs are covered by the University of Minnesota’s campus-wide wireless network. The ALCs are readily available for group and individual work before and after scheduled class time. Reflecting student preferences, the ALCs, especially the smaller 45-capacity room, have quickly become one of the most sought after and heavily used student study spaces on campus. In support of the important design objective of flexibility, the ALCs employ reconfigurable low-profile flooring with internal power and cable management to accommodate reconfiguring technology and wiring in the room. Demountable wall systems that meet the acoustic performance criteria in the university’s classroom standards allow the rooms to be reconfigured, saving renovation costs over the life cycle of the building. ALCs can be “flexed” on a semester basis to meet changing room size or teaching requirements. The larger space in BioSci (117 capacity) is divisible into two ALCs (72 and 36 capacity), or two traditional seating table/chair classrooms, or one ALC and one traditional classroom.
BioSci 64 flexed up with capacity for 117 and flexed down with two rooms and variable seating (one ALC and one traditional table/chair classroom) Diagrams courtesy of University of Minnesota Office of Classroom Management Classroom project costs were $147,000 for EE/CSci 2-260 and $269,000 for BioSci 64. These include all classroom AV and technology engineering, design, equipment, and installation plus furniture costs, and are representative for those contemplating similar projects. These costs do not include construction costs for permits/fees, electrical/lighting, wall/floor systems, construction, and abatement, which are highly variable depending on the specific building renovation scenario. The pilot classrooms stimulated lively discussion on campus regarding student-centered learning versus lecture-style teaching. Some faculty members were strongly in favor of retaining large lecture halls and did not embrace the changes that ALCs represent. The university responded by underscoring its commitment to changes in teaching and learning, such as the ALCs, while also noting that the large number and diversity of classroom types on campus, including 25 large lecture halls, provide for the wide range of teaching and learning needs of faculty and students. The University of Minnesota has just started site demolition and construction of a new Science Teaching and Student Services building, slated to open in fall 2010. The building includes 10 ALCs similar to the BioSci 64 design. ![]() Rendering of planned Science Teaching and Student Services building from a west elevation looking east. Rendering by Kohn, Pedersen, Fox Associates (KPF), courtesy of University of Minnesota Forming the ALC Pilot Evaluation TeamThe Office of Classroom Management partnered with the Digital Media Center to form the ALC Pilot Evaluation Team. This joint effort was designed to leverage OCM’s expertise in the physical, technology, and operational environment of the classroom with DMC’s expertise in faculty development, evaluation, assessment, and emerging academic technologies. OCM staff focused on the classroom, including all aspects of infrastructure, furniture, and technology. DMC staff focused on faculty development and support as well as the evaluation process, analysis, and results. Collaboratively, the team developed and implemented the evaluation plan for the ALC rooms, determined the faculty development and support services, and discussed emerging issues, such as pedagogical and technical support and technology needs. The ALC Pilot Evaluation Team conducted research to learn about instructor and student attitudes and expectations regarding teaching and learning in these new spaces, as well as how the spaces were utilized, the teaching strategies employed, and the technologies and room features used. The evaluation team met twice a month during fall 2007 and monthly during spring 2008 to discuss the research project. The value of partnership and leveraging expertise in this fashion cannot be overstated. Neither OCM nor DMC has the staff, depth of knowledge, resources, or mission to overlap the other’s areas of responsibility. However, the strengths of each organization are complementary. The partnership approach allowed a more rigorous assessment from faculty and student perspectives, and the emerging faculty development will benefit teaching outcomes at the university more broadly. In addition to the OCM-DMC evaluation partnership, OIT’s Customer Engagement team partnered with individual departments and faculty members teaching in the ALC rooms to provide computing devices for some students and courses in those rooms. Research Questions and MethodsAlthough the existing literature on learning spaces suggests that design features impact teaching and learning,3 few research studies support this assertion with evidence. To close this knowledge gap, the ALC Pilot Evaluation Team conducted a research study from September 2007 to May 2008 to learn about instructor and student perceptions regarding teaching and learning in these new spaces, including teaching strategies as well as the technologies and physical features employed. The ALC evaluation team determined the following research questions:
Results and Key FindingsTo answer these questions, Table 1 illustrates the research methods we employed, including instructor interviews, instructor surveys, student surveys, student focus groups, and classroom observations for fall 2007 and spring 2008. In fall 2007, the evaluation process involved distributing instructor and student questionnaires on the four courses taught in the ALCs. The response rate for the student questionnaire was 27.1 percent (n = 51) and the response rate for the instructor questionnaire was 100 percent (n = 4). Instructor interviews were conducted at the beginning of the semester (n = 3) and at the end of the semester (n = 2). In addition, classroom observations were conducted at the convenience of faculty (n = 13). In spring 2008, the evaluation process involved distributing both instructor and student questionnaires on the 11 courses taught in the ALCs. The response rate for the student questionnaire was 35.4 percent, and the response rate for the instructor questionnaire was 69.2 percent (n = 9). Instructor interviews were conducted at the beginning of the semester (n = 8) and at the end of the semester (n = 5). In addition, classroom observations were conducted at the convenience of faculty (n = 16). Table 1. Research Methods Employed
Question 1: Instructor Attitudes and ExpectationsWhat are faculty attitudes and expectations for the new learning spaces as they start the semester? Do their attitudes and expectations change over the term, and are they fulfilled? Data from the interviews and surveys suggests that faculty members held positive attitudes and high expectations before, during, and after the semester they taught in the ALCs. The key findings are as follows:
Question 2: Student PerceptionsHow do students perceive the new spaces? Are they comfortable in the new arrangements? How do the new spaces affect their relationships with their classmates? With their instructors? The key findings are as follows:
Question 3: Learning TechnologiesHow are the technologies used, both from faculty and student perspectives? What teaching/learning strategies were used, and how did the rooms facilitate or inhibit those strategies? Instructors used the PCC standard technology system to varying degrees, ranging from simply projecting DVD content to fully exploiting the available multi-source content, robust switching, and interactivity capabilities of the rooms. The student use of technology in the ALCs spanned the continuum from no technology at all to a full-fledged partnership with OIT with discipline-specific, resource-intensive software and laptops. For the departments and individual courses that engaged in the OIT Laptop Initiative, OIT technicians delivered the laptops at the beginning of class and picked them up at the end of the class and re-imaged them regularly, which help the computers’ security and allowed faculty to leverage the technology affordances in the ALCs to maximize their student learning outcomes. A key difference in student technology in the ALCs versus the TEAL or SCALE-UP rooms is the flat-panel display linked to each table, the ability of the students at that table to control switching of content to the display, and then the ability of the instructor to extend content from any student table to all displays and the projectors. Although the ALCs are physically located in the biological science and the engineering/computer science buildings, they are general-purpose classrooms open to the university community and used by a variety of disciplines. The ALCs are covered by the OCM technology, facilities, and support protocols common to all general classrooms. Additionally, the OCM/OIT partnership offered an initial welcome tour to the space and access to the optional OIT laptop support. Since the spaces were so novel, we had close relationships with the faculty members, which allowed us to continually meet their needs and challenges in a timely manner. A number of different teaching and learning strategies were used in ALCs across disciplines. Table 2 describes a few examples from the classroom observations conducted in the ALCs. Table 2. Instructional Strategies Used in ALCs
The key findings are as follows:
Question 4: Physical FeaturesIn what ways did the physical features, such as seating, sightlines, lighting, ventilation, acoustics, and power affect teaching and learning? Were any adjustments made by faculty in their teaching approach specifically in light of room design/function? If so, what was learned? If not, would they be willing to make adjustments of various sorts? The quantitative data in the student questionnaire about the physical features of the ALCs were very positive statistically. The faculty and students in these rooms offered a number of comments, suggestions, and recommendations to help improve these learning spaces in the future, such as the glass marker boards, the instructor station, and round tables. Both ALC pilot rooms were renovations that necessitated working around a number of design constraints, including structural support pillars that could not be removed, room dimensions, geometry, and building systems/infrastructure limitations. Note also that accessibility is an important factor in all University of Minnesota designs for learning spaces, as reflected in the University of Minnesota Construction Standards for Classrooms. The ALCs include a number of universal design and other accessibility elements, such as the ramped transition to the ALCs that provide a flat floor entry to the rooms, wheelchair-accessible student tables, a flip-up wheelchair-height laptop surface with an auxiliary control panel on the instructor podium, accessible switches, and other features. The key findings are as follows:
Conclusion and RecommendationsThe Active Learning Classrooms yielded very positive responses from faculty and students. More than 85 percent of students surveyed recommended the ALCs for their other classes. One student commented, “I think that the Active Learning Classroom is amazing! When I first walked in I was blown away by all of the technology. After spending classtime in the room for about a semester, I have grown to love it. I really enjoy having our own monitors so our team can all view the same information at the same time!” Another student mentioned, “I love this space! It makes me feel appreciated as a student, and I feel intellectually invigorated when I work and learn in it.” Likewise, each of the faculty participants interviewed expressed a desire to continue teaching in the ALC: “I loved it. I can’t imagine teaching in a different place. It was just special — a wonderful class — a wonderful experience.” Faculty and students overwhelmingly found that this space made a difference for them. The ALC Pilot Evaluation Team carefully reviewed the data from the study and provided the following recommendations from the study:
In addition to these recommendations, the ALC Pilot Evaluation Team and other key university stakeholders began to talk about broader institutional issues that emerged from this research study. The team learned that if the ALC walls could talk, they would say students felt “intellectually invigorated” and faculty loved to teach in the ALCs. These discussions revealed a number of other emerging themes and possible research questions in the broader scope of learning spaces:
To begin to address these emerging themes, we recommend moving from studying perceptions, attitudes, and expectations to researching student learning outcomes and engagement issues.4 In this regard, we recently applied the PAIR-up model in teams that include tenured faculty, research experts, and undergraduate researchers. In these teams, we explored the relationships, if any, among formal and informal learning spaces, teaching and learning practices, and student learning outcomes. Using traditional and innovative research methods in an Archibald G. Bush grant extension, we examined three case studies of undergraduate courses in different disciplines across campus ranging in size from 22 to 117 students. A complete analysis of this study will be available in summer 2009. We intend to continually innovate our research around formal and informal learning spaces until we find solutions to the difficult questions that you, your colleagues, and your constituents encounter every day. Additionally, since learning does not start or stop at the classroom door, the formal learning spaces designed and developed by the offices of Information Technology and Classroom Management function and serve as student study spaces both inside and outside of the classroom. The concept of space is not as rigid and static as it once was — space today is more fluid and flexible. This flexibility, coupled with the increasing emergence of ubiquitous student mobile computing devices will further blend formal and informal learning spaces on campus. Finally, as students use their mobile devices within the wireless cloud of our campus spaces, colleges and universities need to define a roadmap to help their campus community address the technical infrastructure, support issues, and services needed for future mobile learning, research, and engagement environments. A recent survey by the Pew Internet & American Life Project predicts that, by the year 2020, most people across the world will be using a mobile device as their primary means for connecting to the Internet. The 2009 NMC New Horizon Report states: Mobiles are already in use as tools for education on many campuses. New interfaces, the ability to connect to wifi and GPS in addition to a variety of cellular networks, and the availability of third-party applications have created a device with nearly infinite possibilities for education, networking, and personal productivity on the go; almost every student carries a mobile device, making it a natural choice for content delivery and even field work and data capture. (p. 9) To help define and determine the relationships, processes, and strategies needed at the University of Minnesota to support the rapid, ever-changing mobile computing world, OIT is currently applying the PAIR-up model to established a Mobile Initiative that works in partnership with colleges, other central units, and coordinate campuses to provide leadership in this area and to define a roadmap for the university community that addresses the present and future infrastructure and support needs and issues. In closing, elevating campus conversations and initiatives at the intersection of mobile devices, learning spaces, and learning science ensures that 21st century higher education institutions provide learners with a diversity of well-designed learning environments. It will be critical to PAIR-up to design these learning environments. As mobile/person-based computing devices become more pervasive, it will be critical to understand the need for diverse learning environments, to design learning activities that integrate the affordances of mobile technologies, and to ensure we prepare faculty and students for these future learning environments. Endnotes
© 2009 Aimee L. Whiteside, Linda Jorn, Ann Hill Duin, and Steve Fitzgerald. The text of this article is licensed under the Creative Commons Attribution-NonCommercial-Share Alike 3.0 license. |
![]() |
||||||||||||||||||||||||||||||||||||||||||
| Unless otherwise noted, EDUCAUSE holds the copyright on all materials published by the association, whether in print or electronic form. In certain cases the work remains the intellectual property of the individual author(s) (see Special Circumstances). Content from conference speeches, presentations, blogs, wikis and feeds reflect the opinions of the author, and not necessarily those of EDUCAUSE or its members. | |||||||||||||||||||||||||||||||||||||||||||||