Big Data

Main Nav

What is “big data”? Who’s doing it? Why is the higher education community so interested in it?

According to Wikipedia, “‘Big data’ is a term applied to data sets whose size is beyond the ability of commonly used software tools to capture, manage, and process the data within a tolerable elapsed time. Big data sizes are a constantly moving target, as of 2012 ranging from a few dozen terabytes to many petabytes of data in a single data set.”

Currently, big data is most commonly used by businesses and will become the “key basis for competition,” according to the McKinsey Global Institute’s May 2011 report “Big Data: The Next Frontier for Innovation, Competition, and Productivity.” They point out five ways that big data can create value. And while this new abundance of data will help businesses make data-driven decisions and enhance target marketing of products to consumers by using data to identify pregnant women, for example (see “How Companies Learn Your Secrets,” New York Times, February 16, 2012), we are still in the early stages of data collection. While many are excited by the challenge of exploring and analyzing the abundance of collected data and applying it to improve daily interactions, others are leery of where this data explosion could lead. In “The Future of Big Data,” a recently published report by the Pew Research Center’s Internet & American Life Project, experts provide varying viewpoints on the use of big data and the future. Businesses are the most enthusiastic in their use of big data, but the federal government is also jumping on the data train. The Obama administration has issued plans to dive into the big data pool with a $200 million initiative spanning six federal departments in the hopes of “improving our ability to extract knowledge and insights from large and complex collections of digital data, the initiative promises to help solve some the Nation’s most pressing challenges.” If the federal government can manage such massive data collections and successfully promote this undertaking, this should motivate other areas of society to take up the challenge of using large data sets to improve various industries and the lives of their consumers.

Higher education is just beginning to explore how to leverage the massive amounts of data it collects to improve the student experience. In his article “The Rise of Big Data,” Louis Soares explains that giving students an opportunity to see their data “in useful ways…can allow students to become better managers of their own educational experiences and can also, perhaps, improve collective outcomes across all of higher education.” Students are starting to see that data and use it to their advantage to keep themselves on track academically, as discussed in an EDUCAUSE 2011 session, “Course Signals: A Student Success System/Stoplights for Student Success.” As we find ourselves in a vast wonderland of data gathering and analyzing in higher education in the next few years, it will be exciting to see how big data can meet the promise of reducing institutional costs, increasing college affordability, and improving student retention and completion.

EDUCAUSE Staff Picks

“The Rise of Big Data in Higher Education,” EDUCAUSE Live!, March 2012

Understanding and Managing the Risks of Analytics in Higher Education: A Guide, EDUCAUSE, June 2012

“Scientific Research: How Many Paradigms?” EDUCAUE Review, June 2012

Library Items on this Topic

View All

EDUCAUSE Library Items for Big Data

Showing 1 - 10 of 18052 Results

Sort by:

Relevancy |

Title | Date

: January 1, 2013 File: Session Slides …
$30K Tuition: What Does It Buy from IT? (At Rice, a Lot!): November 6, 2009 | A session at the EDUCAUSE 2009 Annual Conference
Undergraduates arrive at Rice, a moderately expensive campus, with highly customized laptops and elevated expectations for services. We welcome them with covert training, market best practices with…
$500 Million in Higher Ed. Grants Involving OER Announced: September 21, 2012

Earlier this week, the U.S. Department of Labor announced the college and university winners of its second-round grants under the Trade Adjustment Assistance Community College and Career Trai…
'Blatant Copying' in Coursework: January 1, 2005

Examiners for British standardized tests are reporting increasingly obvious examples of cut-and-paste cheating on exams, a problem they attribute both to student behavior and to excessive help from…
'E-Mail Wiretapping' Prosecutions Could Increase in the Future: January 1, 2005

"A federal appeals court ruling in Boston last week on e-mail wiretapping is reverberating throughout the Internet community—and legal world—with a consensus emerging that there may be pro…
'Evil Twin' Fear for Wireless Net: January 1, 2005

Researchers at Britain's Cranfield University are warning users of wireless computing devices about bogus Wi-Fi access points that can steal personal information. The so-called evil twin hotsp…
'Follow the Money' and Other Unsolicited Advice for CIOs: January 1, 1999

Gregory Jackson, Associate Provost at the University of Chicago, offers advice to senior information technology administrators in higher education. Gre…
'Morphing' Community Colleges: April 7, 2009

With some offering bachelor's degrees and others building dorms or creating campuses for businesses, institutional leaders consider how to define missions and emphasize the associate degree.…
'Piracy': February 3, 2010

In a new book, Piracy: The Intellectual Property Wars from Gutenberg to Gates (University of Chicago Press), Adrian Johns details the long history of the term and its battles, arguing tha…
'Smart Computing' -- Orienting Your Students: January 1, 1999

The Office of Policy Development and Education participates in summer orientation to properly introduce students to proper use of information technology resources at the University of Michigan. Thi…