Forecasting the Flu Through Combo of 'Big' and Traditional Data

Three UC San Diego researchers say they can predict the spread of flu a week into the future with as much accuracy as Google Flu Trends can display levels of infection right now. The study - appearing in Scientific Reports, an online journal from the publishers of Nature - uses social network analysis and combines the power of Google Flu Trends' "big data" with traditional flu monitoring data from the Centers for Disease Control and Prevention (CDC).

"Our innovation," says corresponding author Michael Davidson, a doctoral student in political science at UC San Diego, "is to construct a network of ties between different U.S. health regions based on information from the CDC. We asked: Which places in years past got the flu at about the same time? That told us which regions of the country have the strongest ties, or connections, and gave us the analytic power to improve Google's predictions."

Google Flu Trends (GFT) is very good, Davidson says, at showing where in the U.S. people are searching for information on flu and flu-like symptoms. And these data are valuable because they come in real time, he said, about two weeks ahead of when the CDC can issue its reports. But GFT has also made some infamous errors - errors that probably reflect widespread public concerns about flu more than actual confirmed illness.

By weighting GFT predictions with a social network derived from CDC reports on laboratory-tested cases of flu, the researchers were able to refine and improve GFT's predictions.

The researchers are optimistic their work will soon be put to public use. "We hope our method will be implemented by epidemiologists and data scientists," Davidson says, "to better target prevention and treatment efforts, especially during epidemics."

Davidson's co-authors are Dotan A. Haim, who is also a political science graduate student at UC San Diego, and Jennifer M. Radin, of the UC San Diego/San Diego State University Joint Doctoral Program in Public Health.

The study was funded in part by the Robert Wood Johnson Foundation and the James S. McDonnell Foundation.

Source: University of California, San Diego