Data is ubiquitous. In the area of heath, there are growing data streams directly initiated by patients through their activities on the internet and on social networks and other related ones such as electronic medical records and pharmacy sales data. These so-called Novel Data Streams (NDS) are very appealing to public health surveillance officials due to their ease of collection. A new paper published in EPJ Data Science evaluates the currently available NDS surveillance papers before outlining a conceptual framework for integrating such data into current public health surveillance systems. The authors, who hail from public health agencies, academia, and the private sector, highlight the need for future rigorous evaluation and validation of standards before NDS can effectively reinforce existing public health surveillance systems.
NDS encompass a broad set of sources, from internet search data to social media posts to Wikipedia access logs, even restaurant reservations and reviews and news sources, according to co-lead author Benjamin Althouse from the Santa Fe Institute in New Mexico.
A well-known example of health surveillance systems based on NDS is a web application called Google Flu Trends developed in 2008. It estimates the number of individuals with influenza-like symptoms who visit their doctor on the basis of Google searches. Despite its initial success, the system was later criticized for not being able to accurately deliver predictions across different influenza seasons.
Nevertheless, thanks to NDS, surveillance systems could soon be nearly instantaneous and deliver on very fine geographic scales, according to Samuel Scarpino, the other co-lead author from the Santa Fe Institute.
NDS could also extend surveillance to places with no existing systems and improve the dissemination of relevant data. And they could potentially measure unanticipated events, such as syndromes associated with new pathogens not currently under surveillance. However, NDS-based approaches can only be adequately vetted following collaborations between academic researchers, the private industry, and public health officials.
Reference: Althouse BM, et al. (2015), Enhancing Disease Surveillance with Novel Data Streams: Challenges and Opportunities, European Physical Journal Data Science, 4 :17, DOI: 10.1140/epjds/s13688-015-0054-0