IoT Bought Me This Big Data and All I got Was an Unused Data Lake

Cover of the new big data issue. (Image courtesy of IEEE.)

There’s a lot to talk about when it comes to big data from the Internet of Things (IoT), and we’re not the only ones who think so. Proceedings of the IEEE has published the second of its two special issues focusing on big data, with this issue consisting of seven papers on the practical applications of big data.

Here’s a quick overview of the big data applications under discussion in the issue:

  • Big Data Analysis for Media Production: This paper discusses the massive quantities of data accumulated through the production of films and other video media. This data takes the form of camera footage and other information from film sets, and the paper outlines solutions for integrating this data to simplify the post-production process.
  • Parallel Processing Systems for Big Data: A Survey: This paper outlines current systems for parallel data processing, and includes a discussion of open issues for big data processing.
  • Classification of Big Data With Application to Imaging Genetics: This paper suggests that traditional data processing techniques aren’t suited to big data applications, especially in the field of medical imaging and genetics. The authors propose a new procedure for classifying certain data sets based on linear discriminant analysis (LDA).
  • ‘Big Data Assimilation’ Toward Post-Petascale Severe Weather Prediction: An Overview and Progress: This paper discusses the implications of big data for weather prediction, asserting that current data assimilation (DA) and numerical weather prediction (NWP) systems aren’t up to the task. The paper discusses the big data assimilation (BDA) project, which has been proposed to solve this problem.
  • Going Digital: A Survey on Digitalization and Large-ScaleData Analytics in Healthcare: This paper outlines the changing landscape of health-care analytics and the goals of more effective treatments and better patient outcomes.
  • Big Data for Remote Sensing: Challenges and Opportunities: This paper outlines the use of Earth observation (EO) sensors for applications such as climate science, oil spill detection and urban planning, and includes a discussion of the titular challenges and opportunities brought forth by big data EO advancements.
  • Some Comments on the Analysis of ‘Big’ ScientificTime Series: This paper discusses some of the limitations of using statistical procedures in analyzing big data from interplanetary and geographic sources. One of the interesting conclusions reached by the authors is that “all data measured on Earth are influenced by the normal modes of the Sun.”

The first special big data issue of Proceedings of the IEEE, published in January 2016, focused on the theoretical aspects of big data. With this second special issue, the publication concludes what it considers to be a timely foray into the questions of big data.

“It is of interest to note that big data and the Internet of Things (IoT), representing the two sides of the same coin, reinforce each other,” write the guest editors in their preface to this special issue, “all the more recognizing that we are well and truly in the fourth industrial revolution.”


You can read this issue of Proceedings of the IEEE here. To learn more about the applications of big data, read What Can Big Data Do for Manufacturing?