IoT Analytics

IoT analytics flow. Source: Gosalvez 2016.
IoT analytics flow. Source: Gosalvez 2016.

IoT analytics involves analyzing data coming from the Internet of Things (IoT) and deriving useful insights from this data.

IoT analytics is usually discussed within Industrial IoT (IIoT). Data is collected from manufacturing infrastructure, meteorological stations, smart meters, delivery vans, and various sensors on all types of machines. IoT analytics can also be applied to retail and healthcare sectors. Data can be in different formats such as video feeds, geolocation data, social media data, or log files. Given the different types of information sources, data integration can be very difficult. This is exactly where IoT analytics makes a difference.

Discussion

  • Could you showcase IoT analytics with some examples?

    By adopting IoT for monitoring, control and automation, Deep Sky Vineyard improved efficiency. By optimizing farming schedules, labour efficiency increased by 30%. Crop efficiency increased by 50% by reducing loss due to rotting, etc. Water flow and soil moisture are monitored to achieve consistent yields and quality.

    Siemens Healthineers applied IoT to detect anomalies in x-ray tube production using multivariate time series. Specifically, they determine the quality of liquid metal bearings. They're also able to identify how much each variable contributes to the anomaly.

    Audi's Neckarsulm factory does 5 million welds per day. Manual inspection of weld quality is expensive. Voltage and current data from welding gun controllers are collected. These are combined with data on weld configuration, metal types, and electrode health. Audi does analytics at the edge on Intel hardware to warn of possible faulty welds.

    British oil and gas company BP fitted many of its wells with 20-30 GE sensors. Temperature, pressure and other parameters are measured. Each well sends 2 million data points per minute to GE's Predix cloud platform. This data helps BP predict well flows and useful life of a well, and see fleetwide performance.

  • How does IoT analytics differ from traditional analytics?
    Unique traits of IoT data and analytics. Source: Pettey 2016.
    Unique traits of IoT data and analytics. Source: Pettey 2016.

    Traditional analytics is done on structured data. IoT devices generate unstructured data. Data have different formats and are not standardized. Because sensors are affected by physical process and randomness, data may contain missing points, corrupted messages, and incorrect readings. This is unlike data entered by humans or scanned from forms.

    Traditional data systems don't change that often. For example, when filling a form many fields have a predefined range. IoT systems are more dynamic. Device IP addresses may change. Devices may be upgraded. New devices may be installed with better capability. Environmental conditions may affect sensor accuracy or precision.

    IoT data often comes in real-time. Many applications also require real-time analysis and insights. In fact, it's been said that much of IoT data becomes stale and useless if not analyzed immediately. Deciding whether to give someone a loan based on analysis of past behaviour is non-real-time traditional analysis. But to know available parking spaces requires IoT analytics in real-time.

  • What does it mean to state that IoT data needs context?
    Azure Digital Twins plugin for Azure Data Explorer enables greater context to IoT data. Source: Anderson 2021.
    Azure Digital Twins plugin for Azure Data Explorer enables greater context to IoT data. Source: Anderson 2021.

    Raw data collected by sensors is called content. It's value can be enhanced by bringing in context, which is about associating a data stream with other data streams and business goals.

    Analysis on any device's data stream can be enhanced by combining it with other related data streams. Relationships across data sources can be modelled digitally. These relationships become useful when we run analytics queries. In the figure, a household's power consumption from the grid is enhanced by including all other households on that street or all households fed by the same power station. These multiple streams are used to more accurately interpolate missing data points or detect anomalies.

    Data collected by sensors on a machine on the factory floor can be enhanced with peak hours of machine use, yields, rejects, operator effectiveness, bottlenecks, material use estimates, and more. Another example is leak detection in oil pipelines. Context comes from integrating different types of data: pipeline inspection data, weather, dig reports, waterways, rain/flood zones, seismic activity, etc.

  • What's a typical process flow in IoT analytics?

    IoT analytics commonly adopts the following steps:

    • Data Collection: This step primarily comprises of data collected from various IoT sources including audio, image and light sensors. This heterogeneous nature of data raises the significance of IoT analytics technology.
    • Data Pre-processing: This step handles missing data, imports required libraries, encodes categorical data and does feature scaling.
    • Analysis of Data: This is mostly about exploratory data analysis that brings out summary statistics. It may suggest possible hypotheses and modelling approaches.
    • Train and Test of data: Data scientists build machine learning and deep learning models to suit business requirements. Models are trained from available data. With cross validation and online testing, the efficiency of the model is evaluated.
    • Deployment and Improvement: The tested model is deployed to deal with various real-world business problems.
  • What are the various types of analytics in IoT?
    Types of data analytics, applicable to IoT as well. Source: Vasudevan 2021.

    Descriptive analytics is the most basic form that allows users to describe and aggregate incoming IoT data. Descriptive analysis is as simple as calculating mean and standard deviation. It can be used to quickly understand the data being collected.

    Diagnostic analytics builds on the initial understanding provided by descriptive analytics. It seeks to explain why something happened in the past. It's really root cause analysis but based on data and powered by algorithms. Data discovery, data mining, data drill down and drill through are some useful processes.

    Predictive analytics looks at historical data to predict future events or behaviour. If a sensor starts showing data out of its usual range, this might indicate some fault. Predictive maintenance can be scheduled before things become worse. In an another example, a supplier can proactively analyse client inventory and do early or just-in-time delivery.

    Prescriptive analytics is used to optimize decisions for the future to achieve a certain goal. For example, it might suggest best operating conditions to maximize efficiency or uptime.

  • How is edge computing influencing IoT analytics?
    Introducing edge analytics. Source: Sony Professional Solutions Europe 2019.

    With edge computing some of the work is done at the edge of the network. This is where IoT connects the physical world to the cloud. Edge computing is more than just computation and data processing on IoT devices. An integral part of this is the powerful and seamless integration between the IoT and the cloud, between the physical world and the computational world. Edge computing applications use the computing power of IoT devices to filter, pre-process, aggregate, or evaluate IoT data.

    Some of the motivating factors for edge analytics are data privacy, latency and robustness. Some applications might permit processing of sensitive information only on devices. Applications that use image recognition may need low latency. Connectivity issues should not render applications unusable. All these are examples where cloud analytics may not be suitable.

    Healthcare has many examples of edge analytics. Portable MRI machines and image processing software enable real-time analysis at bedside. Insulin pumps obtain current sugar levels from sensors, use algorithms to predict future sugar levels and then deliver correct amounts of insulin.

  • What are some algorithms or techniques used in IoT analytics?
    Stream processing in AWS using Amazon Kinesis. Source: Gill 2021.
    Stream processing in AWS using Amazon Kinesis. Source: Gill 2021.

    IoT uses many ML/AI algorithms, selected to match the needs of each application. Classification, clustering, estimation, denoising, and feature selection are some of these. Time-series analysis is an important technique. This can be time-series statistical analysis, data mining or search. One technique breaks data into chunks and uses incremental algorithms. This mitigates high memory requirements.

    Edge computing mitigates large capacity requirements by distributing the processing and storage. Only some data that needs complex analytics or long-term storage go to the cloud. In some applications, only aggregates (sum, mean, min, max) are stored.

    When it comes to real-time insights, data is analyzed as it flows into the analytics platform. This is called streaming analytics. Raw data may be stored in a data lake. Processed data is usually stored in databases or data warehouses.

    Time-series data has its own customized databases: InfluxDB, Timescale, Prometheus, Redis, Kdb+, RRDtool, Amazon Timestream, and more. Moreover, IoT leverages many big data technologies including Apache Hadoop, Apache Spark, Apache Storm, SAP HANA, Apache Drill, and more.

  • What are the major industries influenced by IoT analytics?

    IoT analytics is playing an important role in manufacturing, retail, oil & gas and healthcare:

    • Manufacturing: This sector is defining the Industrial IoT (IIoT), Industry 4.0 and smart energy management. Machine learning, neural networks, and predictive methodologies are playing major roles. With these technologies, hidden trends, insights and correlations are established that help in strengthening the business structure.
    • Retail: IoT analytics in retail assist companies in providing a personalized experience to customers that turn them into repeat buyers. Data provides a contextual view about consumer preference.
    • Oil & Gas: Operational efficiency is improved and downtimes are reduced by fixing faults quickly or predicting impending failures. Analytics is also presenting new opportunities such as better pump designs, higher production, reservoir mapping, and more.
    • Healthcare: IoT analytics is unlocking valuable insights by analyzing data from various mobile devices and smart technologies such as sensors, heart rate monitors, thermometers and IVs. They help to gain a remote view of patients.
  • What are the major barriers to adopting IoT analytics?
    Frequency of challenges in IoT analytics as mentioned in 32 publications. Source: Zschörnig et al. 2020, fig. 1.
    Frequency of challenges in IoT analytics as mentioned in 32 publications. Source: Zschörnig et al. 2020, fig. 1.

    Data privacy is a concern for end users. Data from their devices may reveal personal information directly or via analytics. Those who collect the data don't always clarify how it will be stored, secured, shared or used.

    Since IoT deals with physical systems (building automation, self-driving cars), safety is a major concern. Buggy apps, malware or communication failures can causes systems to fail and put lives in danger.

    Real-time analytics itself is a challenge due to large volumes of data that demand fast processing and high amounts of storage.

    IoT as a whole is diverse and complex. The architecture spans low-end sensors to high-end servers, edge analytics to cloud storage. Many types of data come in. Various technologies and workflows are used. Interoperability is an issue. Integrating many parts into one effective solution is a challenge. People need to be trained and ecosystems have to mature.

    Regulations about data use are not transparent. The legal framework to handle data theft or misuse is also not mature.

Milestones

1968

At General Motors, Dick Morley introduces Programmable Logic Controller (PLC) in the automatic transmission manufacturing division.

1975

Honeywell and Yokogawa introduce the technology of Distributed Computing System (DCS). Control is distributed across the system. Backup redundancies are available. The system eliminates a singular point of failure in a central control room.

1999

RFID as a technology starts gaining wider adoption. In subsequent years, devices equipped with Near-Field Communication (NFC), barcodes, QR codes and digital watermarking start gaining adoption within the IoT technology.

2002

With the growing popularity of cloud technology, its integration with IoT technology starts experiencing a linear growth rate. Further, this synergy allows the storage of IoT-based data in the cloud. Analysis of the historical data unlocks hidden patterns, thereby leading to the development of OPC Unified Architecture protocol in 2006.

References

  1. Altizon. 2018. "How IoT Analytics is Transforming Four Major Industries." Altizon, August 20. Updated 2020-07-09. Accessed 2021-12-14.
  2. Amazon Web Services. 2018. "AWS IoT Analytics - How It Works." Amazon Web Services, on YouTube, April 24. Accessed 2021-12-14.
  3. Amazon Web Services. 2021. "AWS IoT Analytics: Analytics for IoT devices." Amazon Web Services. Accessed 2021-12-27.
  4. Amazon Web Services. 2021b. "Aggregation functions." User Guide, AWS IoT SiteWise, Amazon Web Services. Accessed 2021-12-28.
  5. Anderson, Taylor. 2021. "Adding Context to IoT Data Just Became Easier." Microsoft Tech Community, June 22. Accessed 2021-12-27.
  6. Banerjee, Snehasis, Tanushyam Chattopadhyay, Arpan Pal, and Utpal Garain. 2018. "Automation of feature engineering for IoT analytics." ACM SIGBED Review, vol. 15, no. 2, pp 24-30, March. doi: 10.1145/3231535.3231538. Accessed 2021-12-27.
  7. Bergey, Christopher. 2017. "Data context vs. content in an IIoT environment." IoT Agenda, TechTarget, November 2. Accessed 2021-12-27.
  8. Bock, Jon. 2018. "Solving the Challenges of IoT Analytics." Blog, Splunk, July 12. Accessed 2021-12-27.
  9. DataAnalyticsWiki. 2021. "IoT and Predictive Analytics." DataAnalyticsWiki, October 19. Accessed 2021-12-22.
  10. DataFlair. 2018. "8 Worst Barriers to IoT Adoption – Must Explore." DataFlair, June 14. Updated 2021-05-09. Accessed 2021-12-24.
  11. Davis, Megan. 2020. "What are the biggest barriers to IoT adoption today?" Blog, IOT TECH EXPO, Encore Media, April 14. Accessed 2021-12-14.
  12. Dilmegani, Cem. 2018. "IoT Analytics: Benefits, Challenges, Use Cases & Vendors." AIMultiple, April 13. Updated 2020-11-25. Accessed 2021-12-14.
  13. Gill, Navdeep Singh. 2021. "Understanding IoT Analytics Platform for Real-Time Data Ingestion." Blog, XenonStack, October 20. Accessed 2021-12-27.
  14. Google Cloud. 2021. "Deep Sky Vineyard: Pairing wine with the IoT." Google Cloud. Accessed 2021-12-27.
  15. Gosalvez, Victoria. 2016. "IoT Analytics: What Is That?" IoT Zone, DZone, July 28. Accessed 2021-12-22.
  16. Grizhnevich, Alex. 2018. "IoT Architecture: Building Blocks and How They Work." Blog, ScienceSoft, April 1. Accessed 2021-12-27.
  17. Hilton, Steven. 2018. "3 types of IoT platform analytics." Networkworld, IDG Communications Inc., November 26. Accessed 2021-12-22.
  18. Industrial Internet of Things. 2019. "Industrial Internet of Things (IIoT) and Industry 4.0 Solutions." Blog, Industrial Internet of Things, May 1. Accessed 2021-12-14.
  19. Intel. 2021. "Audi Industry 4.0 Manufacturing Transformation." Customer Spotlight, Intel, July 19. Accessed 2021-12-27.
  20. Kimachia, Kihara. 2021. "5 Examples of IoT and Analytics at Work in Real Estate." IT Business Edge, November 4. Accessed 2021-12-22.
  21. Ksiazek, Krzysztof. 2019. "An Introduction to Time Series Databases." Blog, Severalnines, April 2. Accessed 2021-12-27.
  22. Logi Analytics. 2019. "Diagnostic Analytics." BI Encyclopedia, Logi Analytics, August 11. Updated 2021-04-09. Accessed 2021-12-27.
  23. Microsoft. 2021. "Siemens Healthineers uses Anomaly Detector to identify anomalies in X-ray tube production." Microsoft, November 15. Accessed 2021-12-27.
  24. Mukherjee, Debnath, and Suman Datta. 2016. "Incremental Time Series algorithms for IoT Analytics: an example from autoregression." ICDCN '16: Proceedings of the 17th International Conference on Distributed Computing and Networking, Article No.: 37, pp. 1-6, January. doi: 10.1145/2833312.2849556. Accessed 2021-12-22.
  25. Nelson, Patrick. 2018. "Data freshness, not speed, most important for IoT." Network World, IDG Communications Inc., June 12. Accessed 2021-12-27.
  26. Pal, Kaushik. 2015. "Internet of Things (IoT) Data vs. Static Data Analytics." Techopedia, October 21. Accessed 2021-12-27.
  27. Pedamkar, Priya. 2019. "IoT Analytics Flow." EDUCBA, October 17. Updated 2021-10-19. Accessed 2021-12-14.
  28. Perara, Srinath. 2015. "IoT Analytics: Using Big Data to Architect IoT Solutions." White paper, WSO2, November. Accessed 2021-12-27.
  29. Pettey, Christy. 2016. "Transform Your Business With IoT Analytics." Gartner, March 16. Accessed 2021-12-27.
  30. Reale, Andrea. 2017. "A guide to Edge IoT analytics." IBM Business Operations Blog, IBM, February 23. Accessed 2021-12-22.
  31. Sinha, Anuj. 2021. "All About IoT Analytics." IoT For All, January 12. Accessed 2021-12-14.
  32. Skizzle. 2021. "IoT Analytics – What It Is, Its Importance And Use Cases." Skizzle, April 8. Accessed 2021-12-14.
  33. Sony Professional Solutions Europe. 2019. "Introducing Edge Analytics: The new AI powered video analytics solution." Sony Professional Solutions Europe, on YouTube, February 19. Accessed 2021-12-24.
  34. Tynan, Dan. 2021. "How the edge is reshaping healthcare." Hewlett Packard Enterprise Development LP, March 12. Accessed 2021-12-27.
  35. Vasudevan, Shriram. 2021. "4 Types of Data Analytics - A Quick View." On YouTube, January 15. Accessed 2021-12-27.
  36. Wayner, Peter. 2021. "Database trends: The rise of the time-series database." VentureBeat, January 15. Accessed 2021-12-27.
  37. Winig, Laura. 2016. "GE’s Big Bet on Data and Analytics." Case Study, MIT Sloan Management Review, February. Accessed 2021-12-27.
  38. Zschörnig, Theo, Robert Wehlitz, and Bogdan Franczyk. 2020. "IoT Analytics Architectures: Challenges, Solution Proposals and Future Research Directions." In: Dalpiaz F., Zdravkovic J., Loucopoulos P. (eds), Research Challenges in Information Science, RCIS 2020, Lecture Notes in Business Information Processing, vol. 385, Springer, Cham. doi: 10.1007/978-3-030-50316-1_5. Accessed 2021-12-27.

Further Reading

  1. Dilmegani, Cem. 2018. "IoT Analytics: Benefits, Challenges, Use Cases & Vendors." AIMultiple, April 13. Updated 2020-11-25. Accessed 2021-12-14.
  2. Sinha, Anuj. 2021. "All About IoT Analytics." IoT For All, January 12. Accessed 2021-12-14.
  3. Rykov, Misha. 2019. "The Top 10 Industrial AI use cases." IOT Analytics, December 6. Accessed 2021-12-14.
  4. Centric Digital. 2016. "How IoT Analytics Differs From Traditional Analytics." Blog, Centric Digital, June 28. Accessed 2021-12-27.

Article Stats

Author-wise Stats for Article Edits

Author
No. of Edits
No. of Chats
DevCoins
4
9
1889
8
4
1490
1877
Words
0
Likes
2081
Hits

Cite As

Devopedia. 2022. "IoT Analytics." Version 12, January 26. Accessed 2022-10-10. https://devopedia.org/iot-analytics
Contributed by
2 authors


Last updated on
2022-01-26 04:11:10

Improve this article
  • Internet of Things
  • Industrial IoT
  • Adaptive IoT
  • IoT Data Management
  • Streaming Analytics
  • Data Analytics

Article Warnings

  • In References, replace these sub-standard sources: data-flair.training, educba.com
  • Readability score of this article is below 60 (46.8). Use shorter sentences. Use simpler words.