Bigdata & analytics

Modular Software Stack
Full spectrum solution from data ingress to detailed analytics and customizable monitoring and alerting.

Modularity

The DDNET MSS was designed with a clear goal of being as modular as possible in order to suit as many real-world applications as possible. We provide a series of modules for each part of the software stack - from support for Real Time OS’s to embedded boards on the sensor side, to self-hosted and cloud hosted modules for data acquisition and storage, leading to a fully customizable dashboard for data analysis and monitoring applications.
DDNET BIGDATA/IoT Vision

A glimpse in the future of DDNET MMS deployments

Data-flow Management and Storage

Leveraging the latest advances in elastic search and distributed cloud storage, the DDNET MMS solution will handle all the aspects of data collection and storage. Just point your sensors to the ingress endpoint and start sending data.

Data Analysis and Categorization

All the incoming data is preliminarily categorised at the ingress point, allowing for an easier understanding of what data is coming in and what it represents. Enjoy creating what you see is what you get recipes for data analysis with instant feed-back and detailed reporting options.

Deep Learning & Pattern Recognition

Get an instant preview of trends and insights from your data as soon as it is loaded into our platform. Start with pre-trained machine learning modules and customize them to suit your needs.

Automated Monitoring and Alerting

Our back-end systems track the flow of data and detect both stream and payload related issues on the fly. Enjoy the peace of mind in not having to set detailed rules, and let our deep learning algorithms do the heavy lifting.

API Flexibility

Our device-access and data-transport modules have been designed with full data management and on-the-fly updating in mind. Even without updating the firmware, our solution can adapt in real-time to data driven demands and change the data-points being uploaded, allowing for better resource management for both energy and bandwidth.

In an ideal deployment, the on-device module should be exposed to all the data-points that are available to a physical device, using the provided API. Flexible macros can then be defined to decide what data-points are being uploaded and at what rate. The Control module can then receive live instructions via the Dashboard, to either change the desired data-points or increase/decrease the rate at which they are uploaded.

Using smart macros on the device also allows for better energy efficiency and bandwidth savings, by being able to set custom ranges for each data-point, that if not reached will limit the number of uploads per session. Imagine a temperature sensor that only transmits small heart-beat messages if the current registered temperature is within a 0.05 margin of the previous sent value.


Security

One of the most concerning and rapidly raising problem with custom IoT implementations so far has been the lack of security and ease of exploitation of a large number of IoT devices world-wide. Security cameras, wireless routers and many other devices have been recently affected by this.

We believe that our single communication channel with a central Control module limits the avenues of attack on the solution, without affecting on-the-fly updates and future modifications.

All our modules are designed with security as a top-priority and offer best-practice features, such as: individual module security certificates, DNSSEC availability, end-to-end encryption on the transport channel, encrypted data storage, etc.


Scalability

The DDNET MSS data acquisition module provides a scalable and distributed platform for data ingress and storage. Our solution fully integrates on Amazon Cloud, Azure Cloud, IBM Cloud, with many more coming.

For our enterprise customers we also offer data acquisition modules for fully self-hosted servers (CentOS/Debian based distributions) or self-hosted OpenCloud deployments.


Data Analysis, Monitoring & Alerting

With vast experience in creating data-driven analytics platforms, we have designed the DDNET MSS Dashboard to be a one-stop platform for both data analysts and support / monitoring in any IoT deployment.

The general use modules provide an overview of all sensors deployed per project, offering an at-glance view of sensor health, data acquisition rates, over time averages and so on. Custom alerting rules can be defined for each data-point, as well as different levels of alerting for data-point availability and consistency.

Data analysts can use the extended data querying and plotting modules to create detailed statistics on a per-project basis. Detailed reports can be created and a background monitoring task can be enabled to automate the creation of reports suiting each client’s needs.

For clients needing custom data analysis, or for customers needing to integrate various data-points into existing applications, we provide an extended API designed for easy data extraction.