Unit 5: Integrating Offline Data and Batch Data Processing

EnOS Data Analytics provides end-to-end toolsets to help you load your data from various data sources into a unified analytical data store in EnOS, process the data through orchestrating work flows, and analyze the data quickly and interactively.

The Data Analytics mainly provides the following services.

Data Integration

Use the Data Integration service to integrate your data from external systems to EnOS. EnOS supports connection to various types of data sources. For more information, see Data Connection. Based on your needs, you can perform a full-load data synchronization with a manual workflow or incremental data synchronizations with a periodical workflow that runs based on your scheduled frequency. For more information, see Data Integration.

Dataflow Service

Perform data development based on the GUI-based Dataflow Service. You can use the programs in the common library for most frequently used data development tasks such as converting columns to rows, or you can write your own shell script to be run by your workflows. For more information, see Dataflow Service.

Data Exploration

Data Exploration Service helps you process data in a web notebook based interactive experience without having to use complex command lines. Use the Data Exploration Service to quickly explore your data for validation or quick proof of concepts. For more information, see Data Exploration.

To jump start on batch data processing, see Getting Started with Data Analytics.