Getting Started with Data Analytics¶
A typical flow to use the services of EnOS Enterprise Analytics Platform to analyze your historical data is as follows:
Step 1: Prepare the data source and target¶
- Prepare the data source.
- If the data source is external, you’ll first need to set up connection to the source data. EnOS supports to synchronize data from MYSQL, SQL Server, Oracle, FTP, SFTP, Amazon S3, Azure Blob, and GitLab data sources. For information about how to connect to a specified database, see Data Source Registration.
- If the data you want to process and analyze is on EnOS, such as the device master data accumulated and stored on EnOS. You can skip this substep.
- Prepare the target.
- Create a hive table hosted on EnOS to store the data synchronized from the data source. For more information, see Creating a Hive Table in Data Exploration.
Step 2: Synchronize the data from your data source to EnOS¶
For external data sources, you can create data synchronization workflows from scratch or from importing existing workflows to synchronize your data. You can schedule one-time or periodical workflows as you need. For more information, see Data Synchronization
For master data synchronization, you can use the Batch Processing service to create a workflow that uses the
SYNC_MDM program. For more information, see Batch Processing.
Step 3: Process the data¶
Use the Batch Processing service to process your data, for example, converting columns to rows. EnOS provides rich data processing library that is ready to use.
For more information, see Batch Processing.