Application Scenario¶

Data Query and Download from Multiple Data Sources¶

Challenges in Data Query Scenario

Difficulty of data query due to different access methods of different data sources;
Unable to query data quickly across data sources;
Users of different OUs cannot share data quickly and safely.

Data Federation Solution

Encapsulating data sources to achieve unified query interface and cross-source query.
Supporting asynchronous data download with customized file format for Hive data source, enabling data download from Hive.

The application scenario of Data Federation is shown in the following figure.

Wind Farm Real-time Data Report¶

Time series data generated by wind turbines and wind farm devices are stored in TSDB, but the dimension data of the devices is stored in MySQL databases. In this case, use restful APIs to connect federation channels for obtaining data to be visualized through SQL statements. The application scenario is shown in the following figure.

Hive Data Query¶

Integrating Hive access in code
Referencing Hive data in reports
Downloading big amount of Hive data for analysis
Connecting federation channels through Restful APIs, JDBC, or OData and obtaining data for visualization through SQL statements

Hive Data Download¶

To download a large amount of Hive data for analysis, use Restful API to submit data download job, view the job status, and get the file download URL.