Skip to main content

Performance

The performance data in this document is based on the default configuration. If you are facing high network latency or high throughput write scenarios, you can refer to the Operation Manual for optimization.

Test Dataset​

  • Dataset: TPC-H 1T

Test Cluster Configuration​

Configuration ItemUpstream ConfigurationDownstream Configuration
FE2 cores 16 GB2 cores 16 GB
BE3 nodes, 16 cores 64 GB, 3*500 GB per node3 nodes, 16 cores 64 GB, 3*500 GB per node

Incremental Synchronization Performance Test​

Test Steps​

  1. Create the database and tables for TPC-H 1T in the upstream cluster.
  2. Create a synchronization job for the TPC-H 1T database.
  3. Wait for the TPC-H 1T data import to complete and record the completion time.
  4. Wait for the downstream data synchronization to complete and record the completion time.

Test Conclusion​

Incremental synchronization time difference: 33 seconds


Full Synchronization Performance Test​

Test Steps​

  1. Create the library and table information for TPC-H 1T in the upstream cluster and complete the data import, recording the completion time.
  2. Create a synchronization job for the TPC-H 1T database.
  3. Wait for the downstream data synchronization to complete and record the completion time.

Test Conclusion​

Full synchronization time difference: 6 minutes 1 second


Test Steps​

  1. Use Flink to import 100,000,000 records in the upstream.
  2. Create a synchronization job for the library and table.
  3. Observe the difference between the downstream synchronization completion time and the upstream import completion time at each stage (e.g., 1,000,000 records, 2,000,000 records, etc.).
  4. Record the last import completion time in the upstream.
  5. Record the downstream synchronization completion time.

Test Conclusion​

The lag time at each stage is maintained within 5 seconds.