After you create a real-time synchronization node in DataStudio and commit and deploy the node to the production environment, you can run the node in Operation Center. In addition, you can configure monitoring and alerting to monitor the status of the node and view metrics related to the running of the node in Operation Center. This topic describes the common O&M operations that can be performed on a real-time synchronization node.
Prerequisites
A real-time synchronization node is created and deployed. For more information, see Create a real-time synchronization node to synchronize incremental data from a single table and Configure a real-time synchronization node to synchronize all incremental data from a database.
Run and manage the real-time synchronization node
- Offset: Resumable uploads or data synchronization from a specified offset is supported.
- Failovers: To prevent system resources from being occupied when the node frequently starts due to failovers, you can configure the node to automatically stop when the number of failovers exceeds a specified threshold within a specified period of time. If you do not specify the maximum number of failovers, the system automatically stops the node when the number of failovers exceeds 100 within 5 minutes.
Monitor the real-time synchronization node
To prevent data output delays caused by errors that occur on the real-time synchronization node, you can configure monitoring and alerting settings for the node to monitor the node in Operation Center. To configure monitoring and alerting settings for the node, perform the following steps: Log on to the DataWorks console and go to the Operation Center page. On the Operation Center page, choose in the left-side navigation pane. On the Real Time DI page, find the node and click Alarm settings in the Operation column. For more information, see Manage real-time synchronization nodes.- Alerting conditions: You can configure monitoring and alerting based on the following conditions: node status, business delay, failover, and support for synchronization of DDL operations. Note Support for synchronization of data changes generated by DDL operations that are performed on a source varies based on the destination type. Specific types of destinations may not support the synchronization of such data changes. If you use such a destination for your real-time synchronization node and configure an alert rule for the node based on this alerting condition, a related error may be reported during the running of the node. For more information about the supported DDL operations, see Supported DML and DDL operations.
- Notification method: Methods such as Email, text message, and DingTalk are supported.
- Alerting frequency control: To prevent a large number of alerts from being reported within a short period of time, DataWorks allows you to control the alerting frequency for real-time synchronization nodes. You can configure a setting for the alert rule to enable DataWorks to send only one alert notification within a specified period of time.
View the details of the real-time synchronization node
After the real-time synchronization node is deployed to Operation Center, you can view information about the status, logs, configurations, failover records, and DDL records of the node on the Real Time DI page in Operation Center. To go to the Real Time DI page, perform the following steps: Log on to the DataWorks console and go to the Operation Center page. On the Operation Center page, choose in the left-side navigation pane. For more information, see Manage real-time synchronization nodes.
Modify the real-time synchronization node
You can go to the DataStudio page to modify the configurations of the real-time synchronization node. To make the modifications take effect, you must stop the node before the modification, commit and redeploy the node after the modification, and then start the node on the Real Time DI page in Operation Center.