You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: advocacy_docs/edb-postgres-ai/migration-etl/data-migration-service/getting_started/create_migration.mdx
+9-5
Original file line number
Diff line number
Diff line change
@@ -5,25 +5,29 @@ title: "Creating a migration"
5
5
After you use the EDB DMS Reader to read the source database, create a new migration in the EDB Postgres® AI Console.
6
6
This establishes a sync between the source database and a target cluster in the EDB Postgres AI Console.
7
7
8
-
1. Access the [EDB Postgres AI Console](https://portal.biganimal.com) and log in with your EDB Postgres AI Database Cloud Service credentials.
8
+
1. Access your Hybrid Control Plane instance and log in with your EDB Postgres AI credentials.
9
9
10
-
1. Select the project where you created the database cluster.
10
+
1. Select the project from which you want to manage the migration.
11
11
12
12
1. Within your project, select **Migrate** > **Migrations**.
13
13
14
-
1. In the **Migrations** page, select **Create New Migration** > **To Managed Postgres**.
14
+
1. In the **Migrations** page, select **Create New Migration**.
15
15
16
16
1. In the **Create Migration** page, assign a **Name** to the migration.
17
17
18
18
1. Select the **Source** of the migration. The ID for the EDB DMS Reader is listed in the drop-down menu.
19
19
20
-
1. Under **Destination**, select a target cluster for the migration and enter the name of the database where you want the migration to copy data and select **Next**.
20
+
1. Select the migration type, **Snapshot** or **Snapshot + Streaming**.
21
+
22
+
1. Under **Destination Type**, select a target for the migration. This can be a **Managed Postgres** or **External Postgres** instance. Select the destination cluster and database accordingly and select **Next**.
21
23
22
24
1. Select the tables and columns to migrate. Modify the table and column names if needed.
23
25
24
26
1. Select **Create Migration**.
25
27
26
-
The EDB Postgres AI Console now displays a new migration. The EDB DMS Reader is constantly streaming data when the migration displays the **Running** state. Changes to data are replicated from the source to the target database as long as the migration is running.
28
+
The EDB Postgres AI Console now displays a new migration.
29
+
30
+
If you chose the **Snapshot + Streaming** option, the EDB DMS Reader is constantly streaming data when the migration displays the **Running** state. Changes to data are replicated from the source to the target database as long as the migration is running.
27
31
28
32
!!!note
29
33
The EDB DMS Reader streams data changes. It does not stream changes in the DDL objects.
Copy file name to clipboardExpand all lines: advocacy_docs/edb-postgres-ai/migration-etl/data-migration-service/index.mdx
+4-4
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@ title: EDB Data Migration Service
3
3
indexCards: simple
4
4
deepToC: true
5
5
directoryDefaults:
6
-
description: "EDB Data Migration Service is a solution that enables secure, fault-tolerant, and performant migrations to EDB Postgres AI Cloud Service."
6
+
description: "EDB Data Migration Service is a solution that enables secure, fault-tolerant, and performant migrations."
7
7
product: "data migration service"
8
8
iconName: EdbTransporter
9
9
displayBanner: "Notice: Data Migration Service capabilities are now only available as part of the EDB Postgres AI Hybrid Control Plane, which is currently in tech preview."
@@ -24,10 +24,10 @@ navigation:
24
24
Data Migration Service capabilities are now only available as part of the EDB Postgres AI Hybrid Control Plane, which is currently in tech preview.
25
25
!!!
26
26
27
-
EDB Data Migration Service (DMS) offers a secure and fault-tolerant way to migrate database data to the EDB Postgres AI platform. Using change data capture or CDC and event streaming, source database row changes are replicated to the migration destination. You can select a subset of your schemas' tables to migrate including support for schema, table, and column name remapping.
27
+
EDB Data Migration Service (DMS) offers a secure and fault-tolerant way to migrate database data. Using change data capture or CDC and event streaming, source database row changes are replicated to the migration destination. You can select a subset of your schemas' tables to migrate including support for schema, table, and column name remapping.
28
28
29
-
EDB DMS is currently a public preview capability that is available for use with EDB Hosted EDB Postgres AI Cloud Service deployments on AWS.
29
+
EDB DMS is currently a public preview capability that is available for users of EDB Postgres AI Hybrid Control Plane.
30
30
31
31
EDB Data Migration Service is built on Apache Kafka and the open-source Debezium CDC platform.
32
32
33
-
To migrate self-managed database sources, see [Getting started](./getting_started/).
33
+
See [Getting started](./getting_started/) for an overview of how to migrate database data.
Copy file name to clipboardExpand all lines: advocacy_docs/edb-postgres-ai/migration-etl/data-migration-service/supported_versions.mdx
+23-19
Original file line number
Diff line number
Diff line change
@@ -7,21 +7,24 @@ description: Verify that your Oracle or Postgres database version is compatible
7
7
8
8
## Supported EDB Postgres AI environments
9
9
10
-
The EDB Data Migration Service (EDB DMS) is currently a public preview capability that is only for use with EDB Hosted Postgres AI Cloud Service deployments on AWS.
10
+
The EDB Data Migration Service (EDB DMS) is currently a public preview capability that is only available to users of EDB Postgres AI Hybrid Control Plane.
11
11
12
12
## Supported source databases
13
13
14
14
The following database versions are supported.
15
15
16
-
| Database version | Supported |
17
-
|------------------|-----------|
18
-
| Postgres 11 - 16 | Y |
19
-
| EPAS 11 - 16 | Y |
20
-
| Oracle 11g | Y |
21
-
| Oracle 12c | Y |
22
-
| Oracle 18c | Y |
23
-
| Oracle 19c | Y |
24
-
| Oracle 21c | Y |
16
+
| Database version | Supported source |
17
+
|--------------------|------------------|
18
+
| PostgreSQL 11 - 17 | Y |
19
+
| EPAS 11 - 17 | Y |
20
+
| Oracle 11g | Y |
21
+
| Oracle 12c | Y |
22
+
| Oracle 18c | Y |
23
+
| Oracle 19c | Y |
24
+
| Oracle 21c | Y |
25
+
26
+
!!!note
27
+
The supported Postgres source databases include self-managed and HCP-managed databases.
25
28
26
29
### Oracle
27
30
@@ -33,18 +36,19 @@ Container databases (CDB/PDB) and non-CDB sources are supported.
33
36
34
37
Postgres and EDB Postgres Advanced Server sources require a database role or user that can manage replications. For details, see [Preparing Postgres source databases](getting_started/preparing_db/preparing_postgres_source_databases).
35
38
36
-
## Supported target databases
39
+
## Supported destination databases
37
40
38
-
Data Migration Service supports migrating to EDB Postgres AI Cloud Services. The target Postgres database cluster must meet the following requirements:
41
+
Data Migration Service supports migrating to both HCP-managed databases (on clusters created with EDB Postgres AI Hybrid Control Plane) and self-managed databases running Postgres.
39
42
40
-
- The cluster was deployed with the [EDB Hosted Cloud Service](/edb-postgres-ai/cloud-service/getting_started/planning/choosing_your_deployment/edb_hosted_cloud_service/).
43
+
| Database version | Supported destination |
44
+
|--------------------|-----------------------|
45
+
| PostgreSQL 11 - 17 | Y |
46
+
| EPAS 11 - 17 | Y |
47
+
| PGE 11 - 17 | Y |
41
48
42
-
- AWS is the provider for the EDB Hosted Cloud Service cluster.
43
-
44
-
!!!note
45
-
Other Cloud Service providers and [Your Cloud Account](/edb-postgres-ai/cloud-service/getting_started/planning/choosing_your_deployment/your_cloud_account/) deployments are currently not supported.
46
-
!!!
49
+
!!!note
50
+
If the destination is an HCP-managed database, AWS must be the provider for the Hybrid Control Plane cluster. Other Cloud Service providers are currently not supported.
47
51
48
52
## Supported operating systems
49
53
50
-
The EDB DMS Reader can run on Linux. For details, see [Installing EDB DMS Reader](getting_started/installing).
54
+
Both Reader and Writer run on Linux. For details, see [Installing EDB DMS Reader](getting_started/installing) or [Installing EDB DMS Writer](getting_started/installing2).
Copy file name to clipboardExpand all lines: advocacy_docs/edb-postgres-ai/migration-etl/data-migration-service/terminology.mdx
+8
Original file line number
Diff line number
Diff line change
@@ -17,6 +17,14 @@ CDC is a set of software design patterns used to determine and track changes in
17
17
18
18
The [EDB Data Migration Service Reader](./getting_started/installing/), packaged as `cdcreader`, uses Debezium to perform CDC operations on the source database and Kafka to produce messages containing the change events.
19
19
20
+
Install and configure the DMS Reader when performing any type of migrations, as it allows you to connect to and read the source. If the target for your migration is an HCP-managed database, you don't need to install the [DMS Writer](#edb-dms-writer). If the target is another self-managed database, install the [DMS Writer](#edb-dms-writer).
21
+
22
+
## EDB DMS Writer
23
+
24
+
The [EDB Data Migration Service Writer](./getting_started/installing2/), packaged as `cdcwriter`, uses Debezium to perform CDC operations on the destination database and Kafka to produce messages containing the change events.
25
+
26
+
Install and configure the DMS Writer on your destination machine when performing migrations to self-managed destination databases, as it allows you to connect to self-managed destinations. Additionally install the [DMS Reader](#edb-dms-reader) for any type of migrations.
27
+
20
28
### Apache Kafka
21
29
22
30
[Apache Kafka](https://kafka.apache.org/) is an open-source, distributed-event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. EDB Data Migration Service uses Kafka to manage data streaming from the source to the target database.
Copy file name to clipboardExpand all lines: advocacy_docs/edb-postgres-ai/migration-etl/index.mdx
+17-5
Original file line number
Diff line number
Diff line change
@@ -15,15 +15,27 @@ The available migration tools are suitable for different migration scenarios. Th
15
15
16
16
## EDB Data Migration Service
17
17
18
-
[EDB Data Migration Service](data-migration-service) is a cloud-basedservice that helps you migrate your data to an [EDB Hosted Cloud Service](/edb-postgres-ai/cloud-service/getting_started/planning/choosing_your_deployment/edb_hosted_cloud_service/) database.
18
+
[EDB Data Migration Service](data-migration-service) is a cloud-based, Hybrid Control Plane service that helps you migrate your data, either with **Snapshot** or **Snapshot + Streaming** capabilities.
19
19
20
-
EDB DMS offers a secure and fault-tolerant way to migrate database data to the EDB Postgres AI platform using change data capture and event streaming technologies. This allows the migration to stream any changes in the source database to the EDB Cloud Service database until you decide to cut over.
20
+
EDB DMS offers a secure and fault-tolerant way to migrate database data using change data capture and event streaming technologies. This allows the migration to stream any changes in the source database to the destination database until you decide to cut over.
21
21
22
-
At the end of a data migration with EDB DMS, the data in your source database will have been copied to a Postgres database managed with EDB Postgres AI Cloud Service.
22
+
At the end of a data migration with EDB DMS, the data in your source database will have been copied to a Postgres database.
23
23
24
-
-**Purpose:**Migration of database data
24
+
### Migration scenarios
25
25
26
-
-**Applicable migration scenarios:** From Oracle, PostgreSQL or EDB Postgres Advanced Server to [EDB Hosted Cloud Service](/edb-postgres-ai/cloud-service/getting_started/planning/choosing_your_deployment/edb_hosted_cloud_service/) databases with PostgreSQL, EDB Postgres Advanced Server or EDB Postgres Extended Server
26
+
**To HCP-managed databases**
27
+
28
+
-**Purpose:** Migration of database data to an HCP-managed Postgres database
29
+
30
+
-**Applicable migration scenarios:** From Oracle, PostgreSQL or EDB Postgres Advanced Server to EDB Postgres AI Hybrid Control Plane databases with PostgreSQL, EDB Postgres Advanced Server or EDB Postgres Extended Server
31
+
32
+
** To self-managed Postgres databases**
33
+
34
+
Alternatively, you can use the EDB Data Migration Service to migrate either HCP-managed databases or other external, self-managed databases to a different Postgres destination database outside of the Hybrid Control Plane.
35
+
36
+
-**Purpose:** Migration of database data to a self-managed Postgres database
37
+
38
+
-**Applicable migration scenarios:** From HCP-managed or self-managed databases running on Oracle, PostgreSQL or EDB Postgres Advanced Server to self-managed instances of PostgreSQL, EDB Postgres Advanced Server or EDB Postgres Extended Server
0 commit comments