問題描述
我們最近開始使用 AWS DMS 從 RDS 上的 Oracle 數據庫到 S3 的持續遷移(初始加載 + CDC)過程.數據庫正在使用 LogMiner.
We recently started the process of continuous migration (initial load + CDC) from an Oracle database on RDS to S3 using AWS DMS. The DB is using LogMiner.
我們檢測到的問題是 Update 類型的 CDC 記錄只包含被更新的數據，其余字段為空，因此簡單地將具有最大時間戳值的記錄視為有效的可能性丟失了.
the problem that we have detected is that the CDC records of type Update only contain the data that was updated, leaving the rest of the fields empty, so the possibility of simply taking as valid the record with the maximum timestamp value is lost.
有誰知道這是否可以更改或在 DMS 或 RDS 配置的哪個部分進行觸摸，以便更新包含記錄的所有字段的信息?
Does anyone know if this can be changed or in what part of the DMS or RDS configuration to touch so that the update contains the information of all the fields of the record?
提前致謝.
推薦答案
表級別的補充日志記錄可能會增加記錄的內容，但這也會增加為給定工作負載寫入的日志數據總量.
Supplemental Logging at table level may increase what is logged, but that will also increase total volume of log data written for a given workload.
來自不同供應商的許多基于日志的數據復制產品需要在表級別進行額外的補充日志記錄，以確保將更改前后數據更新的完整行數據寫入數據庫日志.
Many Log Based Data Replication products from various vendors require additional supplemental logging at the table level to ensure the full row data for updates with before and after change data is written to the database logs.
re:https://docs.oracle.com/database/121/SUTIL/GUID-D857AF96-AC24-4CA1-B620-8EA3DF30D72E.htm#SUTIL1582
通過 LogMiner 提取數據是可能的，但您需要評估它是否可以根據您需要的數據量進行擴展.
Pulling data through LogMiner may be possible, but you will need to evaluate if it will scale with the data volumes you need.
這篇關于帶有 CDC 的 AWS DMS.更新記錄只包括更新的字段.如何包括所有?的文章就介紹到這了，希望我們推薦的答案對大家有所幫助，也希望大家多多支持html5模板網！