The role of replication

The role of replication

This tip addresses the place for replication in the world of data warehousing. The data warehousing world is one of performing "extract, transform and load (ETL)" for data movement. Some replication vendors missed the mark when they didn't add robust transformations to their product sets. Furthermore, DBMS vendors added replication functions much like they are adding ETL functionality now.

But still is there a place for replication in data warehousing? There is one. If you have a separate staging area tier (meaning separate physical DBMS instance) from your data warehouse, this staging area often acts as a dropping ground for the operational data and a data cleansing server. If you can live with the format of the data in this first tier of the data warehouse architecture initially being exactly the same as the operational data, replication can be used as a low-cost ETL for this first tier.

Be careful not to yield to the temptation to just replicate your operational data and call that a data warehouse. The transformation layer is very important and you need ETL. You just may choose to go light (or non-existent) on the transformations in the first ETL when the goal is to just get the data changed data only out of the source system and into a manageable environment as soon as possible.

One drawback of this approach is that you are not exercising your true ETL process in this step. Some have found this to be an acceptable tradeoff.

    Requires Free Membership to View

    Login

    When you register, you'll begin receiving targeted emails from my team of award-winning editorial writers on the latest customer relationship management (CRM)and call center technology issues today. Our goal is to keep you informed on the hottest issues facing this fast-changing industry.

    Hannah Smalltree, Editorial Director

    By submitting your registration information to SearchCRM.com you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchCRM.com is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

For more information, check out searchCRM's Best Web Links on  Data Warehousing.


This was first published in November 2001

Join the conversationComment

Share
Comments

    Results

    Contribute to the conversation

    All fields are required. Comments will appear at the bottom of the article.

    Disclaimer: Our Tips Exchange is a forum for you to share technical advice and expertise with your peers and to learn from other enterprise IT professionals. TechTarget provides the infrastructure to facilitate this sharing of information. However, we cannot guarantee the accuracy or validity of the material submitted. You agree that your use of the Ask The Expert services and your reliance on any questions, answers, information or other materials received through this Web site is at your own risk.

    Back to top