The data modeler's challenge, part 2

The data modeler's challenge, part 2

Continued from part 1.

Conversely, an 'Individual' can purchase the service. This 'Individual's' company becomes, in turn, 'Company' in the operational system, so two categories of 'Company' and 'Individual' exist in the operational system -- those who pay and those who don't pay for the service. This type of controversy between the business definition and the nature of existing data can make the deadline of a modeler Friday the 13th. To avoid that, guidelines for a clever modeler include:

  1. Decompose the business objects into the smallest possible attributes.
  2. Group the common attributes together.
  3. Introduce more generic entities into the model that can collapse all other objects from the perspective of existing data.
  4. Implement proper flagging to identify the category of the respective record.
  5. Define the top-level dimensions for the common attributes.
  6. Attach the facts like 'Sale', 'Order' or 'Revenue' to the generic entity which rolls up to the common attributes which again, rolls up the highest level of the dimension.
  7. Capture the snapshots of all slowly changing data from one definition to another like 'Contact' to 'Customer' and 'Customer' to 'Client'. Remember, operational system will not provide this directly. What the ETL needs to do is to capture all slowly changing dimensions and

    Requires Free Membership to View

    When you register, you'll begin receiving targeted emails from my team of award-winning editorial writers on the latest customer relationship management (CRM)and call center technology issues today. Our goal is to keep you informed on the hottest issues facing this fast-changing industry.

    Hannah Smalltree, Editorial Director

    By submitting your registration information to SearchCRM.com you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchCRM.com is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

  1. put respective flags on the data at the time of cleansing, massage or reconciliation.
  2. Define rigid business rules for the ETL to classify different category in the generic object (Business users are the perfect guide to synthesize the definitions) and implement them in transformation rules.
  3. Design a repository to collect all related metadata attributes of respective categories and give their access to the OLAP Cubes.
  4. Design proper summary tables or implement data marts to categorize a generic entity and attach it to the cube to minimize the object analysis for the cubes.

For more information, check out SearchCRM's Best Web Links on Business Intelligence and Data Analysis.


This was first published in March 2002

Join the conversationComment

Share
Comments

    Results

    Contribute to the conversation

    All fields are required. Comments will appear at the bottom of the article.

    Disclaimer: Our Tips Exchange is a forum for you to share technical advice and expertise with your peers and to learn from other enterprise IT professionals. TechTarget provides the infrastructure to facilitate this sharing of information. However, we cannot guarantee the accuracy or validity of the material submitted. You agree that your use of the Ask The Expert services and your reliance on any questions, answers, information or other materials received through this Web site is at your own risk.