Data Warehousing in the Real World

Table of contents

PART I INTRODUCTION

INTRODUCTION
Background
What is a Data Warehouse?
Why Read This Book?
Road Map
One Final Point

DELIVERY PROCESS
Introduction
Data Warehouse Delivery Method

PART II DATA WAREHOUSE ARCHITECTURE

SYSTEM PROCESSES
Introduction
Overview
Typical Process Flow Within a Data Warehouse
Extract and Load Process
Clean and Transform Data
Backup and Archive Process
Query Management Process

PROCESS ARCHITECTURE
Introduction
Load Manager
Warehouse Manager
Query Manager
Detailed Information
Summary Information
Metadata
Data Marting
To Summarize

PART III DESIGN

DATABASE SCHEMA
Introduction
Starflake Schemas
Identifying Facts and Dimensions
Designing Fact Tables
Designing Dimension Tables
Designing the Starflake Schema
Query Redirection
Other Schemas

PARTITIONING STRATEGY
Introduction
Horizontal Partitioning
Vertical Partitioning
Hardware Partitioning

AGGREGATIONS
Introduction
Why Aggregate?
What is an Aggregation?
Designing Summary Tables
Which Summaries to Create

DATA MARTING
Introduction
When is a Data Mart Appropriate?
Designing Data Marts
Costs of Data Marting

METADATA
Introduction
Data Transformation and Load
Data Management
Query Generation
Metadata and Tools

SYSTEM AND DATA WAREHOUSE PROCESS MANAGERS
Introduction
Why You Need Tools to Manage a Data Warehouse
System Managers
Data Warehouse Process Managers
Load Manager
Warehouse Manager
Query Manager

PART IV HARDWARE AND OPERATIONAL DESIGN

HARDWARE ARCHITECTURE
Introduction
Process
Server Hardware
Network Hardware
Client Hardware

PHYSICAL LAYOUT
Parallel Technology
Disk Technology
Database Layout
Filesystems

SECURITY
Introduction
Requirements
Performance Impact of Security
Security Impact on Design

BACKUP AND RECOVERY
Introduction
Definitions
Hardware
Software
Backup Strategies
Testing the Strategy
Disaster Recovery

SERVICE LEVEL AGREEMENT
Introduction
Definition of Types of System
Is the Data Warehouse an Operational System of Not?
Defining the SLA

OPERATING THE DATA WAREHOUSE
Day-to-Day Operations of the Data Warehouse
Overnight Processing

PART V CAPACITY PLANNING, TUNING AND TESTING

CAPACITY PLANNING
Introduction
Process
Estimating the Load

TUNING THE DATA WAREHOUSE
Introduction
Assessing Performance
Tuning the Data Load
Tuning Queries

TESTING THE DATA WAREHOUSE
Introduction
Developing the Test Plan
Testing Backup Recovery
Testing the Operational Environment
Testing the Database
Testing the Application
Logistics of the Test

PART VI FUTURES

DATA WAREHOUSE FUTURES

APPENDICES
Methodology
Accessing the Data Warehouse