Optimizing Process Flows - SAS Data Integration Studio 3.3 User's Guide - page 181

CHAPTER

11

Optimizing Process Flows

Building Efficient Process Flows 182
Introduction to Building Efficient Process Flows 182

Choosing Between Views or Physical Tables 182

Cleansing and Validating Data 183

Managing Columns 183
Drop Columns That Are Not Needed

183

Do Not Add Unneeded Columns 183
Aggregate Columns for Efficiency 184
Match the Size of Column Variables to Data Length 184

Managing Disk Space Use for Intermediate Files 184
Deleting Intermediate Files at the End of Processing 184

Deleting Intermediate Files at the End of Processing 185

Minimizing Remote Data Access 185
Setting Options for Table Loads 186
Using Transformations for Star Schemas and Lookups 186

Using Surrogate Keys 187
Working from Simple to Complex 187
Analyzing Process Flow Performance 187
Introduction to Analyzing Process Flow Performance

187

Simple Debugging Techniques 188
Monitoring Job Status 188
Verifying a Transformation's Output 188
Limiting a Transformation's Input 188
Redirecting Large SAS Logs to a File 189
Setting SAS Options for Jobs and Transformations 189

Using SAS Logs to Analyze Process Flows 189
Introduction to Using SAS Logs to Analyze Process Flows 189

Evaluating SAS Logs 190
Capturing Additional SAS Options in the SAS Log 190
Redirecting SAS Data Integration Studio's Log to a File 191
Viewing or Hiding the Log in SAS Data Integration Studio

191

Using Status Codes to Analyze Process Flows 191
Adding Debugging Code to a Process Flow 191
Analyzing Transformation Output Tables 192
Viewing the Output Table for a Transformation 192
Setting SAS Options to Preserve Intermediate Files for Batch Jobs

192

Using a Transformation's Property Window to Redirect Output Files

193

Adding a List Data Transformation to the Process Flow 193
Adding a User Written Code Transformation to the Process Flow 194