Discovering the Data Pipeline

The purpose of Data Professionals is to collect data, process it to extract its value, and communicate the resulting information in an efficient way to end users.

Those operations are conducted throughout what is called the Data Pipeline. The Data Pipeline is made of conduits, processing plants, and storage facilities which organize the Data Flow – the movement and transformation of data along the pipeline. The schema below illustrates the Data Pipeline which will be explained throughout the next pages.