Course Catalog Help
DATAENG 07 (Builder): Configuring Data Expectations in Pipeline Builder

DATAENG 07 (Builder): Configuring Data Expectations in Pipeline Builder

Learn how to configure and apply data expectations checks in pipeline builder and review them in the Data Health application.

rate limit

Code not recognized.

About this course

In some cases, data health checks like the ones you applied in the previous tutorial may may be sufficient to monitor your pipelines. A full monitoring and protection program should take advantage of the Data Expectations framework for greater granularity and control. In this brief tutorial, you’ll practice adding some of these checks to your pipeline and view them in the Data Health application.

⚠️ Course prerequisites

  • DATAENG 06: Monitoring Data Pipeline Health: If you have not completed the previous course in this track, please do so now.

📖 Learning Objectives

  • Understand when and how to apply data expectations checks in Pipeline Builder.

💪 Foundry Skills

  • Apply a Data Expectations check in Pipeline Builder.
  • View expectations checks in the Data Health app.

Curriculum

  • Introduction
  • About this Course
  • Data Expectations in Pipeline Builder
  • Add a Primary Key Data Expectation
  • View your Data Expectation in Data Health: Part 1
  • View your Data Expectation in Data Health: Part 2
  • Exercise Summary
  • Practice: Implement Data Expectations in your Pipeline
  • Practice: Implement Data Expectations in your Pipeline
  • Conclusion
  • Key Takeaways
  • Next Steps

About this course

In some cases, data health checks like the ones you applied in the previous tutorial may may be sufficient to monitor your pipelines. A full monitoring and protection program should take advantage of the Data Expectations framework for greater granularity and control. In this brief tutorial, you’ll practice adding some of these checks to your pipeline and view them in the Data Health application.

⚠️ Course prerequisites

  • DATAENG 06: Monitoring Data Pipeline Health: If you have not completed the previous course in this track, please do so now.

📖 Learning Objectives

  • Understand when and how to apply data expectations checks in Pipeline Builder.

💪 Foundry Skills

  • Apply a Data Expectations check in Pipeline Builder.
  • View expectations checks in the Data Health app.

Curriculum

  • Introduction
  • About this Course
  • Data Expectations in Pipeline Builder
  • Add a Primary Key Data Expectation
  • View your Data Expectation in Data Health: Part 1
  • View your Data Expectation in Data Health: Part 2
  • Exercise Summary
  • Practice: Implement Data Expectations in your Pipeline
  • Practice: Implement Data Expectations in your Pipeline
  • Conclusion
  • Key Takeaways
  • Next Steps