Maintainable SQL in Data Warehousing

Since SQL isn't a programming language, and say you don't have the option of using a programming language to generate SQL, how do you go about making it maintainable? If I had the opportunity to build a new data warehouse from scratch, I'd probably tell myself these things to prevent…

Continuous Integration and Deployment for Data Pipelines

Although continuous integration and deployment (CI/CD) are not new concepts, new tools such as Docker, Kubernetes, and Jenkins have allowed CI/CD to be more easily implemented in recent years. However, there are interesting challenges when applying CI/CD to data engineering.…