Overcoming 9 Data Governance Challenges January 30, 2023 by Lyndsay Wise Data governance is the process of managing and protecting data throughout its lifecycle.
7 Important ETL Requirements December 26, 2022 by Lyndsay Wise Let's simplify ETL to identify seven criteria that shouldn't be overlooked. The seven criteria are: Extract, Cleanse, Transform, Load, Analyze, Automate, Right time access
The Importance of Business and IT Alignment to Build Successful Data Pipelines October 31, 2022 by Lyndsay Wise Successful data pipeline projects being built require broader considerations than just the pipelines themselves. Understanding business outcomes and needs, help data teams build better data pipelines across the data ecosystem.
Successful Data Projects Start with Understanding Business Problems October 25, 2022 by Lyndsay Wise Too many data projects overlook the root causes driving data pipeline needs. Organizations need to drive data projects by evaluating business challenges, risks, and opportunities. Overall project success requires an...
How To Simplify The ETL Code Process with Low-Code Tools April 18, 2022 by Donal Tobin Learn the pros and cons of manual and low-code ETL. Find out what tools are available to help, and start improving your process today.
Heroku PostgreSQL and Integrate.io January 11, 2022 by Abe Dearmer What can you do with data collected on Heroku PostgreSQL? How will you analyze it and integrate it? With Integrate.io, of course! Integrate.io lets you connect to a PostgreSQL database...
The Ultimate Guide to Redshift ETL: Best Practices, Advanced Tips, and Resources for Mastering Redshift ETL December 15, 2021 by Mark Smallcombe This guide will cover everything you need to know about building and maintaining your Redshift ETL pipeline. We’ll cover ETL best practices and advanced tips, whether to build or buy...
How to improve performance of "UPSERT"s when running "COPY commands December 07, 2021 by Abe Dearmer UPSERT is the operation to merge new records with existing records using primary keys on a table. While some RDBMSs support a single UPSERT statement.
What is the U.S.-EU Safe Harbor Program? December 07, 2021 by Abe Dearmer In a nutshell, the Safe Harbor program enables certified American companies to safely handle personal and potentially sensitive data from European customers and partners.