Use Short Query Acceleration (SQA) December 06, 2021 by Donal Tobin Short Query Acceleration (SQA) will speed up the execution of short running queries. It does this by selecting certain queries to jump the queue. This can be useful when your...
How Gusto Built Their Data Pipeline with Amazon Redshift December 06, 2021 by Abe Dearmer Gusto Gusto, founded in 2011, is a company that provides a cloud-based payroll, benefits and workers’ compensation solution for businesses. Their business has grown steadily over the years, currently topping...
3 Steps to Set up Automatic WLM with Query Priority in Amazon Redshift December 06, 2021 by Donal Tobin Introduction With the release of Query Priorities and Automatic WLM, the AWS team has given Amazon Redshift administrators a powerful new way to define and prioritize data workloads. Without using...
How Yelp Built Their Data Pipeline with Amazon Redshift December 06, 2021 by Donal Tobin Yelp The tech world has changed dramatically since Yelp was launched back in 2004. Eight years later and Yelp started its change. It transformed from running a huge monolithic application...
What is the worst part of data engineering? December 06, 2021 by Abe Dearmer Table of Contents Drivers of change The Challenge of Data Engineering The worst part of data engineering Summary In data engineering teams the list is long and depends on your...
Customer Success Story: Fuze improves query performance by 10x December 06, 2021 by Abe Dearmer Fuze is a cloud-based communications and collaboration platform provider. Fuze drives workplace transformation for its customers with data from 2.5 million meetings, 20 million calls, and 33 million messages each...
Don’t Use Redshift as an OLTP Database December 06, 2021 by Donal Tobin It is common to connect an application framework like Django to Amazon Redshift. This is useful when using Redshift data in your application, i.e. in an OLTP scenario. Since Amazon...
Redshift’s Automatic WLM with Query Priority: A First Look at Performance December 06, 2021 by Abe Dearmer Introduction The AWS team recently released a new feature of their Automatic WLM that we’re really excited about: Query Priorities. This feature aims to address the main limitation of Auto...
Use Routine Vacuuming to Reclaim Unused Space December 06, 2021 by Abe Dearmer Amazon Redshift databases require periodic maintenance known as vacuuming. Amazon Redshift is based on PostgreSQL, but unlike PostgreSQL, Redshift doesn’t offer autovacuum. So when a row is deleted from a...