How Gusto Built Their Data Pipeline with Amazon Redshift December 06, 2021 by Abe Dearmer Gusto Gusto, founded in 2011, is a company that provides a cloud-based payroll, benefits and workers’ compensation solution for businesses. Their business has grown steadily over the years, currently topping...
3 Steps to Set up Automatic WLM with Query Priority in Amazon Redshift December 06, 2021 by Donal Tobin Introduction With the release of Query Priorities and Automatic WLM, the AWS team has given Amazon Redshift administrators a powerful new way to define and prioritize data workloads. Without using...
What is the worst part of data engineering? December 06, 2021 by Abe Dearmer Table of Contents Drivers of change The Challenge of Data Engineering The worst part of data engineering Summary In data engineering teams the list is long and depends on your...
Don’t Use Redshift as an OLTP Database December 06, 2021 by Donal Tobin It is common to connect an application framework like Django to Amazon Redshift. This is useful when using Redshift data in your application, i.e. in an OLTP scenario. Since Amazon...
Redshift’s Automatic WLM with Query Priority: A First Look at Performance December 06, 2021 by Abe Dearmer Introduction The AWS team recently released a new feature of their Automatic WLM that we’re really excited about: Query Priorities. This feature aims to address the main limitation of Auto...
Use Routine Vacuuming to Reclaim Unused Space December 06, 2021 by Abe Dearmer Amazon Redshift databases require periodic maintenance known as vacuuming. Amazon Redshift is based on PostgreSQL, but unlike PostgreSQL, Redshift doesn’t offer autovacuum. So when a row is deleted from a...
Use Amazon Redshift Spectrum for infrequently used data December 06, 2021 by Abe Dearmer Amazon Redshift launched with disruptive pricing. To compare the cost, we’re looking at the price for storing 1TB of data for one year ($ / TB / Year). With a...
How Wish Built Their Data Pipeline with Amazon Redshift December 06, 2021 by Abe Dearmer Wish Wish is a mobile commerce platform. It provides online services that include media sharing and communication tools, personalized and other content, as well as e-commerce. During the last few...
Benchmarking the Performance of Amazon Redshift ra3.16xlarge versus ds2.8xlarge instances December 06, 2021 by Abe Dearmer A first look at the new RA3 Amazon Redshift node type Table of Contents Introduction Specs Copy Performance I/O Performance Real-world performance Separation of Storage and Compute Conclusion Introduction Today...