There are three ways to collect data on the cloud: storing it directly in the database, uploading log files, or logging via S3/CloudFront. Although we reviewed the pros and cons for each method there was one aspect we didn't mention - price. Let's try and estimate how much collecting data on the cloud actually costs.
Welcome to Xplenty's Blog
All things data
In our recent article, Scale Your Data Collection on the Cloud Like a Champ, we reviewed several ways of collecting big data, the most promising of which was S3/CloudFront logging. It’s low cost and quick to implement. In this article we’d like to go deeper into the woods and show how to setup S3/CloudFront logging with your application.
When we met with WalkMe, a company which offers helpful in-app walkthroughs (we use it for our app and it’s great), our meeting took a surprising turn. We expected a discussion about crunching big data. They already had a data collection mechanism in place, but they had a problem that preceded any sort of crunching. They had a problem scaling the data collection process.