Amazon had some great news at AWS re:Invent 2014 in Vegas—and we were there to hear it. Most of them were geared toward enterprises and developers, but three stood out for us more than the rest.
Welcome to Xplenty's Blog
All things data
Amazon’s CloudTrail is a service that logs AWS activity. However, these logs need some preparation before they can be analyzed. In this post, we’ll see how to parse these log files with Xplenty’s data integration in the cloud to generate a comfortable tab-delimited file.
There are three ways to collect data on the cloud: storing it directly in the database, uploading log files, or logging via S3/CloudFront. Although we reviewed the pros and cons for each method there was one aspect we didn't mention - price. Let's try and estimate how much collecting data on the cloud actually costs.
In the first two posts in the series we learned how to scale data collection on the cloud and collect Big Data with S3/Cloudfront logging. Some of our customers started collecting Cloudfront logs and wondered what to do with them, so we decided to write one more post to show how to analyze AWS CloudFront logs with Xplenty’s Hadoop-as-a-Service. You can try this demo for free even if you don’t have an Xplenty account or any logs at the moment.
In our recent article, Scale Your Data Collection on the Cloud Like a Champ, we reviewed several ways of collecting big data, the most promising of which was S3/CloudFront logging. It’s low cost and quick to implement. In this article we’d like to go deeper into the woods and show how to setup S3/CloudFront logging with your application.
With all of the various providers around here, as an attendee it can sometimes be easy to get lost in the sea of technology. However we had a great time today demoing our SaaS Hadoop to at least 100 people. Success.
The first full day of re:Invent has come and gone, and it was a great day. Thousands of people from all areas of technology connecting and learning, and most importantly spreading knowledge.
Here we are...AWS re:Invent 2013 in Vegas baby Vegas!
Let us just get this out of the way right now - it’s been a while since we've written. But we have a good reason, honest we do. We've been making mad upgrades and system tweaks for your benefit.