Xplenty’s Data Processing Survey

Xplenty’s Data Processing Survey

We want to know more about the Big Data community: what causes them headaches? What makes them happy? Which tools and technologies do they use? When we had our booth at AWS re:Invent 2014, we met as many people as possible and talked about their data needs. To get an even better picture, we conducted a little survey on the side with three questions:

  1. Where do you store your data?

  2. Which data processing tools have you used?

  3. Are you satisfied with your data processing architecture?

Keep in mind this survey was held at the AWS re:Invent summit, so we were definitely more likely to see people using Amazon products.

Where do you store your data?

Where do you store your data?

Whether it’s flat files or JSON, according to our survey, Amazon S3 is the most popular place for storing data. Quite a lot of people use other data stores, though unfortunately they didn’t tell us which ones. Interesting.

Note: Survey participants were able to select multiple options.

Which data processing tools have you used?

Which data processing tools have you used?

Amazon Elastic MapReduce (EMR) came out on top as the most widely used data processing tool while writing your own code came in second. Do people actually need to write so much custom code, or is it simply because they have not discovered other tools yet? Amazon Data Pipeline, a web service that processes and moves data between different sources, came in third.

Note: Survey participants were able to select multiple options.
Are you satisfied with your data processing architecture?

Are you satisifed with your data processing architecture?

What did AWS participants think about their data architecture? It seems as though the majority were somewhat satisfied with what they have, some were very satisfied and just a small minority weren’t satisfied. The data architectures must be doing alright.

Take the New Survey

We would love to know more about your Big Data use case. Feel free to complete the survey below—it’s anonymous and only takes a few minutes. If you want, you can leave your email address and we’ll send you the survey results before we send them to anyone else.


Integrate Your Data Today!

Get a 7-day free trial. No credit card necessary.