Welcome to Xplenty's Blog.

Get the full picture of how your business is doing, which efforts are working and how it’s all impacting your bottom line in real time.

Xplenty's CEO Yaniv Mor gives an inside look at how to successfully overcome the challenges of running a remote startup team.

As part of our recent acquisition of Driven, Xplenty is also taking charge of Cascading, the popular open source project that is used to create and execute complex data processing...

We at Xplenty are adding two new services from Google Cloud into our ever-increasing array of available integrations: Google Cloud Spanner and Google Cloud SQL for PostgreSQL. As a longtime...

2017 is here, and we give you our 4 data related predictions for the year. They all revolve around the massive production and consumption of data

Xplenty, the data integration platform helping organizations make raw data “analytics-ready,” today announced it has received a $4 million Series A extension from Bain Capital Ventures, True Ventures and Rembrandt...

One of the most long-overdue AWS functionalities is finally available. During the most recent Amazon Web Services Re:Invent gathering in Las Vegas, Amazon announced Athena: a service that lets you...

A chart that clearly specifies what are the differences between each and every profession in the field of BI, including titles, skills, roles and salaries.

Xplenty explains the basics of Data Integration: What is ETL (Extract Transform Load), what are its main functions and when you would need them.

Which BI architecture is better for your organization, ETL or ELT? This article explains the considerations and also how they relate to Data Warehouses and Data Lakes.

Matt Mueller, President of a BI and analytics recruitment firm, shares his tips and best practices on how to hire a ‘Head of BI’.

Today, we have great news to share - Xplenty was included in StartUp50.com’s Annual StartUp Big 50 List. To earn our well-deserved spot in the Big 50 we had...

Data warehouses (DWHs) are widely recognized as essential components of business intelligence and analytics operations. But the question of whether the optimal deployment route is in the cloud or on-premise...

Igor Elbert, Principal Data Scientist at Gilt.com, shares with Xplenty his thoughts on recent data projects, challenges and his approach to ETL.

Why you need a Data Integration Layer (ETL), reasons to use a SaaS based tool for ETL rather than coding it through scripts.

In an interview with Datanami, Xplenty CEO Yaniv Mor explains the pitfalls of data hoarding and how to overcome it.

This post takes a look at how you can use Xplenty, a data integration tool, to create personalized data-driven marketing campaigns to increase your ROI.

Xplenty, swoops in as a superhero in the world of ETL, to save you time (which means money) getting all that data into your company’s analytic data store. Grab data...

Xplenty integration with HipChat is super fast and incredibly easy using Xplenty’s HipChat hooks. Xplenty’s HipChat hooks allow you to get real-time updates about your account activity into your HipChat...

Xplenty's integration with Salesforce is the easiest way to read and process your data from Salesforce and move it to an analytic data stores such as Amazon Redshift or Google...

We already integrate with many tools to reduce the bulk of time you likely spend on cleaning your data and preparing it for analytics. We want to continue to make...

At Xplenty, we aim to make moving and processing data as quick and seamless as possible.
We integrate with a ton of tools your teams already uses to make...

ETL is a critical, necessary process for almost all analytics projects. But the harsh reality is that ETL is complicated, with many challenges along the way, and implementation can be...

Writing your own ETL code is not trivial. What starts out as a simple ETL process gets more complex over time. So does the coding, which becomes less manageable. A...

May was a crazy month here at Xplenty. We started our event tour at Collision in Las Vegas. Then we headed over to NYC for the Data Summit...

So you’re on the cloud or plan to move there very soon.

If you want to know what the big players are doing with Big Data, then the Data Summit is the place to be. This Big Data conference, that will take...

What do U2’s lead singer Bono, pro skater Tony Hawk, and Netflix founder Reed Hastings have in common? Collision. Not a literal crash, but the huge tech conference that will...

Everything comes as a service these days, and so does collecting Big Data. Various platforms on the web are happy to take data collection off your coding hands, making it...

There are quite a few real-time platforms out there. A lot of them are newcomers, and the differences between them aren’t clear at all. The least we can do, is...

Happy birthday to Redshift! Amazon’s data warehouse-as-a-service has just celebrated two years of data querying. Several reviews were written about Redshift at the time, but as far as we know,...

Big Data consultant David Gruzman answered some of our burning questions about which Big Data platform to use, whether streaming is a must or not, and what are the biggest...

Last year, we recruited $3 million, got featured on TechCrunch, found new customers, hired more employees, attended conferences around the globe, spent thousands of hours on R&D, and invested a...

One of the greatest Big Data myths, is that you need terabytes or even petabytes of data before you can use Hadoop. However, there are plenty of advantages to using...

Is Apache Spark as hot as you think it is? Although it shines so bright across the Big Data galaxy that some folks think that it may have killed the...

On paper, Spark and Tez have a lot in common: both possess in-memory capabilities, can run on top of Hadoop YARN and support all data types from any data sources....

Every year, dozens of Big Data conferences take place all over the world, from San Francisco to Shanghai. Now that 2015 is finally here, it’s time to open up your...

With Segment and Xplenty, you can sort, filter and aggregate your customer behavior data without writing any code, or installing or maintaining anything.

We want to know more about the Big Data community: what causes them headaches? What makes them happy? Which tools and technologies do they use? When we had our booth...

People talk a lot about Hadoop, and we like to keep up to date with the latest gossip by reading Hadoop blogs. If you'd also like to jump into the...

Data collection, data processing, data visualization, and reporting are becoming more and more challenging as data volumes grow and data formats change. Combined with the increased use of public cloud...

Amazon had some great news at AWS re:Invent 2014 in Vegas—and we were there to hear it. Most of them were geared toward enterprises and developers, but three stood out...

Xplenty notification emails now include “View Job” and “View Cluster” action buttons. The buttons are available at the inbox level, so you can easily interact with jobs and clusters in...

Apache Spark is setting the world of Big Data on fire. With a promise of speeds up to 100 times faster than Hadoop MapReduce and comfortable APIs, some think this...

Big Data is mostly famous, well, for being big. So if you have anything under a petabyte, why would you even think about using Apache Hadoop? But you should.

Following our post about Hadoop security for the enterprise, or the lack thereof, one of the ways to make Hadoop more secure is by installing an additional platform. Five major...

Google BigQuery is a great Big Data warehouse on the cloud for the SQL-savvy. But it’s not right for everything. Google itself recommends using Hadoop’s MapReduce rather than BigQuery for...

New Xplenty features: Redshift merge, Google AdWords Reporting integration and scheduler enhancements

Next week we’ll be heading down to Vegas for AWS re:Invent 2014. We’re eager to meet the Big Data community and attend AWS sessions. There are quite a few of...

While Hadoop has proved its power for scalable storage and processing of Big Data, it may not be enterprise-ready when it comes to security. Hortonworks, Cloudera and MapR address this...

Hadoop YARN may be the gun that hangs on the wall in the first act and kills MapReduce in the last—Google Trends clearly shows that interest in Hadoop is still...

These days, there is a renaissance of Hadoop-based Big Data projects: Impala, Spark, Storm, Flink and HBase as well as several SQL-on-Hadoop tools. Most of these projects are still in...

YARN's promise was big and exciting, but did it deliver? Now that we’ve spent a year with the baby elephant, we're happy to announce YARN Week: a three post series...

IBM joined the cloud computing market when it bought SoftLayer in 2013. One of the services that it provides is cloud-based storage, just like Amazon S3 and Rackspace. You can...

Amazon is not alone in the cloud: Rackspace, a cloud computing company that was established back in 1998 in Texas, is one of its major competitors. It also founded OpenStack,...

Let’s say that you’re doing some marketing for a Big Data startup. As part of your campaign, you want to find the most influential tweeters who talk about Hadoop and...

Screencast on how to connect Amazon S3 with Xplenty.

How do you integrate data from Amazon RDS (Relational Database Service) with data from other sources such as S3, Redshift, or even MongoDB? The answer is Xplenty. Our data integration...

We concentrate on making data processing as fast and easy as possible. To complete the dataflow, Xplenty integrates with a plethora of services that can store, analyze, or visualize data....

New Xplenty features: processing small files, importing Heroku connections, MongoDB secondary replica sets and more.

Xplenty can read data from SQL Server, MongoDB, SAP HANA, and many more data stores. One of the many DBs Xplenty integrates with is Redshift.

Some developers need to process data. Maybe you work in a small startup where people take on several roles, or maybe in an enterprise company where you are asked to...

We’ve uploaded a brand new screencast which shows how to process web server logs with Xplenty.

Many new functions are now available and also run-time variables in the job history.

Everybody has issues, and so do users and repositories on GitHub. That's why we decided to answer this year’s GitHub Data Challenge by heading where developers fear to tread and...

We’ve processed plenty of JSON data in our blog - from Tweets to GitHub commits - but we’ve never really discussed how to process JSON with Xplenty’s data integration on...

We now have these additional features for you..

What if you have a killer idea for GitHub’s Data Challenge but no money, servers, or coders at your disposal? We have the solution for you. You can sign up...

Hadoop is definitely a great solution for processing dark data, but what if you don’t know how to use it? Hadoop requires you to buy new hardware, provide expert maintenance,...

Analyzing the large amounts of data in your data warehouse is now easier than ever with support for the Cube and Rollup functions. You can now aggregate your data across...

Integrating data from MongoDB and a relational database sounds like a major headache. On one hand you have a schemaless NoSQL database containing JSON objects, and on the other, an...

Although the Internet made the world flat, geography still matters. Knowing which countries your users live in could provide business opportunities to localize your services and increase profits. The only...

We've been busy adding new features since the last announcement.

Amazon’s CloudTrail is a service that logs AWS activity. However, these logs need some preparation before they can be analyzed. In this post, we’ll see how to parse these log...

Big Data brother is watching - whenever users surf your website, their browser sends an HTTP header called ‘User Agent’. It tells your web server which browser they’re using, in...

Parsing URL query string parameters is easy with Xplenty. You can take a huge pile of web server logs and analyze them via Xplenty’s visual interface. Let me show you...

The 2014 World Cup is the hottest World Cup ever. Not just because of the soaring temperatures in Brazil that send players begging for water breaks, but also because of...

What can you do with data collected on Heroku PostgreSQL? How will you analyze it and integrate it? With Xplenty, of course! Xplenty lets you connect to a PostgreSQL database...

You’ve spent hours tinkering and preparing the perfect dataflow to batch process zillions of web logs. Feeling satisfied, you run the job on one of the clusters and leave your...

In our previous post, we discussed Mad Men and how to design a data warehouse in the space age of Big Data. This post will take another step forward, or...

In "The Monolith", the fourth episode in Mad Men’s final season, a huge computer is installed in the center of the floor. The computer was brought in because a competing...

Xplenty now provides the capability to directly access source data from relational databases. You can use the new Database Source component to read data directly from Postgres, MySQL and Amazon...

A regular expression, AKA regex, is a powerful yet really confusing tool. Although regular expressions are the technology behind text replacement and natural language processing, they are hard to read,...

Unstructured data is big - according to IDC, about 90 percent of the storage in the world is used for unstructured data. It comes as no surprise considering the amount...

Xplenty loves MongoDB. We’ve already guided you how to integrate with MongoLab, and now we’ll show you how to do data integration on the cloud with Xplenty and MongoHQ.

Did you know that choosing the right join type for your data could improve your data integration performance? Given certain data sets, Pig provides several join algorithms that process them...

Comparing Hive with HBase is like comparing Google with Facebook - although they compete over the same turf (our private information), they don’t provide the same functionality. But things can...

According to the Elephant Care Manual for Mahouts and Camp Managers: "It is essential to cleanse the elephant's body carefully every day by using half of a coconut shell to...

Amazon launched Elastic Map Reduce (EMR) to make Hadoop easier, but there were still too many Hadoop hoops to jump through before processing Big Data. That’s why we founded Xplenty....

There are three ways to collect data on the cloud: storing it directly in the database, uploading log files, or logging via S3/CloudFront. Although we reviewed the pros and cons...

What does it mean to be a pig? Well, according to the philosophers behind the Apache Pig project pigs eat anything, live anywhere, and are domestic animals. They even claim...

Papertrail is a cloud-hosted log management service. We use it internally for business insights and eat our own dogfood by processing the logs on Xplenty, our data integration platform on...

Xplenty can integrate various data sources on the cloud. One of the services it can integrate with is MongoLab, a MongoDB-as-a-service. This post will demonstrate how to connect them together.

Last year Cloudera published a blog post on Big Data’s new use cases: transformation, active archive, and exploration. There’s one more use case that isn’t explicitly mentioned - data integration....

Huge amounts of data are needed to calculate key performance indicators (KPIs), a luxury that only large enterprises were able to afford. This post series discusses how companies of all...

An overview of 12 open source and commercial SQL-on-Hadoop tools: Apache Hive, Apache Sqoop, Apache Phoenix, Impala, Presto, BigSQL, CitusDB, Hadapt, Jethro, Lingual, and HAWQ.

On Monday April 7th an OpenSSL security update was released for the "Heartbleed" vulnerability. Here at Xplenty we've immediately installed the security update to protect ourselves from this vulnerability and...

In his recent article "Turbocharge Your Porsche - Buy An Elephant", Bill Inmon, "the father of data warehousing", criticizes Cloudera for associating Big Data with the data warehouse, two totally...

Introducing Apache Hadoop to the organization can be difficult - everyone is trained and experienced in the old ways of SQL and all the analytics tools integrate with SQL. Certain...

Relational databases are here to stay - they are common, integrate with other information systems, do a good job of querying structured data, and people know how to use them....

Despite the Hadoop hype machine crunching away, not everyone is fond of that little yellow elephant. In fact, some fear it. But why should the cute mammal and the innovative...

Mortal Kombat’s master of ice Sub-Zero and the living-dead fire breathing Scorpion are major archenemies. As the story goes, Sub-Zero and his clan of assassin ninjas slaughtered their rival clan,...

The Sochi 2014 Winter Olympics were the most celebrated winter games on the net. Their official website had more visitors in one night than Vancouver 2010 had during the entire...

Ken and Ryu are both the best of friends and the greatest of rivals in the Street Fighter game series. When it comes to Hadoop data storage on the cloud...

Xplenty now supports the capability to join dataflows using non-equality conditions to compare values between the dataflows. This is done using the new cross join component to define the data...

Hey all you out there in Xplentyland. We haven't forgotten about you. In fact, we've been thinking about you since the last update regarding new features, because we've been adding...you...

We haven’t forgotten about you. In fact, we’ve been thinking about you since the last update regarding new features, because we’ve been adding…you guessed it, new features! So away we...

Last week I packed my suitcase and got on a plane to London. The agenda - presenting at the February Hadoop Users Group UK meetup. The meetup was supposed to...

Big Data was always around in some form or another. At some point, businesses decided to use that information to learn what makes their clients tick with phrases like "sales...

We love things that are great in pairs, things like chocolate and vanilla, gin and tonic, and Simon and Garfunkel. This is why we are proud to announce the new...

Researchers from the University of Bristol measure public mood in the UK by analyzing tweets. In Brazil a team led by a computer scientist use Twitter to identify...

Readers of our blog should know by now that Apache Hadoop is great for offline batch processing of Big Data. But what about online streaming data? What if you’re running...

Childhood dreams do come true - in 2015 "Batman vs. Superman" will bring the world’s biggest superheroes to battle on-screen, finally solving that eternal debate who will prevail (I put...

In the first two posts in the series we learned how to scale data collection on the cloud and collect Big Data with S3/Cloudfront logging. Some of our...

Xplenty is excited to announce we now support Rackspace’s public cloud offering. Rackspace users can now use Xplenty’s Data Integration-as-a-Service to process their data. Xplenty provides you with out of...

Funnel analysis is awesome. Whether your company has a checkout, a registration, or any kind of process on a website or even in real life, funnel analysis lets you see...

Consider for a moment, if you will, plastic patio furniture. Plastic Fantastic is a global manufacturer with several factories, warehouses, and plenty of stores. One can only imagine the sheer...

In our recent article, Scale Your Data Collection on the Cloud Like a Champ, we reviewed several ways of collecting big data, the most promising of which was

When we met with WalkMe, a company which offers helpful in-app walkthroughs (we use it for our app and it’s great), our meeting took a surprising turn. We expected...

We've decided to end the year with some platform upgrades for you. Just a few more tweaks to make Xplenty Hadoop-as-a-Service that much more functional.

We’ve decided to end the year with some platform upgrades for you. Just a few more tweaks to make Xplenty Hadoop-as-a-Service that much more functional.

Monday, December 23. The office is buzzing, at least from the people that didn’t take off the whole week. No one can concentrate, it’s almost time for presents and food,...

Happy holidays everyone! We've been working hard to make the Xplenty Hadoop-as-a-Service platform better and more user friendly for you. We hope you're enjoying your experience with us, and these...

Happy holidays everyone! We’ve been working hard to make the Xplenty Hadoop-as-a-Service platform better and more user friendly for you. We hope you’re enjoying your experience with us, and these...

Now, Hadoop! Now, SQL! Now, NOSQL, and Opensource! On, Cloud technology! On, Apps! On, SaaS, and Infrastructure!

As you know, Hadoop can be downright painful to code. However one of our DevOps, Leonid Mirsky, has done a great job writing a tutorial for creating a test environment...

With all of the various providers around here, as an attendee it can sometimes be easy to get lost in the sea of technology. However we had a great time...

The first full day of re:Invent has come and gone, and it was a great day. Thousands of people from all areas of technology connecting and learning, and most importantly...

Here we are...AWS re:Invent 2013 in Vegas baby Vegas!

We're excited to partner with Hortonworks, the makers of the Hortonworks Data Platform. We believe Hortonworks plays a significant role in the Hadoop ecosystem and powering Xplenty with HDP provides...

First day at Vegas!

Let us just get this out of the way right now - it’s been a while since we've written. But we have a good reason, honest we do. We've been...

It’s been a while since we've written. But we have a good reason, honest we do. We've been making mad upgrades and system tweaks for your benefit.

Xplenty will be presenting at exhibiting in SAP TechEd taking place on Oct. 21-25, at The Venetian/Palazzo Congress Center in Las Vegas. The date is rapidly approaching and we can...

Everyone is always looking for the next big thing.  Big Data isn’t the next big thing, it’s already the big thing. Anyone in an industry that collects mass amounts of...

Peanut butter and jelly. Peas and carrots. Forest and Jenny. Bert and Ernie. Abbot and Costello. Sports and data? Of course.

A couple of weeks ago we posted about the datafication of everything, with a few examples of what can be quantified, and what we can do with that quantified data....

Since studies show people are lazy and can only pay attention for a certain amount of time, writing posts in list form is more...hey anyone see the new Star Trek?...

So I thought I was being original for writing a piece on datafication.  But when I searched it, I saw that many before me had written about it, and just...

Paula Rosenblum writes a fun piece regarding the creepiness of retailers using their Big Data.  In it, she contends that targeting our past purchases to send us relevant offers...

The four V’s.  If you're reading this post, chances are good you know what they stand for.  In the off-chance you don’t, they represent volume, variety, velocity, and value.  The...

When you think of Big Data, the types of companies using it are probably technology based, perhaps in the finance sector, marketing, websites, and anyone else that needs to process...

Data Warehousing projects are challenging. Quite often the sheer amount of business requirements involved, and the data volumes that are attached to it, have made these types of projects notoriously...

Remember back in the day, when phones were for talking and computers were for writing term papers?  Not like this is news, but things are a little different now.

Big Data and Big Brother: Can Security and Privacy Go Hand In Hand, or Does it Even Matter?

After a weeks long contest in which 42 different companies were voted on and compared, Xplenty prevailed and was listed on CIO.com's Top 10 hottest Big Data startups.  Thank...

I remember one time on a status update thread, a friend mentioned something about being bad at finding her way around Tel Aviv.  My response was that probably in the...

Buzz about Big Data has been at fever pitch for over a year now. We hear a lot about how the insights we glean will propel businesses, about emerging technologies, and...

Here, at Xplenty we’re gearing up for the release of our Hadoop-as-a-Service platform in a few days’ time. We’re very excited after working really hard in the past year to...

We are proud to announce a few enhancements we've just rolled out.

• Account Members - you can invite your friends and colleagues to help you solve your big data...

We’ve rolled out some new features for you to manage your cluster and jobs.

We’ve been busy upgrading the platform and have some nifty new features for you.

Xplenty is pleased to announce we are launching a public release. Now anyone can sign up, get a free 14 day trial period in which they can build packages and...

Your very own Xplenty was one of 25 companies chosen from a field of over 100 to present at Tech Tour's 2nd Cloud & Big Data Summit on November 21-22, 2012...

With your big data comes the need to secure it.  How  awful would it be  if your competition got a hold of your data and used it against you, to...

In order for businesses to become truly data-driven in their marketing initiatives, they need the right tools gathering the data and the right people we call "data scientists" deciphering the...

It used to be that it only made sense for the real big guys to employ big data.  They have lots to move in only a short time to do...

With every new advancement, whether technological, medical, industrial, or other, the question of "what impact will this have on the environment?" is bound to arise.  Big Data is not immune.

We're very happy to launch the Xplenty site and to share our vision - and of course our product - with you.