Cloud Data Integration with MongoHQ and Xplenty

Cloud Data Integration with MongoHQ and Xplenty



Xplenty loves MongoDB - MongoDB is great for storing and querying data, while Xplenty is great for transforming the data and getting it ready for analysis. That’s why we integrate with MongoHQ, one of the leading MongoDB-as-a-Service solutions. Since MongoHQ is built on the cloud, it allows for fast and scalable work with MongoDB. With Xplenty also available on the cloud, you can read data right from a MongoHQ collection, process it via Xplenty’s user interface, and store it right back.

MongoHQ Settings

  1. Sign in to your MongoHQ account or sign up if you don’t have one.

  2. Open the relevant DB in the dashboard.

  3. A database user must be added. If there is no user, a message will prompt you to create one. Click it and follow the instructions. Keep a note with the database username and password on the side (note - they may be different than the username and password for the whole account).

  4. Create a collection for the DB if one is not available by clicking the Add Collection button.

    mongohq3.PNG

  5. Click the Admin link on the left. Check the line that appears under “Mongo URI” in “Connection Strings” and note down the host and port number. E.g., if the URI displayed is mongodb://<user>:<password>@oceanic.mongohq.com:10063/customers, then the host is oceanic.mongohq.com and the port number is 10063.

    mongohq2.PNG

  6. If you need to migrate data into your MongoHQ database, please refer to the documentation.

Xplenty Settings

  1. Login to your Xplenty account. If you don’t have one, create a free account.

  2. In your account, click the user image on the top right and choose Account settings.

  3. Click the Connections menu on the left, click New Database Connection, and choose MongoDB.

mongohq.PNG  

  1. Enter any name that you want for the connection, and then insert the relevant MongoHQ database details. Note that the username and password are for the specific database which you are trying to access, not the MongoHQ account. Also make sure to disable the “Connect using SSL” checkbox since it isn’t supported.

  2. Click the Test Connection button at the bottom to make sure the connection works. If it fails, one of the details that you entered is incorrect. Go back to the MongoHQ Settings section and make sure all the details are accurate.

  3. Click the Create MongoDB Connection button.

  4. Create a new Xplenty package via My Packages, New Package, to define your new data flow.

  5. Click the New Source button at the top and choose MongoDB.

    xplenty-mongodb-source.png  

  6. Click the component that was just added. The MongoDB Source dialog should appear. Choose the MongoDB connection that you previously created in the MongoDB Connection dropdown, and enter the source collection name. Click the green auto-detect schema button on the right. The schema should be filled automatically. For more info how to work with MongoDB source components, please refer to the help section.

  7. Back on the package screen, add components to process the data as necessary.

  8. To save the processed data back on MongoHQ, add a MongoDB destination. Click the component to open the edit dialog. Choose the relevant MongoDB connection and enter the target collection (probably different than the source collection). Note that you can also store the output of the data flow to a relational database or to delimited files, using other destination components.

    mongohq4.png

  9. All done! To run the job, you will need to setup a cluster. Please refer to the documentation for further details.


Integrate Your Data Today!

Try Xplenty free for 7 days. No credit card required.