Transform Data from Amazon RDS with Xplenty

Transform Data from Amazon RDS with Xplenty

How do you integrate data from Amazon RDS (Relational Database Service) with data from other sources such as S3, Redshift, or even MongoDB? The answer is Xplenty. Our data integration on the cloud lets you join data from various sources and then process it to gain new insights. What about storing the results back to RDS? No problemo, Xplenty does that as well.

Connecting to RDS

First of all we need to connect to the database running on RDS before we can extract or store data:

  1. Log in to the AWS dashboard and then go to the RDS section.

  2. Configure your RDS security policy so that Xplenty will be able to connect to it. For full details, please see the Xplenty knowledge base.

  3. Open the relevant RDS instance and copy the endpoint URL, port, DB name and username (the password is not available on this screen).

    amazon rds instance

  4. Log in to Xplenty, click the user icon at the top right, and go to ‘Manage Connections’.

  5. Click ‘new database connection’ and choose the connection type – either MySQL or PostgreSQL.

    connections

  6. Fill in the relevant fields and click ‘test connection’. If this doesn’t work, either one of the fields hasn’t been filled in correctly, or the security settings haven’t been set as instructed.

    new mysql connection

  7. Click the green ‘create connection’ button to save the connection.

  8. Repeat the process if your destination database is different from the source database.

Integrating Data from RDS

  1. Create a new Xplenty package.

  2. Click the ‘new source’ button at the top and select ‘Database’.

  3. Edit the component that has just been added by clicking it.

  4. Select the database connection and fill in the fields.
    database source

  5. Click the green auto-detect schema button at the top right.

  6. Finally, click ‘okay’ to save the settings.

  7. Add additional sources such as MongoDB or Cloud Storage for S3.

  8. Use a join component to integrate data from both sides.

    join rds and mongodb

For an example of integrating a relational database with MongoDB, please see “How to Integrate MongoDB with Relational Databases”.

Storing Data in RDS

  1. Click the plus button on the last component in the chain and select ‘Database’ under ‘destinations’.

  2. Click the component.

  3. Select the database connection (it may be different from the source connection) and fill in the fields.

    database destination

  4. Click the green auto-fill fields button at the top right.

  5. Finally, click ‘okay’ to save the settings.

Summary

With Xplenty, you can easily combine data from Amazon RDS with data from other sources, process it and store the results back to RDS for further querying. Sign up to Xplenty for free and see what it can do with your data.


Integrate Your Data Today!

Get a 7-day free trial. No credit card necessary.