Database connector setup: A step-by-step guide

Learn the five quick and easy steps to setup database connectors.
October 20, 2023

Are you considering Fivetran for your database replication and wondering where to start? 

There are many considerations when setting up a new connector for your database replication, including your use case, security requirements and database stakeholders. 

In this guide, we’ll walk you through everything you need to know to make your database connector setup successful. 

Learn how to utilize a combination of the Fivetran documentation, in-app connector setup guides and our numerous resources to properly set up a database connector and gain reliable access to your business-critical data.

With these five easy steps, you’ll have your data moving from your database to your cloud destination in no time.

Step 1: Outline your setup plan for success

Build a successful implementation by ensuring you have all the necessary details to power your database replication before you begin the setup process.

Key stakeholders to involve in the setup process:

  • Database architect: Get easy access to all the important database details you may need to complete the setup process
  • Security team: Ensure you’re using a connection method approved by your security team and able to troubleshoot any issues
  • Database analyst or analytics team: Understand the why behind your data and the importance of each column and table for replication

Key details for an efficient setup:

  • Your database host’s IP or domain name: Helps you connect your database to the Fivetran connector for reliable and efficient syncs
  • The port you will use: Number varies by database and there are potentially multiple options for encrypted or unencrypted connections
  • A database user for Fivetran exclusive use: Allows Fivetran to run in the background without any other database processes or user details affecting your syncs

This information will help answer any questions you may have during the setup process and ensure everything runs smoothly once you click save and test on the connector setup form.

Step 2: Gather the required information

Once you have outlined the necessary information, now it’s time to meet with your stakeholders and make informed decisions about your data movement.

Make a decision on your connection option:

To ensure we meet the needs of all of our customers and prospects, Fivetran offers multiple connection options to choose from.

  • Direct connection - the fastest and easiest way to connect is to allow Fivetran IP direct access to your database port
  • SSH tunnel - a more secure way to connect by setting up an SSH tunnel server that has access to your database port
  • AWS PrivateLink, Azure Private Link, or Google Cloud Private Service Connect - allows VPCs and cloud-hosted or on-premises services to communicate with one another without exposing traffic to the public internet
  • VPN tunnel - establish a secure connection between your device and a remote server to access the internet securely, hide your IP address, and encrypt your online activities
  • Proxy Agent - replaces the need for other complicated networking options by installing an agent in the customer's network to create an outbound network connection to Fivetran for secure communication between Fivetran processes and your database without opening an inbound port in your firewall or other access control systems

Make a decision on your replication method:

Fivetran offers multiple ways to replicate data depending on the location and operations of your database.

  • Log-based change data capture: Read changes directly from your database logs for efficient replication to your destination
  • Log-free change data capture: Use Fivetran proprietary replication method, offering the completeness of snapshots while approaching the speed of log-based systems with just a read-only SQL connection

By making these decisions before starting the setup process, you can easily navigate the setup form.

Step 3: Set up your database connector

Now that you’ve gathered all of the necessary inputs, you can breeze through connector setup: 

  • Select the connector you would like to add here
  • Work through each of the items on the setup form using the information you collected
  • Choose your connection and update method
  • Click save and test to validate everything is correct

With everything validated, you can easily finish setting up your connector. In the dashboard for each connector, you can select the schema, change sync frequency and examine connector details. Each of these items will lead to successful data movement with Fivetran.

Step 4: Update and monitor your connector

Fivetran gives you easy access to all your database connectors, allowing you to update and monitor your data movement. Every Fivetran connector has a unique dashboard where you can look through recent syncs, user actions and alerts, helping you monitor the operations of your connector.

Other items that are easily accessible on the connector dashboard include the logs, schema, usage and setup tabs. Each of these tabs serve an important part in your connector monitoring. 

Our logs are compatible with logging services such as the Fivetran Platform connector or other external logging tools. In the schema tab, you can update or change schemas syncing from your database, as well as hide or hash certain columns and tables. 

The usage tab helps you keep track of the amount of data you’re moving and monitor your current MAR numbers. 

Lastly, the setup tab houses your connector details and allows you to update your sync frequency — anywhere from one minute to one day. 

Step 5: Relax with the power of automated data movement

Fivetran allows you to set up your connectors and leave them without worry. With features such as automated schema drift handling and automated resyncs in the event of a failure, Fivetran keeps your connectors up and running with a guaranteed 99.9% SLA. 

By completing these five simple steps, you can ensure that your database replication is reliable and effective, giving you pipeline peace of mind. 

[CTA_MODULE]

Kostenlos starten

Schließen auch Sie sich den Tausenden von Unternehmen an, die ihre Daten mithilfe von Fivetran zentralisieren und transformieren.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Product
Product

Database connector setup: A step-by-step guide

Database connector setup: A step-by-step guide

October 20, 2023
October 20, 2023
Database connector setup: A step-by-step guide
Learn the five quick and easy steps to setup database connectors.

Are you considering Fivetran for your database replication and wondering where to start? 

There are many considerations when setting up a new connector for your database replication, including your use case, security requirements and database stakeholders. 

In this guide, we’ll walk you through everything you need to know to make your database connector setup successful. 

Learn how to utilize a combination of the Fivetran documentation, in-app connector setup guides and our numerous resources to properly set up a database connector and gain reliable access to your business-critical data.

With these five easy steps, you’ll have your data moving from your database to your cloud destination in no time.

Step 1: Outline your setup plan for success

Build a successful implementation by ensuring you have all the necessary details to power your database replication before you begin the setup process.

Key stakeholders to involve in the setup process:

  • Database architect: Get easy access to all the important database details you may need to complete the setup process
  • Security team: Ensure you’re using a connection method approved by your security team and able to troubleshoot any issues
  • Database analyst or analytics team: Understand the why behind your data and the importance of each column and table for replication

Key details for an efficient setup:

  • Your database host’s IP or domain name: Helps you connect your database to the Fivetran connector for reliable and efficient syncs
  • The port you will use: Number varies by database and there are potentially multiple options for encrypted or unencrypted connections
  • A database user for Fivetran exclusive use: Allows Fivetran to run in the background without any other database processes or user details affecting your syncs

This information will help answer any questions you may have during the setup process and ensure everything runs smoothly once you click save and test on the connector setup form.

Step 2: Gather the required information

Once you have outlined the necessary information, now it’s time to meet with your stakeholders and make informed decisions about your data movement.

Make a decision on your connection option:

To ensure we meet the needs of all of our customers and prospects, Fivetran offers multiple connection options to choose from.

  • Direct connection - the fastest and easiest way to connect is to allow Fivetran IP direct access to your database port
  • SSH tunnel - a more secure way to connect by setting up an SSH tunnel server that has access to your database port
  • AWS PrivateLink, Azure Private Link, or Google Cloud Private Service Connect - allows VPCs and cloud-hosted or on-premises services to communicate with one another without exposing traffic to the public internet
  • VPN tunnel - establish a secure connection between your device and a remote server to access the internet securely, hide your IP address, and encrypt your online activities
  • Proxy Agent - replaces the need for other complicated networking options by installing an agent in the customer's network to create an outbound network connection to Fivetran for secure communication between Fivetran processes and your database without opening an inbound port in your firewall or other access control systems

Make a decision on your replication method:

Fivetran offers multiple ways to replicate data depending on the location and operations of your database.

  • Log-based change data capture: Read changes directly from your database logs for efficient replication to your destination
  • Log-free change data capture: Use Fivetran proprietary replication method, offering the completeness of snapshots while approaching the speed of log-based systems with just a read-only SQL connection

By making these decisions before starting the setup process, you can easily navigate the setup form.

Step 3: Set up your database connector

Now that you’ve gathered all of the necessary inputs, you can breeze through connector setup: 

  • Select the connector you would like to add here
  • Work through each of the items on the setup form using the information you collected
  • Choose your connection and update method
  • Click save and test to validate everything is correct

With everything validated, you can easily finish setting up your connector. In the dashboard for each connector, you can select the schema, change sync frequency and examine connector details. Each of these items will lead to successful data movement with Fivetran.

Step 4: Update and monitor your connector

Fivetran gives you easy access to all your database connectors, allowing you to update and monitor your data movement. Every Fivetran connector has a unique dashboard where you can look through recent syncs, user actions and alerts, helping you monitor the operations of your connector.

Other items that are easily accessible on the connector dashboard include the logs, schema, usage and setup tabs. Each of these tabs serve an important part in your connector monitoring. 

Our logs are compatible with logging services such as the Fivetran Platform connector or other external logging tools. In the schema tab, you can update or change schemas syncing from your database, as well as hide or hash certain columns and tables. 

The usage tab helps you keep track of the amount of data you’re moving and monitor your current MAR numbers. 

Lastly, the setup tab houses your connector details and allows you to update your sync frequency — anywhere from one minute to one day. 

Step 5: Relax with the power of automated data movement

Fivetran allows you to set up your connectors and leave them without worry. With features such as automated schema drift handling and automated resyncs in the event of a failure, Fivetran keeps your connectors up and running with a guaranteed 99.9% SLA. 

By completing these five simple steps, you can ensure that your database replication is reliable and effective, giving you pipeline peace of mind. 

[CTA_MODULE]

Topics
No items found.
Share

Verwandte Beiträge

How Fivetran solved database replication
Data insights

How Fivetran solved database replication

Beitrag lesen
The importance of database analytics
Data insights

The importance of database analytics

Beitrag lesen
5 critical features of modern data movement
Data insights

5 critical features of modern data movement

Beitrag lesen
No items found.
Fivetran simplifies SAP data integration to cloud
Blog

Fivetran simplifies SAP data integration to cloud

Beitrag lesen
How to automate SAP ERP data movement into Databricks with Fivetran
Blog

How to automate SAP ERP data movement into Databricks with Fivetran

Beitrag lesen
Try out the Fivetran dbt™ package for SAP
Blog

Try out the Fivetran dbt™ package for SAP

Beitrag lesen

Kostenlos starten

Schließen auch Sie sich den Tausenden von Unternehmen an, die ihre Daten mithilfe von Fivetran zentralisieren und transformieren.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.