Hybrid Deployment Private Previewlink
IMPORTANT: You must have a Business Critical plan to use the Hybrid Deployment model.
Fivetran's Hybrid Deployment model enables organizations to sync data sources using Fivetran while ensuring the data never leaves the secure perimeter of the cloud or on-premises network. This architecture grants you complete control over your data's flow, allowing you to meet specific business needs concerning data security.
With the Hybrid model, you decide where to host the data pipelines, in our secure cloud or within your local environment, while still enjoying the advantages of an automated SaaS model. Your data remains within your private network, with Fivetran serving as a unified control plane for all your data movements. This setup not only supports Hybrid and multi-cloud deployments but also offers an extensible solution complete with APIs, metadata sharing, and more. Additionally, it simplifies troubleshooting, provides straightforward setup, and is easy to configure and support.
When setting up a new data pipeline, you have the option to run it locally. By installing a local processing agent within your environment that communicates outbound with Fivetran, you maintain full control over your data. This agent manages the data pipeline processing in your network, with configuration and monitoring still performed through the Fivetran dashboard or API. Only metadata (including MAR information) and logs are sent to Fivetran, which allows Fivetran to understand how the pipeline is running and to display the details in the dashboard.
Key capabilitieslink
The key capabilities of the SaaS Deployment model:
- Data ingestion and preparation
- Parallel processing
- Temporary data storage: you own and manage the temporary data storage (buckets)
- Data load into a destination
Data privacy and security: Our Hybrid model processes data within your infrastructure, keeping your actual data within the secure boundaries of your network.
Local processing agent: You host this agent on your infrastructure. It connects your local environment to Fivetran's Managed SaaS, maintaining constant communication with Fivetran to determine when the data pipeline needs to run. The local agent picks up those details from Fivetran's orchestration layer to perform the sync.
Deployment and operation: To use the Hybrid model, download the agent configuration files to a Linux machine equipped with Docker or Podman. After setting up the local processing agent on your network, the agent manages data pipeline processing within that network. Configuration and monitoring of the data pipeline still occur within the Fivetran environment (via the Fivetran dashboard or API). The agent only sends metadata, including syncs metrics, MAR information and logs to Fivetran's cloud for tracking and monitoring purposes, accessible via the Fivetran dashboard.
Network Security: The local processing agent creates a secure outbound connection to Fivetran using modern encryption standards like mTLS. You have the option to limit the outbound traffic to the Fivetran endpoint.
Capacity and limitations: Each local processing agent can support one destination and up to 10 connectors. It's crucial to plan your deployment strategy with these limitations in mind.
NOTE: Each local processing agent can support 1 destination and up to 10 connectors.
Supported connectorslink
Fivetran supports Hybrid Deployment for the following connectors:
NOTE: On the Fivetran dashboard, you can identify the connectors that support Hybrid Deployment by the
Local data processing
text next to their names.
Supported destinationslink
Fivetran supports Hybrid Deployment for the following destinations:
NOTE: On the Fivetran dashboard, you can identify the destinations that support Hybrid Deployment by the
Local data processing
text next to their names.
Setup guidelink
Follow our step-by-step Hybrid Deployment setup guide to set up the Hybrid Deployment architecture for your data pipeline.