Manage data pipelines at scale with the Fivetran REST API

Learn how the Fivetran REST API allows you to programmatically manage users, groups and connectors to scale data workflows and improve your overall security posture.

The Fivetran API is a powerful way to interact with Fivetran outside of the user interface (UI). Rather than clicking in the Fivetran UI to perform actions — such as creating connectors — the Fivetran API allows you to send your instructions programmatically using written requests. 

This makes it an efficient, consistent, and powerful way to perform bulk actions, communicate with Fivetran from a different application and automate human-led processes using codified logic. 

Fivetran REST API use cases

For organizations that have a large number of repetitive operations, the Fivetran API eliminates timely manual processes and the potential of human error by offering programmatic control to manage users, groups, connectors and more. Here are common use cases by Fivetran customers.

Create and manage pipelines at scale

Using the scalability of the Fivetran API, engineers can save time by creating and editing any number of connectors at once. Bulk actions can be made to control user access and permissions, and even provision new groups of users at any quantity. By programmatically designing workflows to be efficient, consistent and repeatable, your data team will save hours on low-value repetitive actions, freeing up their time for more business-critical tasks and analysis. 

Datasheet: Fivetran Metadata API​​

DOWNLOAD

Improve your overall security posture 

In addition to Fivetran’s core security capabilities and compliances, Fivetran customers are leveraging the API to improve their overall security posture. For example, a Fivetran customer that has databases with frequent password changes uses the Fivetran API to manage the rotating credentials so that users do not need to manually re-authenticate. This helps to keep its organization and customers’ data safe and secure. Certificate management endpoints ensure Fivetran only connects to data sources that are approved. This is critical to establish confidentiality and security when data is exchanged.

Extend Fivetran using integrations to your favorite developer tools

As the complexity of your data stack grows, Fivetran can integrate with other technologies including Airflow, Astronomer and Terraform via the REST API. Using the API integration, users can monitor Fivetran data syncs from within Airflow for end-to-end data pipeline orchestration. Those with multiple deployment environments can use Fivetran and Terraform to ensure the changes or additions at a data source level are verified in development or test environments before publication in a production data warehouse. By extending the reach of the API beyond Fivetran, your business can scale and automate the flow of data across your entire modern data stack. 

Sync data from customers to your software product

Powered by Fivetran (PBF) enables product development teams to connect data from their customers’ sources to their software product. These Fivetran users build applications and portals that provide analytics as a service to their customers. Rather than creating and maintaining data pipelines themselves — a resource-intensive process — PBF customers focus their efforts on creating the analytics and user experiences that differentiate their product from competitors. In this scenario, the Fivetran API is used to allow end-users to authenticate a connection between their sources and Fivetran themselves, all from the convenience of the application’s user interface.


Powered by Fivetran customer, Involve, uses Fivetran Connect Cards to let their customers connect their data to their app from their app

“With less time required to triage problems, we can spend more time building our apps.” -Saumya Bhatnagar, Chief Product Officer and Founder, Involve

Whether meeting enterprise-size demands for pipeline management or building a product that needs to create connectors programmatically, the Fivetran REST API is a powerful tool for developers to interface with Fivetran. To test our API and understand the full scope of what’s possible, visit our interactive API docs.  

Try Fivetran's new API Reference

LEARN MORE

Start for free

Join the thousands of companies using Fivetran to centralize and transform their data.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Blog

Manage data pipelines at scale with the Fivetran REST API

August 9, 2022
Manage data pipelines at scale with the Fivetran REST API
Topics
No items found.
Share
Learn how the Fivetran REST API allows you to programmatically manage users, groups and connectors to scale data workflows and improve your overall security posture.

The Fivetran API is a powerful way to interact with Fivetran outside of the user interface (UI). Rather than clicking in the Fivetran UI to perform actions — such as creating connectors — the Fivetran API allows you to send your instructions programmatically using written requests. 

This makes it an efficient, consistent, and powerful way to perform bulk actions, communicate with Fivetran from a different application and automate human-led processes using codified logic. 

Fivetran REST API use cases

For organizations that have a large number of repetitive operations, the Fivetran API eliminates timely manual processes and the potential of human error by offering programmatic control to manage users, groups, connectors and more. Here are common use cases by Fivetran customers.

Create and manage pipelines at scale

Using the scalability of the Fivetran API, engineers can save time by creating and editing any number of connectors at once. Bulk actions can be made to control user access and permissions, and even provision new groups of users at any quantity. By programmatically designing workflows to be efficient, consistent and repeatable, your data team will save hours on low-value repetitive actions, freeing up their time for more business-critical tasks and analysis. 

Datasheet: Fivetran Metadata API​​

DOWNLOAD

Improve your overall security posture 

In addition to Fivetran’s core security capabilities and compliances, Fivetran customers are leveraging the API to improve their overall security posture. For example, a Fivetran customer that has databases with frequent password changes uses the Fivetran API to manage the rotating credentials so that users do not need to manually re-authenticate. This helps to keep its organization and customers’ data safe and secure. Certificate management endpoints ensure Fivetran only connects to data sources that are approved. This is critical to establish confidentiality and security when data is exchanged.

Extend Fivetran using integrations to your favorite developer tools

As the complexity of your data stack grows, Fivetran can integrate with other technologies including Airflow, Astronomer and Terraform via the REST API. Using the API integration, users can monitor Fivetran data syncs from within Airflow for end-to-end data pipeline orchestration. Those with multiple deployment environments can use Fivetran and Terraform to ensure the changes or additions at a data source level are verified in development or test environments before publication in a production data warehouse. By extending the reach of the API beyond Fivetran, your business can scale and automate the flow of data across your entire modern data stack. 

Sync data from customers to your software product

Powered by Fivetran (PBF) enables product development teams to connect data from their customers’ sources to their software product. These Fivetran users build applications and portals that provide analytics as a service to their customers. Rather than creating and maintaining data pipelines themselves — a resource-intensive process — PBF customers focus their efforts on creating the analytics and user experiences that differentiate their product from competitors. In this scenario, the Fivetran API is used to allow end-users to authenticate a connection between their sources and Fivetran themselves, all from the convenience of the application’s user interface.


Powered by Fivetran customer, Involve, uses Fivetran Connect Cards to let their customers connect their data to their app from their app

“With less time required to triage problems, we can spend more time building our apps.” -Saumya Bhatnagar, Chief Product Officer and Founder, Involve

Whether meeting enterprise-size demands for pipeline management or building a product that needs to create connectors programmatically, the Fivetran REST API is a powerful tool for developers to interface with Fivetran. To test our API and understand the full scope of what’s possible, visit our interactive API docs.  

Try Fivetran's new API Reference

LEARN MORE
No items found.

Related blog posts

No items found.
No items found.
No items found.

Start for free

Join the thousands of companies using Fivetran to centralize and transform their data.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.