Fivetran now supports Delta Lake on Azure as a destination

Learn all about Fivetran’s new Delta Lake on Azure destination.
July 21, 2023

We're excited to announce that a new data lake destination is now publicly available in Beta at Fivetran: Delta Lake on Azure Data Lake Storage (ADLS).

Delta Lake is the preferred format for data on both Microsoft and Databricks, and Fivetran automates the process of extracting your data, then cleansing, conforming and converting it to Delta Lake format, before loading it into Azure Data Lake Storage. So whether you're already using Azure, Databricks or both, skip the pain of the move and start doing advanced analytics and AI on your data faster.

Why is Fivetran's new Delta Lake on Azure destination a big deal?

Normally, it's difficult to land data from multiple sources into ADLS because a typical organization might have dozens of data sources that they need to build pipelines for, each with its own API and specific quirks. Even if your data engineers succeed in setting one up initially, keeping data in sync is harder than most people imagine. Change data capture can become a major headache, as evolving schemas and API updates can cause breaking changes that lead to sleepless nights.

Fivetran's Delta Lake on ADLS destination is the simplest way to unify all of your data in one place, the lakehouse. Why? We've spent years building and refining our over 500 connectors and have hundreds of engineers whose sole responsibility is maintaining them to ensure an SLA of 99.9 percent uptime. Plus, our platform is completely no-code, changes to your source data are always reliably synced with CDC and a single connector can be set up in less than 10 minutes.

Finally, Delta Lake on Azure is a big deal because it features native integration with Databricks Unity Catalog You can govern and track lineage for your data, enabling you to have full visibility into how your teams are using it to build downstream tables and applications.

How does Fivetran's new Delta Lake on Azure destination work?

With Fivetran, you can seamlessly load data from over 500 sources, including on-premises and cloud data warehouses, databases and SaaS applications. Regardless of where your data resides, you can effortlessly copy it into your lakehouse for advanced analytics and AI, in no time flat.

But we don't stop at basic data replication. We also cleanse, conform, deduplicate and normalize your data, ensuring its quality and consistency. Say goodbye to messy, fragmented data, and hello to synchronized, reliable datasets that are ready for advanced analytics right out of the box.

Finally, no matter what format your initial data is in, our newest destination automates the process of converting it into Delta Lake format. Delta Lake provides enhanced reliability, scalability and performance for your lakehouse, enabling efficient query processing and data manipulation with Python, SQL or Scala.

What are the limitations of the new destination?

As of July 2024, support for Databricks Unity Catalog is live and the Delta Lake on Azure destination is available in all Fivetran-supported regions.

How does Delta Lake on ADLS differ from Fivetran's existing support for Databricks as a destination?

Our new lakehouse offering isn't specific to just Databricks. Many of our customers using the Azure cloud also use Delta Lake along with Azure Synapse Analytics and other native Azure services.

For customers who are planning to land data in Delta Lake on ADLS using Databricks, we made a number of enhancements to this offering that make it different, including:

  • Integration with Databricks Unity Catalog
  • Less expensive ingestion using Fivetran compute, instead of Databricks compute

What's coming next for data lake destinations at Fivetran?

We’ll be adding support for Microsoft Fabric and OneLake. Ultimately, our goal is to support data ingestion from all of our data sources onto any cloud, in any analytics format.

NOTE: As of July 2024, we support Microsoft Fabric and OneLake as well.

To get started with Delta Lake on Azure as a destination, start a 14-day free trial.

Kostenlos starten

Schließen auch Sie sich den Tausenden von Unternehmen an, die ihre Daten mithilfe von Fivetran zentralisieren und transformieren.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Product
Product

Fivetran now supports Delta Lake on Azure as a destination

Fivetran now supports Delta Lake on Azure as a destination

July 21, 2023
July 21, 2023
Fivetran now supports Delta Lake on Azure as a destination
Learn all about Fivetran’s new Delta Lake on Azure destination.

We're excited to announce that a new data lake destination is now publicly available in Beta at Fivetran: Delta Lake on Azure Data Lake Storage (ADLS).

Delta Lake is the preferred format for data on both Microsoft and Databricks, and Fivetran automates the process of extracting your data, then cleansing, conforming and converting it to Delta Lake format, before loading it into Azure Data Lake Storage. So whether you're already using Azure, Databricks or both, skip the pain of the move and start doing advanced analytics and AI on your data faster.

Why is Fivetran's new Delta Lake on Azure destination a big deal?

Normally, it's difficult to land data from multiple sources into ADLS because a typical organization might have dozens of data sources that they need to build pipelines for, each with its own API and specific quirks. Even if your data engineers succeed in setting one up initially, keeping data in sync is harder than most people imagine. Change data capture can become a major headache, as evolving schemas and API updates can cause breaking changes that lead to sleepless nights.

Fivetran's Delta Lake on ADLS destination is the simplest way to unify all of your data in one place, the lakehouse. Why? We've spent years building and refining our over 500 connectors and have hundreds of engineers whose sole responsibility is maintaining them to ensure an SLA of 99.9 percent uptime. Plus, our platform is completely no-code, changes to your source data are always reliably synced with CDC and a single connector can be set up in less than 10 minutes.

Finally, Delta Lake on Azure is a big deal because it features native integration with Databricks Unity Catalog You can govern and track lineage for your data, enabling you to have full visibility into how your teams are using it to build downstream tables and applications.

How does Fivetran's new Delta Lake on Azure destination work?

With Fivetran, you can seamlessly load data from over 500 sources, including on-premises and cloud data warehouses, databases and SaaS applications. Regardless of where your data resides, you can effortlessly copy it into your lakehouse for advanced analytics and AI, in no time flat.

But we don't stop at basic data replication. We also cleanse, conform, deduplicate and normalize your data, ensuring its quality and consistency. Say goodbye to messy, fragmented data, and hello to synchronized, reliable datasets that are ready for advanced analytics right out of the box.

Finally, no matter what format your initial data is in, our newest destination automates the process of converting it into Delta Lake format. Delta Lake provides enhanced reliability, scalability and performance for your lakehouse, enabling efficient query processing and data manipulation with Python, SQL or Scala.

What are the limitations of the new destination?

As of July 2024, support for Databricks Unity Catalog is live and the Delta Lake on Azure destination is available in all Fivetran-supported regions.

How does Delta Lake on ADLS differ from Fivetran's existing support for Databricks as a destination?

Our new lakehouse offering isn't specific to just Databricks. Many of our customers using the Azure cloud also use Delta Lake along with Azure Synapse Analytics and other native Azure services.

For customers who are planning to land data in Delta Lake on ADLS using Databricks, we made a number of enhancements to this offering that make it different, including:

  • Integration with Databricks Unity Catalog
  • Less expensive ingestion using Fivetran compute, instead of Databricks compute

What's coming next for data lake destinations at Fivetran?

We’ll be adding support for Microsoft Fabric and OneLake. Ultimately, our goal is to support data ingestion from all of our data sources onto any cloud, in any analytics format.

NOTE: As of July 2024, we support Microsoft Fabric and OneLake as well.

To get started with Delta Lake on Azure as a destination, start a 14-day free trial.

Verwandte Beiträge

Fivetran supports Amazon S3 as a destination with open table formats
Product

Fivetran supports Amazon S3 as a destination with open table formats

Beitrag lesen
Unleashing the power of Fivetran and Azure Synapse for accelerated data movement
Data insights

Unleashing the power of Fivetran and Azure Synapse for accelerated data movement

Beitrag lesen
Why Fivetran supports data lakes
Product

Why Fivetran supports data lakes

Beitrag lesen
No items found.
Fivetran named a Challenger in 2024 Gartner® Magic Quadrant™
Blog

Fivetran named a Challenger in 2024 Gartner® Magic Quadrant™

Beitrag lesen
The path to better patient care: Securing and scaling healthcare data
Blog

The path to better patient care: Securing and scaling healthcare data

Beitrag lesen
Fivetran brings automated data integration to Amazon SageMaker Lakehouse
Blog

Fivetran brings automated data integration to Amazon SageMaker Lakehouse

Beitrag lesen

Kostenlos starten

Schließen auch Sie sich den Tausenden von Unternehmen an, die ihre Daten mithilfe von Fivetran zentralisieren und transformieren.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.