Charles Wang

Build vs. buy data pipelines: Costs to consider

Build vs. buy data pipelines: Costs to consider

A few simple calculations illustrate why it's ill-advised to build your own data pipeline.

Data integration and the data hierarchy of needs

Data integration and the data hierarchy of needs

Data integration plays a foundational role in the progression to data and analytics mastery.

What is a database schema? Types and uses in data integration

What is a database schema? Types and uses in data integration

Database schemas help with data integration and database optimization to drive better analysis and faster results.

What is ETL?

What is ETL?

Data integration continues to evolve.

What is ELT?

What is ELT?

Extract, load and transform, or ELT, is a data integration process that moves data directly from source to destination for analysts to transform as needed.

 What is a data pipeline?

What is a data pipeline?

A data pipeline is a series of actions that combine data from multiple sources for analysis or visualization.

Reliable data replication in the face of schema drift

Reliable data replication in the face of schema drift

Use these techniques to ensure that data replication remains robust, even as schemas change.

A visual guide to transformations: The Salesforce data model

A visual guide to transformations: The Salesforce data model

Analysis-ready data models are built using sequences of transformations. Here's how we create our data model for Salesforce.

What is a data mart?

What is a data mart?

Data marts are miniature, specialized data warehouses.

What is a data lake?

What is a data lake?

Data lakes serve as central destinations for business data and offer users a platform to guide business decisions.

What is data transformation?

What is data transformation?

Learn why data transformation is essential to data modeling and bringing your organization to the forefront of data literacy.

What is data integration?

What is data integration?

Learn how data integration is the key to a mature analytics practice and more.

Ten database schema best practices

Ten database schema best practices

Follow these tips to ensure that your database schema delivers maximum utility for data warehouse users, data analysts and data scientists.

Eleven database schema mistakes to avoid

Eleven database schema mistakes to avoid

A good database schema is indispensable for making data warehouses work. Get it wrong, and you’ll be in a world of hurt.

Data lakes vs. data warehouses

Data lakes vs. data warehouses

Successful analytics depends on choosing the right approach to storing your enterprise data.

What is the modern data stack?

What is the modern data stack?

A radically new approach to data integration saves engineering time, allowing engineers and analysts to pursue higher-value activities.

ETL vs. ELT: Choose the right approach for data integration

ETL vs. ELT: Choose the right approach for data integration

Learn about ETL and ELT so you can decide which method works for you.

Product managers! Join us at #mdscon 2021

Product managers! Join us at #mdscon 2021

This year's Modern Data Stack Conference features speakers and sessions for data professionals of all kinds.

Team leads! Join us at #mdscon 2021

Team leads! Join us at #mdscon 2021

This year's Modern Data Stack Conference features speakers and sessions for data professionals of all kinds.

Applying the scientific method to improve business intelligence

Applying the scientific method to improve business intelligence

The scientific method is a proven route to successful, tested and verified improvement. Here’s how to combine it with BI.

Data analysts! Join us at #mdscon 2021

Data analysts! Join us at #mdscon 2021

This year's conference features speakers and sessions for data professionals of all kinds.

Data engineers and data architects! Join us at #mdscon 2021

Data engineers and data architects! Join us at #mdscon 2021

This year's Modern Data Stack Conference features speakers and sessions for data professionals of all kinds.

How to handle HIPAA concerns with cloud data warehouses

How to handle HIPAA concerns with cloud data warehouses

Achieve HIPAA compliance and reduce risk while offloading some of your operational burden.

Data analytics vs. business intelligence

Data analytics vs. business intelligence

Should your data team focus on business problems and use cases, or expand into more complex areas like predictive analytics?

Business intelligence: What you need to know

Business intelligence: What you need to know

Business intelligence is the art of extracting actionable insights from your data. There’s a whole stack of technologies under the hood.

Data warehouse vs. database

Data warehouse vs. database

Data warehouses are a particular kind of database. Learn how they are uniquely suited to analytics.

The importance of ETL security

The importance of ETL security

ETL security is essential for safeguarding your customer's data and complying with regulations. Learn about the Fivetran approach.

dbt explained

dbt explained

Learn how dbt adds data modeling and transformation to the modern data stack.

Introducing the Fivetran Protocol

Introducing the Fivetran Protocol

Here's how SaaS providers can build bulletproof data replication APIs.

Data transformation fundamentals, uses and tools

Data transformation fundamentals, uses and tools

Data can transform a struggling business into a successful one, but first, you need to transform the data. Here’s how.

Key considerations for pipeline performance

Key considerations for pipeline performance

Data pipeline performance hinges on several important techniques, including algorithmic optimization and parallelization.

What is a data lakehouse?

What is a data lakehouse?

The data lakehouse is a promising new technology that combines aspects of data warehouses and data lakes.

When to use NoSQL and MongoDB

When to use NoSQL and MongoDB

What is MongoDB used for? Learn how MongoDB and its Fivetran connector can help you.

SQL vs. NoSQL: Database differences explained

SQL vs. NoSQL: Database differences explained

What is NoSQL, and what does it bring to the table?

ETL platform alternatives: Fivetran vs. Informatica and more

ETL platform alternatives: Fivetran vs. Informatica and more

Compare popular data integration tools on cost, security, reliability and number of supported sources.

Which connectors does your ETL tool need?

Which connectors does your ETL tool need?

Make sure your data integration solution can connect to critical data sources.

How to compare ETL tools

How to compare ETL tools

Use these criteria to choose the best ETL tool for your data integration needs.

Network performance and data integration

Network performance and data integration

Data integration can easily become non-performant. Learn about some common bottlenecks.

Five things I’ve learned from building analytics stacks at J.P. Morgan and Fivetran

Five things I’ve learned from building analytics stacks at J.P. Morgan and Fivetran

These data management best practices apply to both large enterprises and fast-growing startups.

Why ELT will disrupt ETL

Why ELT will disrupt ETL

ETL, long a mainstay of data integration, is labor-intensive, brittle, complex — and ripe to be supplanted by ELT.

The ultimate guide to data integration

The ultimate guide to data integration

This guide is a one-stop introduction to data integration. Learn how to make data-driven decisions a reality for your organization!

The dangers of DIY database replication

The dangers of DIY database replication

Database replication for database analytics involves many serious difficulties.

Process isolation in data pipelines

Process isolation in data pipelines

Process isolation is an important pillar of software engineering that can keep your data pipelines (and you) out of trouble.

The importance of database analytics

The importance of database analytics

Use database connectors to uncover insights about your operations.

Building efficient data pipelines with incremental updates

Building efficient data pipelines with incremental updates

Sync data incrementally, or watch your pipeline grind to a halt.

Don’t try this at home: Building an idempotent data pipeline

Don’t try this at home: Building an idempotent data pipeline

Learn about the technical challenges involved in building an idempotent data pipeline.

Idempotence and how it failure-proofs your data pipeline

Idempotence and how it failure-proofs your data pipeline

Learn how idempotence protects you from the worst consequences of data integration failures.

Database Schema Design Guide

Database Schema Design Guide

Building a data connector requires you to design a schema to structure your data. This is how Fivetran does it.

Database Schema Best Practices

Database Schema Best Practices

Learn how Fivetran provides normalized schemas to make life easier for analysts.

Your Data Access and Transparency Journey

Your Data Access and Transparency Journey

How can your organization ensure data access and transparency? Measure yourself against this model, courtesy of our partners at Slalom.

What Is the Architecture of Automated Data Integration?

What Is the Architecture of Automated Data Integration?

Automated data integration depends on several key concepts.

What Is Idempotence?

What Is Idempotence?

Idempotence is an important characteristic of many systems, including Fivetran. Here's what it means.

Three Kinds of Metrics GitHub Data Can Answer

Three Kinds of Metrics GitHub Data Can Answer

Data from GitHub can help your engineers quantify how they are doing.

Five dashboards to jump-start your analytics

Five dashboards to jump-start your analytics

Consider building these dashboards that help answer essential business questions.

 Why You Need Automated Schema Migration

Why You Need Automated Schema Migration

Schema changes can completely disrupt a data pipeline. Automated data integration offers a solution.

The Definitive Glossary of Data Integration Terms

The Definitive Glossary of Data Integration Terms

New to analytics? Don’t know what an ERD is? Read this comprehensive list of important data integration terms.

How Fivetran Built Its Klaviyo Connector

How Fivetran Built Its Klaviyo Connector

The process of building a connector is inextricably linked with schema design.

How Well-Designed Schemas Jump-Start Analytics

How Well-Designed Schemas Jump-Start Analytics

Fivetran customers share how data integration gets easier with well-designed schemas.

Seven Steps to Getting Started With Automated Data Integration

Seven Steps to Getting Started With Automated Data Integration

In this excerpt from The Essential Guide to Data Integration, we discuss practical steps to getting started with automated data integration.

Top Technical Considerations for Choosing an ETL Tool

Top Technical Considerations for Choosing an ETL Tool

In this excerpt from The Essential Guide to Data Integration, we discuss the technical considerations for choosing a data integration tool.

Top Business Considerations for Choosing an ETL Tool

Top Business Considerations for Choosing an ETL Tool

In this excerpt from The Essential Guide to Data Integration, we discuss the business considerations for choosing a data integration tool.

Why You Shouldn't Build Your Own Data Pipeline

Why You Shouldn't Build Your Own Data Pipeline

In this excerpt from the Essential Guide to Data Integration, we discuss why you shouldn’t build your own data pipeline.

A Primer to Customer Attribution

A Primer to Customer Attribution

Demystify customer decision-making with the right tracking tools and attribution models.

Use Fivetran, BigQuery and Looker to Get a Handle on NetSuite Data

Use Fivetran, BigQuery and Looker to Get a Handle on NetSuite Data

NetSuite is essential but complicated. Use this guide to set up dashboards for all your NetSuite data.

Use Fivetran, Snowflake and Tableau to Get a Handle on NetSuite Data

Use Fivetran, Snowflake and Tableau to Get a Handle on NetSuite Data

NetSuite is essential but complicated. Use this guide to set up dashboards for all your NetSuite data.

BI Tools Comparison

BI Tools Comparison

BI tools can drive data literacy across your organization. Here’s how to choose the right one.

A Primer to the World of Data

A Primer to the World of Data

How does data become useful knowledge and products?

A Primer to the World of Data

A Primer to the World of Data

How does data become useful knowledge and products?

A Friendly Reminder: One Plus NULL Equals NULL

A Friendly Reminder: One Plus NULL Equals NULL

Whenever you perform arithmetic across SQL columns, take care to handle NULL values appropriately.

Your Data Stack Should Live in the Cloud

Your Data Stack Should Live in the Cloud

For most organizations, on-premises is over. The future? Managed services in the cloud.

Simple and Automated Always Beats Complex and Handwritten

Simple and Automated Always Beats Complex and Handwritten

Fivetran Transformations offers a radically simpler approach to modeling data for reports and dashboards.

Get Started With the “T” in ELT

Get Started With the “T” in ELT

Use Fivetran Transformations to prepare your data for reporting.

Machine Learning in One Lesson

Machine Learning in One Lesson

You don’t need Python chops to get started with simple predictive models, just BigQuery ML and Looker (Fivetran helps, too!).

Instant Data Stack: Fivetran, Snowflake and Tableau

Instant Data Stack: Fivetran, Snowflake and Tableau

Want to deploy a full-fledged data stack in minutes? Connect Fivetran through Snowflake Partner Connect, then connect Snowflake to Tableau. That's it!

Now in BETA: Fivetran REST API

Now in BETA: Fivetran REST API

Use our REST API to automate your workflow by programmatically managing users, groups and connectors.

Now in BETA: Custom Roles

Now in BETA: Custom Roles

Tighten your security by specifying the exact sources your users can manage.

How to Think About Schema Changes

How to Think About Schema Changes

Prevent schema changes from ruining your workflow with help from Fivetran.

Google Ads (AdWords) Connector Now Comes With Prebuilt Reports

Google Ads (AdWords) Connector Now Comes With Prebuilt Reports

We now offer five prebuilt AdWords reports to give you a head start on ad analytics.

Why You Shouldn’t Build Reports From Raw Data

Why You Shouldn’t Build Reports From Raw Data

Or, how I learned to stop worrying and love data warehousing.

Simpson’s Paradox: Beware the Lurking Variable

Simpson’s Paradox: Beware the Lurking Variable

You can easily reach misleading conclusions if you don’t carefully slice your data, consider lurking variables, and think about causality.

Build Connector Status Dashboards With the Fivetran REST API

Build Connector Status Dashboards With the Fivetran REST API

Learn how to combine AWS Lambda and the new Fivetran REST API to build connector status dashboards.

Cloud Data Warehousing: It's Time to Re-Think Your Data Architecture

Cloud Data Warehousing: It's Time to Re-Think Your Data Architecture

A digest of Fivetran CEO George Fraser's talk about the merits of cloud data warehousing at MicroStrategy World 2019.

An Introduction to Looker Blocks and LookML

An Introduction to Looker Blocks and LookML

Use Looker Blocks to conduct plug-and-play analyses with data from our standardized connectors.

Use Lambda Functions to Move Data From Redshift

Use Lambda Functions to Move Data From Redshift

Learn how to incrementally migrate data from Redshift tables using AWS Lambda.

Choose the Right Metrics

Choose the Right Metrics

What gets measured gets managed. Make sure you measure the right things, identify vanity metrics, and perform sanity checks.

Don't try this at home: Fivetran makes NetSuite’s API usable

Don't try this at home: Fivetran makes NetSuite’s API usable

Understand the history of the Fivetran NetSuite connector and you'll see why you shouldn't try building your own.

Funnel Analysis and Conversion Metrics in SQL

Funnel Analysis and Conversion Metrics in SQL

Using SQL to conduct funnel analysis can help you make sense of multiple facets of your business.

How to Write Cloud Functions in Python

How to Write Cloud Functions in Python

We walk you through the process of setting up a cloud function connector using Python and Google Cloud Platform Functions.

Falcon.io: Building a Data-Driven Culture in a Fast-Growing Company

Falcon.io: Building a Data-Driven Culture in a Fast-Growing Company

With its modern data stack, Falcon.io builds a comprehensive picture of the business’s critical operations, democratises access to data, and makes faster, more precise business decisions.

Read Post →

Start for free

Join the thousands of companies using Fivetran to centralize and transform their data.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.