The secret sauce behind Databricks’ marketing analytics growth

The team transitioned from siloed warehouse data hell to a modern data lakehouse.

“Instead of hiring Data Engineers, Fivetran allows us to focus on business value, hiring analysts, dashboard builders, people who are experts in web analytics and paid media. Our infrastructure is a lot broader and more advanced than it was a year or two ago.” Chris Klaczynski, Marketing Analytics Manager, Databricks

Key Results

  • Databricks’ marketing analytics team transitioned from siloed data warehouse hell to a modern data lakehouse, scaling from a team of one to a team of five within two years.
  • Access to reliable data expanded the visibility of marketing team performance and helped to build a culture of accountability.
  • Fivetran saves Databricks over 40 hours a month in engineering time – the equivalent of a part-time Data Engineer.
  • With the time saved, the Marketing Analytics team is now able to focus on building dashboards, driving business insights and collaborating with other teams on machine learning projects.

Data stack:

Pipeline: Fivetran

Connectors: Marketo, Salesforce, Facebook Ads, Google Analytics

Destination: Databricks Delta Lake

Business Intelligence Tools: Tableau, SQL Analytics

The Situation

Meet Chris Klaczynski: a Marketing Analytics Manager and Fivetran power user at Databricks. As Databricks’ first full-time Marketing Analytics team member, Chris brought a wealth of experience from Amazon’s Kindle and Alexa Customer Behavior teams when he joined in 2019.

Chris’ role was clear: to help marketers at Databricks solve their toughest problems. Databricks – a business that in turn prides itself on helping data teams solve the world’s biggest challenges – was founded in 2013 by the original creators of Apache Spark, Delta Lake and MLflow. Built on a modern Lakehouse architecture in the cloud, Databricks combines the best of data warehouses and data lakes to offer an open and unified platform for data and AI.

The Problem  

Chris’ first responsibility at Databricks was supporting the primary marketing objectives: driving pipeline generation, growing the database, and improving ROI. But as Databricks rapidly expanded, the need for centralized and documented data became more and more apparent. Data silos were appearing around the business, including on Chris’ marketing team, where data was stored in its own data warehouse.

It was critical that Chris’ newly-built dashboards were supplied with trustworthy, timely data for marketing operations to keep running smoothly – but without dedicated engineering resources, and in the face of a rapidly expanding marketing team, scaling with demand became next to impossible.

“97% of what I was doing was keeping the lights on. Getting out of the data hell was a big quality of life improvement for me.”

When Chris joined Databricks, data was cobbled together through Notebooks, Alteryx and legacy pipelines from central teams. It wasn’t a scalable approach, and Chris would deal with slews of emails from Marketing leaders who didn’t trust their data and reports. Databricks faced a number of challenges with their traditional data warehouse:

  • Issues with their Salesforce and Marketo pipelines in particular – they weren’t able to get data into the Delta format natively, and needed to use Parquet as a workaround.
  • Issues appending data natively to existing tables required using temporary tables and more convoluted ETL.  
  • Schema changes were always breaking pipelines, resulting in outages and stale, untrustworthy data.

Because of this, stakeholders weren’t able to discern if a juicy insight was real, or simply a data quality issue. Chris’ team lost trust from stakeholders every time their data didn’t line up with source systems. This hampered planning, budget-allocation and other decision making.

The Solution

Chris began looking for a low-code, turnkey solution that would give his team the reliable pipelines they needed. A three-point strategy informed his search:  

  • Get out of the data engineering ‘jungle’ and into insights and predictive analytics.
  • Hire analysts and Digital SMEs, not Data Engineers and DevOps.
  • Be self-sufficient with our data pipelines and utilize Delta and AutoML.
“We didn’t want to be in the data engineering business – we wanted to focus on delivering insights and running analyses that generate business outcomes.”

Fivetran immediately stood out as a solution to Chris’ data pipeline needs. In trialing the product, the setup was quick and simple. “We followed the quick instructions, set up a cluster, whitelisted the IPs and we were off to the races within a few days.”

Chris’s team now uses Fivetran to bring in data from all of their core marketing source systems: Marketo, Salesforce, Facebook Ads and Google Analytics. “Simply put, it just works.” Once in their lakehouse, Chris’ team joins the data with other sources from Product and Central Teams, transforming it in a meaningful way to run Data Science, machine learning, and generate vital Tableau dashboards for analysis.

The Outcome

Chris now supports a rapidly growing data team of analysts and leaders who, in turn, deliver crucial insights to over 90 marketers. In total, Fivetran saves Databricks over 40 hours a month in engineering time – the equivalent of a part time Data Engineer.

“Instead of hiring the kind of traditional engineering headcount, Fivetran allows us to focus on business value, hiring analysts, dashboard builders, people who are experts in web analytics and paid media. Our infrastructure is a lot broader and more advanced than it was a year or two ago.”

By bringing on Fivetran to handle data ingestion, Chris freed up time to build a full suite of Tableau dashboards that answer the most common questions that his marketing team face, saving his team time and allowing them to focus on adding value with three Data Science and machine learning projects:

  • Accurate campaign-level forecasts to allow managers to understand how they’re pacing and whether their performance is on-pace.
  • A causal impact model which determines the impact of a specific customer event on their consumption.
  • A propensity model that predicts event attendance based on previous behavior, allowing teams to be more targeted in their email marketing.

The downstream impacts of Chris’ decision making are already being felt internally at Databricks. Customer Service and Customer Success have seen how easy the process has been and are asking for more use cases and connectors to be switched on.

“By using Fivetran, we can bring in new sources of data that our new hires will be using  – areas we haven’t explored deeply. They can hit the ground running and start building dashboards immediately. They don't have to build pipelines or get familiar with notebooks or writing code. They can have immediate access to data so they can focus on insights and building relationships with their stakeholders.”

Access to reliable data has been critical for marketing account managers, who are now more accountable for the forecasts they are making. Increased visibility through sophisticated dashboards has made it easier for teams to track and rapidly act on campaign performance.

Ingesting data into a Delta Lake? Check out the Databricks Partner Portal to learn about the power of Databricks and Fivetran.

Visit Fivetran’s Marketing Analytics page to see how you could be centralizing your marketing data in a way that’s fast, reliable, and in real time.

Download this IDC report to learn how Fivetran drives millions in financial impact and enables new business initiatives for enterprises.

Kostenlos starten

Schließen auch Sie sich den Tausenden von Unternehmen an, die ihre Daten mithilfe von Fivetran zentralisieren und transformieren.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Company size
Region
Industry
B2B technology
Sources
No items found.
Destinations
No items found.
Sources
No items found.
Destinations
No items found.
BI tool
No items found.
Try Fivetran for free
Key results
The total economic impact of Fivetran

Learn how automated data movement boosts productivity and accelerates insights for your business.

Download the report
Are you a true data pioneer?

Our quiz will tell you where you are on your data journey and what tools you can unlock to level up.

Take the quiz
Why they chose Fivetran

Further reading
No items found.
No items found.
Related customer stories
Case study

National Australia Bank enhances customer experiences and powers GenAI

Case study

Envision Pharma Group and Fivetran: Pioneering faster paths in pharma

Case study

Raiffeisen Bank International uses real-time data to win more customers

Case study

Saks achieves data efficiency & enables AI with Fivetran

Case study

Cemex connects 1,800+ global facilities in real-time

Case study

Gill Capital unlocks SAP data with Fivetran, boosts sales by 25%

Case study

HubSpot spart bei GenAI mit Fivetran 100.000 US-Dollar ein

Case study

Deliveroo verwandelt die Essenslieferung in eine datengesteuerte Unternehmung

Case study

Paylocity transforms its go-to-market strategy with Fivetran

Case study

Group 1001 increases productivity by 10X

Let's get you moving data