Fivetran simplifies SAP data integration to cloud

Fivetran’s connection to SAP NetWeaver enables log-based change data capture despite common license restrictions for databases managed by SAP applications.
July 22, 2024

SAP ERP data is central to many companies’ business processes that span across finance, sales, distribution, production planning and more. In fact, 99 out of 100 largest companies run SAP, and being able to access, combine and analyze data within SAP systems and other data sources can help businesses drive more informed decision-making. But oftentimes, high-quality enterprise data is locked away due to SAP license restrictions and complex data integration solutions that risk business operations. 

Fivetran HVR Netweaver Connection

To address these concerns and limitations, Fivetran has developed a connection to SAP NetWeaver via the application layer to perform high-volume, log-based change data capture (CDC). With this connection, table selection and initial load is handled through the SAP Netweaver application layer. Direct access to the database is not required, and customers can still take advantage of Fivetran’s log-based CDC with the HANA Runtime license edition.

The integration optimizes the initial load during the data replication process and simplifies data integration to ensure comprehensive visibility and access without any business disruptions. The ability to extract changes from transaction logs of various databases has the least impact on SAP applications because of the asynchronous nature of CDC. Changes are captured independently of the source application performing the changes.

The initial data load is important in setting up real-time replication. Many organizations have tables with multiple terabytes of data to transfer, and the goal should be to reduce risk to business operations and minimize initial load time. 

‍Prerequisites

The following is required to implement SAP NetWeaver data replication: 

  • SAP ABAP version 7.5 and above
  • Oracle or SAP HANA database

Two main components of Fivetran’s connection to SAP NetWeaver 

The first is enabling Fivetran to communicate with the SAP application using the RFC (Remote Function Call). This connection can be made from the capture agent or the Fivetran Hub. SAP’s RFC libraries must be installed wherever Fivetran is connected. The connection to the SAP source can then be configured like any other connection in the Fivetran Hub, as displayed in Figure 1. Note that the user will be an SAP (background) user.

Figure 1. Architecture

The second component resides on the SAP source system and is offered through SAP transports (*.kbr). Customers can upload, check and activate these transports through the standard SAP transport procedures. The transport will generate all the ABAP functions in the Fivetran namespace (/Fivetran/) in SAP. Since it doesn’t connect directly to the database, AppConnect doesn’t require a specific database user or schema.

After the location has been set up, operations are identical for users to other Fivetran (SAP) sources and targets. In addition, features like refresh, compare and unpack (the ability to decode cluster, pool, and long text data) work with connections through NetWeaver as they do with direct connections.

The most important part — capturing changes from the database log files — which leverages proprietary log-parsing capabilities for Oracle and HANA remains unchanged. Fivetran processes changes with the lowest possible latency and impact on the SAP source system.

In short, Fivetran’s connection to SAP NetWeaver allows enterprises to perform log-based CDC despite common license restrictions for databases managed by SAP applications, such as SAP HANA Runtime.

Commencer gratuitement

Rejoignez les milliers d’entreprises qui utilisent Fivetran pour centraliser et transformer leur data.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Product
Product

Fivetran simplifies SAP data integration to cloud

Fivetran simplifies SAP data integration to cloud

July 22, 2024
July 22, 2024
Fivetran simplifies SAP data integration to cloud
Fivetran’s connection to SAP NetWeaver enables log-based change data capture despite common license restrictions for databases managed by SAP applications.

SAP ERP data is central to many companies’ business processes that span across finance, sales, distribution, production planning and more. In fact, 99 out of 100 largest companies run SAP, and being able to access, combine and analyze data within SAP systems and other data sources can help businesses drive more informed decision-making. But oftentimes, high-quality enterprise data is locked away due to SAP license restrictions and complex data integration solutions that risk business operations. 

Fivetran HVR Netweaver Connection

To address these concerns and limitations, Fivetran has developed a connection to SAP NetWeaver via the application layer to perform high-volume, log-based change data capture (CDC). With this connection, table selection and initial load is handled through the SAP Netweaver application layer. Direct access to the database is not required, and customers can still take advantage of Fivetran’s log-based CDC with the HANA Runtime license edition.

The integration optimizes the initial load during the data replication process and simplifies data integration to ensure comprehensive visibility and access without any business disruptions. The ability to extract changes from transaction logs of various databases has the least impact on SAP applications because of the asynchronous nature of CDC. Changes are captured independently of the source application performing the changes.

The initial data load is important in setting up real-time replication. Many organizations have tables with multiple terabytes of data to transfer, and the goal should be to reduce risk to business operations and minimize initial load time. 

‍Prerequisites

The following is required to implement SAP NetWeaver data replication: 

  • SAP ABAP version 7.5 and above
  • Oracle or SAP HANA database

Two main components of Fivetran’s connection to SAP NetWeaver 

The first is enabling Fivetran to communicate with the SAP application using the RFC (Remote Function Call). This connection can be made from the capture agent or the Fivetran Hub. SAP’s RFC libraries must be installed wherever Fivetran is connected. The connection to the SAP source can then be configured like any other connection in the Fivetran Hub, as displayed in Figure 1. Note that the user will be an SAP (background) user.

Figure 1. Architecture

The second component resides on the SAP source system and is offered through SAP transports (*.kbr). Customers can upload, check and activate these transports through the standard SAP transport procedures. The transport will generate all the ABAP functions in the Fivetran namespace (/Fivetran/) in SAP. Since it doesn’t connect directly to the database, AppConnect doesn’t require a specific database user or schema.

After the location has been set up, operations are identical for users to other Fivetran (SAP) sources and targets. In addition, features like refresh, compare and unpack (the ability to decode cluster, pool, and long text data) work with connections through NetWeaver as they do with direct connections.

The most important part — capturing changes from the database log files — which leverages proprietary log-parsing capabilities for Oracle and HANA remains unchanged. Fivetran processes changes with the lowest possible latency and impact on the SAP source system.

In short, Fivetran’s connection to SAP NetWeaver allows enterprises to perform log-based CDC despite common license restrictions for databases managed by SAP applications, such as SAP HANA Runtime.

Topics
No items found.
Share

Articles associés

How to replicate and analyze SAP ERP data with Fivetran
Enterprise

How to replicate and analyze SAP ERP data with Fivetran

Lire l’article
Gain real-time insights on SAP data with Fivetran & Snowflake
Data insights

Gain real-time insights on SAP data with Fivetran & Snowflake

Lire l’article
No items found.
No items found.

Commencer gratuitement

Rejoignez les milliers d’entreprises qui utilisent Fivetran pour centraliser et transformer leur data.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.