Changelog

All notable changes to this connector will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

⚠️ Deprecation Notice

The ODP Source Connector (ODP-RFC-based extraction) is deprecated. On February 2nd, 2024, SAP updated the SAP Note 3255746 to prohibit the use of ODP API for 3rd party applications. This change may impact your ability to ingest data from SAP via the INIT ODP Source Connector in the future.

Ingestion tools that use ODP via OData (like INITs OData Connectors) are not affected, but are different in regards to capability and performance.

To mitigate this risk, INIT will at any time (when demanded by the customer) switch the ODP Source Connector and license for a OData v2 Source / Sink Connector and license of the same tier without any additional cost. We encourage our customers to also evaluate the OData Connector.

See our ODP-Statement for further details.

[Unreleased]

1.4.0 - 2026-10-19

Added

  • Added cross-compilation support for Scala 3 to prepare compatibility with future Kafka versions.

Changed

  • Configuration validation is faster for connector instances with many connections.
  • Updated SAP JCo to 3.1.13.
  • Retry handling and retry log messages are now consistent across all connectors. Log messages no longer start with the class name. If you filter or alert on log patterns, check them.
  • When all retries are exhausted, the log now includes the cause of the last failure.

Deprecated

  • Deprecated the ODP Source Connector, see the deprecation notice at the top of this file.

Fixed

  • Connector properties that use a config provider (e.g. ${file:…}, ${vault:…}) are no longer re-resolved on every poll/put, which reduces load on the secret store.
  • Fixed conversion of BCD/decimal fields inside nested arrays.
  • Requests that fail because the JCo destination is no longer valid (JCo error group 180) are now always retried immediately.

1.3.6 - 2025-04-01

Added

  • Support for Connect plugin discovery KIP-898
  • Add configuration to enable appending ODQ row identifiers to the Kafka message value section
  • Custom RFC name mapping as connector property added
  • Configuration sap.odp.schema.compat.version for schema compatibility mode added

Changed

  • Migration to JCo library version 3.1.11
  • Improved logging for the real time message counter

Fixed

  • correction of an error in the processing of realtime requests, which could lead to data loss during a recovery if a modification of the limits for closing the request was changed at the same time

1.3.5 - 2024-03-05

Added

  • Connector specific JMX metrics
  • Extraction of hierarchies
  • Real-time time limit parameter to close the real-time ODP connection

Changed

  • Migration to JCo library version 3.1.8
  • Real Time max Package number parameter can be disabled now
  • Default settings for Real-time max package number are set to -1 (disabled)
  • Default setting for Real-time time limit is set to close after 1 week
  • Increased the number of filter limits from 5 to 20 for delta selection and full selection ranges
  • Increased maximal number of connections per connector instance to 20 across all build environments

Fixed

  • Bugfix for scaling in BigDecimal conversion
  • Bugfix in default configuration of cron scheduling

1.3.4 - 2023-06-07

Added

  • Errors tolerance configuration options, including DLQ
  • Major performance boost by added support for multiple JCo data serialization formats (compressed and uncompressed) including fragmented packages
  • numeric.mapping configuration option to convert date, times and numeric chars to string
  • headers.enable configuration option for including metadata information to kafka message headers
  • Support for full extractions
  • Implemented the Exactly-Once-API (KIP-618)
  • Major change: In-task parallelization
  • Enhanced logs using MDC
  • Configuration option to close and deactivate real-time requests

Changed

  • Migration to JCo library version 3.1.7
  • JCo destination and refresh logic
  • Disable automatic generation of JCo elementary type default value in schema
  • Applied retries to RODPS_FETCH_TIMEOUT BAPI return message
  • Customizable retry exception list including BAPI error return messages

Fixed

  • Fixed zombie tasks if connector is paused or shut down during retries
  • Fixed a bug with cron based scheduling in case of one-time only executions
  • Bugfix in parsing of fragmented packages
  • Bugfixed retries for connection issues and ZIP-Exceptions

1.3.3 - 2022-04-14

Added

  • Support for realtime ODQ-push requests
  • Configuration properties for cron-like scheduling

Changed

  • Minor performance optimizations due to enhanced caching during connector startup
  • Migration to JCo library version 3.1.5
  • Package name changed from org.init.ohja.kafka.connect.source.odp to org.init.ohja.kafka.connect.odp.source

Fixed

  • Bugfix in full initialization recovery
  • Bugfix for duplicate records in some cases of request recovery

1.3.2 - 2021-06-16

Changed

  • Changed JCo connection handling to decrease risk of outdated destination objects
  • Migration to JCo library version 3.1.4
  • Refactored Kafka Connect conversion library with extended schema information details

1.3.1 - 2021-01-11

Added

  • Delta range selection configuration properties

Changed

  • Migration to JCo library version 3.1.3
  • Performance improvements, specially for sparse datasets
  • Tests executed on S/4HANA

Fixed

  • Bugfix in configuration check regular expression

1.3.0 - 2020-08-19

Added

  • First public release of the odp source connector
  • Connector version equals the OhJa version being used
1.4.0