Error Handling
The connector applies different kinds of validations and error handling mechanisms like configuration validation, upstream connection tests and connection retries with graceful back-off.
The connector maps known exceptions to exception type ConnectException
, which can be handled by Kafka Connect accordingly.
Errors and warnings are logged using SLF4J, as described in section Logging.
Configuration Validation and Recommenders
Single configuration parameter validation extending the Validator
class will throw exceptions of type ConfigException
in case of invalid configuration values. Additionally, the connector overrides the validate
method to validate interdependent configuration parameters and adds error messages to class ConfigValue
in case of any invalid parameter values. The corresponding parameters containing invalid values will be framed in red in the Confluent Control Center together with an appropriate error message.
Graceful Backoff
When there are connection or communication issues with the SAP® system, the connector uses a retry backoff strategy to handle them. Here’s how it works:
-
Retry Attempts: You can set the maximum number of retry attempts using the
sap.webds.max.retries
property. -
Backoff Intervals: After each failed attempt, the connector will pause for a random duration. This pause will be between the minimum and maximum times you specify with
sap.webds.min.retry.backoff.ms
andsap.webds.max.retry.backoff.ms
. -
Exception Handling: Connection and communication issues are categorized into exception groups. You can configure which exception groups should trigger the backoff retry strategy using the
sap.webds.retry.exception.groups
property. For a complete list of these exception groups, refer to the JCo JavaDocs forcom.sap.conn.jco.JCoException
. You can also include BAPI return messages from any message class.
Dead Letter Queue
The sink connector supports the Dead Letter Queue (DLQ) functionality.