The MigratoryData Sink Connector for Kafka consumes Kafka messages from a configurable list of topics and streams them to MigratoryData according to a configurable mapping between Kafka topics and MigratoryData subjects.
Reliable with no message loss
Each task of the MigratoryData Sink Connector writes into Kafka the offsets of the Kafka messages successfully published into the MigratoryData cluster, i.e. for which a publication acknowledgement has been received from the MigratoryData cluster. Therefore, if a task is restarted after a failure or a load re-balance performed by the Kafka Connect service, the task will continue publication of Kafka messages from the last offsets previously acknowledged by task.