KafkaAvroParser support for io.debezium.time.* logical types?

LauriPessiLauriPessi Vertica Customer ✭
in Product Feedback

We're trying to populate columns with Vertica datatype of timestamp through KafkaAvroParser, but the implicit casting threats source data having Avro logical type io.debezium.time.Timestamp as microseconds instead of milliseconds, leading to values around 1970's instead of actuals.

I know these Debezium types are not listed in the supported logical types in the Vertica docs, but this would be a very welcome addition :smile:

Debezium documentation Table 14 describes logical type io.debezium.time.Timestampbeing stored as milliseconds (while io.debezium.time.MicroTimestamp would be the correct logical type for microseconds).

Example:

  • Raw value: 1687892129000
  • KafkaAvroParser to Vertica timestamp column: 1970-01-20 14:51:32.129 (equivalent of to_timestamp(raw_ts / 1000^2))
  • Correct value: 2023-06-27 21:55:29.000 (equivalent of to_timestamp(raw_ts / 1000))

Vertica Analytic Database v24.2.0-2
Enterprise Mode

Tagged:

Answers

  • SruthiASruthiA Administrator

    we dont support Debezium. Please open a support case so that we can discuss usecase and raise a new feature request

This discussion has been closed.