Vertica kafka COPY
I'm trying to load messages from kafka to vertica using COPY command from a kafka cluster with SSL/TLS setup there:
COPY TEST_TABLE SOURCE KafkaSource( stream='test-topic|0|0', brokers='kafka-lab.com:32090', stop_on_eof=true, group_id='test-topic', kafka_conf='sasl.username=test_user;sasl.password=test_password;sasl.mechanism=PLAIN;security.protocol=SASL_SSL' ) PARSER KafkaJSONParser(flatten_arrays=True, flatten_maps=True) ABORT ON ERROR REJECTMAX 1;
following Vertica docs:
However no messages are being loaded, I'm trying to follow the official docs:
You can stream data from Kafka into Vertica two ways: manually using a COPY statement and the KafkaSource UD source function, or automatically using the scheduler.
To directly copy data from Kafka via an SSL connection, you set session variables containing an SSL key and certificate. When KafkaSource finds that you have set these variables, it uses the key and certificate to create a secure connection to Kafka
However it's not clear to me, can I pass these variables (CA , Certificate SSL) using "kafka_conf" param in KafkaSource method or should I set them via vsql only