have data in kafka topic and able to fetch it with scheduler but later want to put data in a table with different column names. how to do this with scheduler?
I have set up a scheduler and it is working fine with the table having same column names as in source table( and the column names in the data in kafka topic). The thing is, the actual aim is to put the kafka data ( from one table) to another table having different column names. How to tell scheduler( which is fetching data from kafka) to map columns. Can i even do it with scheduler? What are the other options?
Answers
please use the instructions from the following link. It has an example regarding sample target table web_hits
https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/KafkaIntegrationGuide/Using_Kafka_with_Vertica.htm
You can achieve what you want using flex tables I guess.
1) load data into flex table using scheduler
2) create your destination table with desired columns and copy the data to your destination table using the steps in the below link
https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/FlexTables/InsertingDataIntoFlexTables.htm?tocpath=Using Flex Tables|_____5