kafka scheduler - frame duration

Chiramel

Hi,

 

we are desigining kafka vertica integration for close to 800 tables.

 

1. We created the kafka scheduler with default frame duration. For the tables executed at the end, have DURATION='0 milliseconds' in COPY statement and those got ERROR message.

 

2. We tried with setting frame duration 7 Hours. All tables executed successful COPY statements, but for the next batch scheduler is waiting for 7 hours.

 

We need a solution to start the next batch immediately once the current batch is completed. Is there any way to set the frame duration to null so the COPY statements depend only on eof=true.

 

Please help.