Need to improve performance in COPY
We have a daily job which run to read data from .tar file of size 35GB. This file has 500-600 .gz files. Script uses COPY statement to read data from file & loads into staging table.
COPY <> FROM STDIN GZIP DELIMITER ',' DIRECT REJECTMAX 500 NULL as '' "
It takes almost 6-8 hours to process one file. Could you please suggest if there is any option to reduce the processing time.