Full table export performance degradation over time
I have a background job that exports a full table on vertica given a set of user supplied filters. I am noticing that as the export continues further and further down the table, the query times get longer and longer.
I am paginating the result set with LIMIT and OFFSET, doing some processing, then writing to a file. Does anyone have any suggestions as to why this is happening and what I can do to fix it?