External Table- Improve Performance

I create External Table above s3, I export the command from vsql 'ANALYZE_EXTERNAL_ROW_COUNT'(T), but still, the result comes really slowly :(select only 10 rows)
First fetch (10 rows): 23783.467 ms. All rows formatted: 23784.586 ms
how can I improve the performance?
the files in s3 are parquet and I use hive_partition_cols, by date
Thank you!

Answers

  • Jim_KnicelyJim_Knicely Administrator

    Hi,
    Runing ANALYZE_EXTERNAL_ROW_COUNT only helps if joining the table to another table.

    S3 is slow by nature - it's remote.

    What are your expectations?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file