Please take this survey to help us learn more about how you use third party tools. Your input is greatly appreciated!

VerticaCopyStream appears to be hanging or waiting indefenitly

Hi,

 

VerticaCopyStream appears to be hanging or waiting indefenitly in start/execute method calls when using IO stream.

 

In my case I am using PipedIOStream(PipedInputStream & PipedOutputStream) to stream the data from my program to vertica continously. Interestingly, the program is working fine if I close the Out stream; so it looks like Vertica calls waits till the stream to be closed to consume data. I even tried flushing the stream; but not of any help.

 

Regards,

Abhilash R

Comments

  • I'll take a shot in the dark here...

     

    Experienced "hanging" behavior when COPYing into Vertica from AWS S3 via a third-party tool called S3FS.

    S3FS tries to make AWS S3 look like a conventional file system, and it succeeds but only to a degree.

     

    When doing huge loads S3FS choked from all the multi-threading, making it look superficially like COPY was hanging. To be clear, the problem was S3FS, not Vertica's COPY.

     

    Perhaps your scenario bears some resemblance to this?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file

Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.