We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


VerticaCopyStream appears to be hanging or waiting indefenitly — Vertica Forum

VerticaCopyStream appears to be hanging or waiting indefenitly

Hi,

 

VerticaCopyStream appears to be hanging or waiting indefenitly in start/execute method calls when using IO stream.

 

In my case I am using PipedIOStream(PipedInputStream & PipedOutputStream) to stream the data from my program to vertica continously. Interestingly, the program is working fine if I close the Out stream; so it looks like Vertica calls waits till the stream to be closed to consume data. I even tried flushing the stream; but not of any help.

 

Regards,

Abhilash R

Comments

  • I'll take a shot in the dark here...

     

    Experienced "hanging" behavior when COPYing into Vertica from AWS S3 via a third-party tool called S3FS.

    S3FS tries to make AWS S3 look like a conventional file system, and it succeeds but only to a degree.

     

    When doing huge loads S3FS choked from all the multi-threading, making it look superficially like COPY was hanging. To be clear, the problem was S3FS, not Vertica's COPY.

     

    Perhaps your scenario bears some resemblance to this?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file