Options on Loading data from ETL nodes vs. DB nodes

We are looking into to see how can move ETL process off of the DB Nodes.  It is given that loading part will use DB nodes in one way or the other, but more importantly we want to utilize "ON ANY NODE" option in COPY FROM.  We have 30 node cluster and want to ensure we spread the work for loading to all nodes but not as dbadmin os or db user.

We had seen that only dbadmin user can utilize the option "ON ANY NODE", can we create a DB user which can utilize "ON ANY NODE" option?  What those privileges would be?  Has anyone else come across this and share their lessons learned?  Any best practice approach anyone can recommend?

At the end the game plan is to move any Extract & Transform load off of DB nodes, as driven by our business process.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file