export to Parquet : Error 3457

RKverticaRKvertica Registered User

A customer is receiving Error 3457: Function ParquetExportFinalize(int) does not exist, or permission is denied for ParquetExportFinalize(int). They are on 8.1.1-6 . Any thoughts? They are using dbadmin. Does this function exist on 8.1.1-6?

thanks.

Comments

  • Jim_KnicelyJim_Knicely Employee, Registered User, VerticaExpert

    The "Export to Parquet" feature was introduced in Vertica 8.1.1.

    See:
    https://my.vertica.com/docs/8.1.x/HTML/index.htm#Authoring/NewFeatures/8.1/8.1.1/Hadoop.htm

    You can check if the Parquet Export package is installed like this:

    [dbadmin@vertica01 ~]$ vsql -f /opt/vertica/packages/ParquetExport/ddl/isinstalled.sql
     ?column?
    ----------
     t
    (1 row)
    

    If you need to re-install it, you can first uninstall it:

    [dbadmin@vertica01 ~]$ vsql -f /opt/vertica/packages/ParquetExport/ddl/uninstall.sql
    DROP LIBRARY
    

    Then install it:

    [dbadmin@vertica01 ~]$ vsql -f /opt/vertica/packages/ParquetExport/ddl/install.sql
                  version
    ------------------------------------
     Vertica Analytic Database v9.0.1-0
    (1 row)
    
    CREATE LIBRARY
    CREATE TRANSFORM FUNCTION
    CREATE TRANSFORM FUNCTION
    CREATE TRANSFORM FUNCTION
    
  • RKverticaRKvertica Registered User

    The parquetexport package is installed. And they are still getting the error.Is this a priviliges issue? If so, what privilege does the user need to execute this? They are able to load parquet data (copy) into vertica just fine.

  • Jim_KnicelyJim_Knicely Employee, Registered User, VerticaExpert

    Hi,

    I have a feeling it's not really installed, or the wrong version is installed.

    For example, say I uninstall it:

    [dbadmin@s18384357 ~]$ vsql -f /opt/vertica/packages/ParquetExport/ddl/uninstall.sql
    DROP LIBRARY
    

    I'll get the same error:

    [dbadmin@s18384357 ~]$ vsql
    Welcome to vsql, the Vertica Analytic Database interactive terminal.
    
    Type:  \h or \? for help with vsql commands
           \g or terminate with semicolon to execute query
           \q to quit
    
    dbadmin=> export to parquet (directory='/home/dbadmin/test_parq') as select * from test;
    ERROR 3457:  Function ParquetExportFinalize(int) does not exist, or permission is denied for ParquetExportFinalize(int)
    HINT:  No function matches the given name and argument types. You may need to add explicit type casts
    

    Until I reinstall:

    [dbadmin@s18384357 ~]$ rm -fr /home/dbadmin/test_parq
    
    [dbadmin@s18384357 ~]$ vsql
    Welcome to vsql, the Vertica Analytic Database interactive terminal.
    
    Type:  \h or \? for help with vsql commands
           \g or terminate with semicolon to execute query
           \q to quit
    
    dbadmin=> export to parquet (directory='/home/dbadmin/test_parq2') as select * from test;
     Rows Exported
    ---------------
                 1
    (1 row)
    
  • Jim_KnicelyJim_Knicely Employee, Registered User, VerticaExpert

    I wonder if a previous database upgrade failed?

    Check the USER_LIBRARIES system table to make sure everything looks good.

    Example:

    dbadmin=> \x
    Expanded display is on.
    dbadmin=> select * from user_libraries where lib_name = 'ParquetExportLib';
    -[ RECORD 1 ]-----+---------------------------------------------------------------------
    schema_name       | public
    lib_name          | ParquetExportLib
    lib_oid           | 45035996287409142
    author            | HPE Vertica
    owner_id          | 45035996273704962
    lib_file_name     | ParquetExportLib_02e43502fb456e1da3dd4e169c72c9d300a0000000d11bf6.so
    md5_sum           | 0fafa4cc79f4ffa5a9b277c79bc46b7b
    sdk_version       | 9.0.1
    revision          | releases/VER_9_0_RELEASE_BUILD_1_2_20180122
    lib_build_tag     | releases/VER_9_0_RELEASE_BUILD_1_2_20180122
    lib_version       | 9.0.1
    lib_sdk_version   | 9.0.1
    source_url        | http://www.vertica.com/
    description       | Parquet export package
    licenses_required |
    signature         |
    dependencies      |
    is_valid          | t
    sal_storage_id    | 02e43502fb456e1da3dd4e169c72c9d300a0000000d11bf6
    

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file