endless design deployment

avoroninavoronin ✭
in General Discussion

Hello All, I have a strange situation with design deployment. I have create design and applied to database. Design is not complex -- 8 projections. However it sits in the state of deployment for 2 days already. Vertica 9.3.
01 Apr 2020 15:28:57 Design in progress: Design started
01 Apr 2020 15:28:57 Design in progress: Design in progress: Analyze statistics phase
01 Apr 2020 15:28:57 Analyzing data statistics: A.pmc_ProdMirItems 25
01 Apr 2020 15:29:15 Analyzing data statistics: A.pmc_ProdMirLocation 50
01 Apr 2020 15:29:35 Analyzing data statistics: A_MART.ProdmirChecksStar 75
01 Apr 2020 15:29:44 Analyzing data statistics: A_MART.ProdMirDate 100
01 Apr 2020 15:29:44 Analyzing data statistics: --DONE--
01 Apr 2020 15:29:44 Design in progress: Design in progress: Analyze correlations phase
01 Apr 2020 15:29:45 Analyzing column correlations: A.pmc_ProdMirItems 25
01 Apr 2020 15:30:27 Analyzing column correlations: A.pmc_ProdMirLocation 50
01 Apr 2020 15:31:03 Analyzing column correlations: A_MART.ProdmirChecksStar 75
01 Apr 2020 15:34:38 Analyzing column correlations: A_MART.ProdMirDate 100
01 Apr 2020 15:34:46 Analyzing column correlations: --DONE--
01 Apr 2020 15:34:46 Design in progress: Design in progress: Query optimization phase
01 Apr 2020 15:34:46 Optimizing query performance: Extracting interesting columns 14
01 Apr 2020 15:34:47 Optimizing query performance: Enumerating sort orders 29
01 Apr 2020 15:34:47 Optimizing query performance: Setting up projection candidates 43
01 Apr 2020 15:34:47 Optimizing query performance: Assessing projection candidates 57
01 Apr 2020 15:34:48 Optimizing query performance: Choosing best projections 71
01 Apr 2020 15:34:48 Optimizing query performance: Calculating estimated benefit of best projections 86
01 Apr 2020 15:34:48 Optimizing query performance: Complete 100
01 Apr 2020 15:34:48 Optimizing query performance: Extracting interesting columns 14
01 Apr 2020 15:34:48 Optimizing query performance: Enumerating sort orders 29
01 Apr 2020 15:34:48 Optimizing query performance: Setting up projection candidates 43
01 Apr 2020 15:34:48 Optimizing query performance: Assessing projection candidates 57
01 Apr 2020 15:34:48 Optimizing query performance: Choosing best projections 71
01 Apr 2020 15:34:48 Optimizing query performance: Calculating estimated benefit of best projections 86
01 Apr 2020 15:34:48 Optimizing query performance: Complete 100
01 Apr 2020 15:34:49 Design in progress: Design in progress: Storage optimization phase
01 Apr 2020 15:34:50 Optimizing storage footprint: pmc_ProdMirItems_DBD_1_rep_ProdmirChecks_AUTO 13
01 Apr 2020 15:34:50 Optimizing storage footprint: pmc_ProdMirLocation_DBD_2_rep_ProdmirChecks_AUTO 25
01 Apr 2020 15:34:50 Optimizing storage footprint: ProdmirChecksStar_DBD_3_rep_ProdmirChecks_AUTO 38
01 Apr 2020 15:34:50 Optimizing storage footprint: ProdMirDate_DBD_4_rep_ProdmirChecks_AUTO 50
01 Apr 2020 15:34:50 Optimizing storage footprint: ProdMirDate_DBD_5_rep_ProdmirChecks_AUTO 63
01 Apr 2020 15:34:50 Optimizing storage footprint: ProdmirChecksStar_DBD_6_rep_ProdmirChecks_AUTO 75
01 Apr 2020 15:34:50 Optimizing storage footprint: ProdmirChecksStar_DBD_7_rep_ProdmirChecks_AUTO 88
01 Apr 2020 15:34:51 Optimizing storage footprint: ProdmirChecksStar_DBD_8_rep_ProdmirChecks_AUTO 100
01 Apr 2020 15:34:57 Design in progress: Design completed successfully
01 Apr 2020 15:34:57 Generating deployment script: Setting up deployment metadata
01 Apr 2020 15:34:57 Generating deployment script: Identifying projections to be deployed
01 Apr 2020 15:34:57 CREATE_DEPLOYMENT
01 Apr 2020 15:34:57 Generating deployment script: Identified all projections to be deployed
01 Apr 2020 15:34:57 POPULATE_DEPLOYMENT
01 Apr 2020 15:34:59 Generating deployment script: Identifying projections to be dropped
01 Apr 2020 15:34:59 Generating deployment script: Identified all projections to be dropped
01 Apr 2020 15:34:59 POPULATE_DEPLOYMENT
01 Apr 2020 15:34:59 DEPLOYMENT_SCRIPT
01 Apr 2020 15:34:59 Generating deployment script: Computing deployment script
01 Apr 2020 15:34:59 RUN_DEPLOYMENT
01 Apr 2020 15:34:59 Generating deployment script: Deployment script generated successfully
01 Apr 2020 15:34:59 DEPLOYMENT_SCRIPT
01 Apr 2020 15:34:59 DEPLOYMENT
01 Apr 2020 15:36:39 RUN_DEPLOYMENT
01 Apr 2020 15:39:59 RUN_DEPLOYMENT
01 Apr 2020 16:06:06 RUN_DEPLOYMENT
01 Apr 2020 16:06:07 RUN_DEPLOYMENT
01 Apr 2020 16:09:58 RUN_DEPLOYMENT
01 Apr 2020 16:13:04 RUN_DEPLOYMENT
01 Apr 2020 16:13:04 RUN_DEPLOYMENT
01 Apr 2020 16:13:08 RUN_DEPLOYMENT
01 Apr 2020 16:13:09 RUN_DEPLOYMENT
01 Apr 2020 16:14:58 RUN_DEPLOYMENT
01 Apr 2020 16:15:51 RUN_DEPLOYMENT
01 Apr 2020 16:15:52 RUN_DEPLOYMENT
01 Apr 2020 16:19:58 RUN_DEPLOYMENT
01 Apr 2020 16:24:58 RUN_DEPLOYMENT
01 Apr 2020 16:29:58 RUN_DEPLOYMENT
..................continues endlessly.................................................
03 Apr 2020 07:59:58 RUN_DEPLOYMENT
03 Apr 2020 08:04:58 RUN_DEPLOYMENT
03 Apr 2020 08:09:58 RUN_DEPLOYMENT
03 Apr 2020 08:14:58 RUN_DEPLOYMENT
03 Apr 2020 08:19:58 RUN_DEPLOYMENT
03 Apr 2020 08:24:58 RUN_DEPLOYMENT
03 Apr 2020 08:29:58 RUN_DEPLOYMENT
03 Apr 2020 08:34:58 RUN_DEPLOYMENT
03 Apr 2020 08:39:58 RUN_DEPLOYMENT

Tagged:

Answers

  • avoroninavoronin ✭

    Code that design was created with

    SELECT DESIGNER_CREATE_DESIGN('ProdmirChecks_AUTO');
    SELECT DESIGNER_RESET_DESIGN ('ProdmirChecks_AUTO' );
    SELECT DESIGNER_SET_DESIGN_TYPE('ProdmirChecks_AUTO','COMPREHENSIVE');
    SELECT DESIGNER_SET_DESIGN_KSAFETY ( 'ProdmirChecks_AUTO', 0);
    SELECT DESIGNER_SET_OPTIMIZATION_OBJECTIVE('ProdmirChecks_AUTO', 'QUERY');
    SELECT DESIGNER_SET_ANALYZE_CORRELATIONS_MODE ('ProdmirChecks_AUTO', 3);

    SELECT DESIGNER_ADD_DESIGN_TABLES('ProdmirChecks_AUTO','A_MART.ProdmirChecksStar');
    SELECT DESIGNER_ADD_DESIGN_TABLES('ProdmirChecks_AUTO','A.pmc_ProdMirItems');
    SELECT DESIGNER_ADD_DESIGN_TABLES('ProdmirChecks_AUTO','A.pmc_ProdMirLocation');
    SELECT DESIGNER_ADD_DESIGN_TABLES('ProdmirChecks_AUTO','A_MART.ProdMirDate');

    SELECT DESIGNER_ADD_DESIGN_QUERIES_FROM_RESULTS ('ProdmirChecks_AUTO', '
    SELECT request as query_text
    FROM query_requests
    WHERE request_duration_ms > 1000 AND request_type = ''QUERY'' AND
    request ILike ''%SELECT%ProdmirChecks%'' AND
    request NOT Like ''%INSERT%'' AND
    request NOT Like ''%query_requests%'' AND
    request NOT Like ''%AcdDataToCount%''

    EXCEPT

    SELECT query_text FROM DESIGN_QUERIES
    WHERE design_name = ''ProdmirChecks_AUTO''
    ');

    SELECT DESIGNER_RUN_POPULATE_DESIGN_AND_DEPLOY (
    'ProdmirChecks_AUTO',
    '/tmp/vertica-designs/ProdmirChecks_AUTO_projections.sql',
    '/tmp/vertica-designs/ProdmirChecks_AUTO_deploy.sql',
    'true', -- build
    'false', -- deploy
    'false',
    'false'
    );
    SELECT DESIGNER_WAIT_FOR_DESIGN ( 'ProdmirChecks_AUTO' );

    SELECT REFRESH('A_MART.ProdmirChecksStar');
    SELECT REFRESH('A.pmc_ProdMirItems');
    SELECT REFRESH('A.pmc_ProdMirLocation');
    SELECT REFRESH('A_MART.ProdMirDate');

  • avoroninavoronin ✭

    Hello,
    The design is still being deployed. Started at 1st april and still shows some activity as of 14 april. Is it April Fools's design or what?

    01 Apr 2020 15:34:59 DEPLOYMENT_SCRIPT
    01 Apr 2020 15:34:59 DEPLOYMENT
    01 Apr 2020 15:36:39 RUN_DEPLOYMENT
    01 Apr 2020 15:39:59 RUN_DEPLOYMENT
    01 Apr 2020 16:06:06 RUN_DEPLOYMENT
    01 Apr 2020 16:06:07 RUN_DEPLOYMENT
    01 Apr 2020 16:09:58 RUN_DEPLOYMENT
    ....
    06 Apr 2020 08:12:18 RUN_DEPLOYMENT
    06 Apr 2020 08:12:20 RUN_DEPLOYMENT
    06 Apr 2020 08:12:45 RUN_DEPLOYMENT
    06 Apr 2020 08:12:47 RUN_DEPLOYMENT
    06 Apr 2020 08:12:47 RUN_DEPLOYMENT
    06 Apr 2020 08:12:49 RUN_DEPLOYMENT
    06 Apr 2020 08:12:49 RUN_DEPLOYMENT
    06 Apr 2020 08:14:59 RUN_DEPLOYMENT
    06 Apr 2020 08:19:59 RUN_DEPLOYMENT
    14 Apr 2020 11:42:14 RUN_DEPLOYMENT
    14 Apr 2020 11:42:16 RUN_DEPLOYMENT

  • mkestermkester Vertica Employee Employee

    Hi! Thanks for posting this. I'd like to try to recreate and trouble shoot this problem on our side. Can you provide me some more information? You can send a dump of all the tables in the design schema, based on what you have here it should be the v_dbd_ProdmirChecks_AUTO_ProdmirChecks_AUTO. I will also need your vertica.log and the create table statements for the targeted tables in A and A_MART. Finally, I see that you called DESIGNER_RUN_POPULATE_DESIGN_AND_DEPLOY with a false flag for deploy, can you confirm the exact commands to recreate the problem? If you'd rather not post here, I can try to find an alternative way for you to send me the files, let me know.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...