Column encoding change on vertica 10 not work

sergey_hsergey_h Vertica Customer ✭
in General Discussion

Hello,
I try change column encoding, but it doesn't work as expected.
My test:
I have table :

openx=> select export_objects('','test.test1');
                                                                                                                                      export_objects
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------


CREATE TABLE test.test1
(
    language_id int
);


CREATE PROJECTION test.test1 /*+createtype(P)*/
(
 language_id
)
AS
 SELECT test1.language_id
 FROM test.test1
 ORDER BY test1.language_id
SEGMENTED BY hash(test1.language_id) ALL NODES KSAFE 1;

Check size

SELECT
projection_name,
    column_name,
    encodings,
    compressions,
    ROUND(SUM(used_bytes)/(1024^2),1)::FLOAT AS size_Mb
FROM
    column_storage
WHERE
    anchor_table_name = 'test1'
    and projection_schema = 'test'
--    and projection_name = 'mnt_compiled_stats_full_new_b0'
GROUP BY
    1,2,3,4
ORDER BY
    5 DESC;

 projection_name | column_name |  encodings   | compressions | size_Mb
-----------------+-------------+--------------+--------------+---------
 test1_b0        | language_id | Uncompressed | int delta    |    7005
 test1_b1        | language_id | Uncompressed | int delta    |    7005
 test1_b0        | epoch       | Int_Delta    | none         |      41
 test1_b1        | epoch       | Int_Delta    | none         |      41

Tnen, i change encoding and execute mergeout

openx=> alter table test.test1 alter column language_id encoding BLOCK_DICT projections (test.test1_b0,test.test1_b1);
WARNING 9385:  New encoding will not be applied to existing projection data of this table; this change will be applied only on mergeout
ALTER TABLE
openx=> select do_tm_task('mergeout','test.test1');
                                                   do_tm_task
-----------------------------------------------------------------------------------------------------------------
 Task: mergeout
(Table: test.test1) (Projection: test.test1_b0)
(Table: test.test1) (Projection: test.test1_b1)

(1 row)

Check size again - nothing changed.

projection_name  column_name  encodings     compressions  size_Mb  
---------------  -----------  ------------  ------------  -------  
test1_b0         language_id  Uncompressed  int delta     7005.0   
test1_b1         language_id  Uncompressed  int delta     7005.0   
test1_b0         epoch        Int_Delta     none          41.0     
test1_b1         epoch        Int_Delta     none          41.0

Vertica vertsion

openx=> SELECT version();
               version
-------------------------------------
 Vertica Analytic Database v10.0.0-3

Answers

  • HibikiHibiki Vertica Employee Employee

    I tried your scenario in 10.0.1, and the result was as expected.
    [Before]

     projection_name | column_name |  encodings   | compressions | size_Mb
-----------------+-------------+--------------+--------------+---------
 test1_super     | language_id | Uncompressed | int delta    |   954.7
 test1_super     | epoch       | Int_Delta    | none         |   425.1

    [After]

     projection_name | column_name | encodings  | compressions | size_Mb
-----------------+-------------+------------+--------------+---------
 test1_super     | language_id | Block_Dict | none         |   916.1
 test1_super     | epoch       | Int_Delta  | none         |   839.9

    Please check the encoding type has been changed on your projection on exported DDL exported by the following statement.

    SELECT export_objects('','test.test1');

    When you ran the mergeout, did you see any error message in vertica.log file?

  • sergey_hsergey_h Vertica Customer ✭

    @Hibiki said:
    Please check the encoding type has been changed on your projection on exported DDL exported by the following statement.

    SELECT export_objects('','test.test1');

    When you ran the mergeout, did you see any error message in vertica.log file?

    Hello @Hibiki,

    openx=> select export_objects('','test.test1');
                                                                                                                                                export_objects
CREATE TABLE test.test1
(
    language_id int
);

CREATE PROJECTION test.test1 /*+createtype(P)*/
(
 language_id ENCODING BLOCK_DICT
)
AS
 SELECT test1.language_id
 FROM test.test1
 ORDER BY test1.language_id
SEGMENTED BY hash(test1.language_id) ALL NODES KSAFE 1;

    DDL projection is changed, but old data not re-encoding.
    No, i didn't see, mergeout worked without errrors in vertica.log

  • HibikiHibiki Vertica Employee Employee

    Can you check the projection definitions and the histories of mergeout by using the following queries?

    SELECT projection_name, projection_basename, is_up_to_date
FROM projections
WHERE projection_schema = 'test' AND anchor_table_name = 'test1'
ORDER BY projection_name;

SELECT projection_name, projection_column_name, data_type, encoding_type
FROM projection_columns
WHERE table_schema = 'test' AND table_name = 'test1'
ORDER BY projection_name, projection_column_name;

SELECT node_name, projection_name, column_name, encodings, compressions
FROM column_storage
WHERE anchor_table_schema = 'test' AND anchor_table_name = 'test1'
ORDER BY node_name, projection_name, column_name;

SELECT operation_start_timestamp, node_name, projection_name, ros_count, total_ros_used_bytes, operation_status, is_executing
FROM tuple_mover_operations
WHERE operation_name = 'Mergeout' AND table_schema = 'test' AND table_name = 'test1'
ORDER BY operation_start_timestamp DESC;

SELECT mr."time", mr.node_name, pr.projection_name, mr.request_type, mr.event_type
FROM dc_mergeout_requests mr
JOIN projections pr ON mr.projection_oid = pr.projection_id
WHERE pr.anchor_table_name = 'test1' AND pr.projection_schema = 'test'
ORDER BY mr."time" DESC;
  • sergey_hsergey_h Vertica Customer ✭

    @Hibiki said:
    Can you check the projection definitions and the histories of mergeout by using the following queries?

    openx=> SELECT projection_name, projection_basename, is_up_to_date
openx-> FROM projections
openx-> WHERE projection_schema = 'test' AND anchor_table_name = 'test1'
openx-> ORDER BY projection_name;
 projection_name | projection_basename | is_up_to_date
-----------------+---------------------+---------------
 test1_b0        | test1               | t
 test1_b1        | test1               | t
(2 rows)

openx=> SELECT projection_name, projection_column_name, data_type, encoding_type
openx-> FROM projection_columns
openx-> WHERE table_schema = 'test' AND table_name = 'test1'
openx-> ORDER BY projection_name, projection_column_name;
 projection_name | projection_column_name | data_type | encoding_type
-----------------+------------------------+-----------+---------------
 test1_b0        | language_id            | int       | BLOCK_DICT
 test1_b1        | language_id            | int       | BLOCK_DICT
(2 rows)

openx=>
openx=> SELECT node_name, projection_name, column_name, encodings, compressions
openx-> FROM column_storage
openx-> WHERE anchor_table_schema = 'test' AND anchor_table_name = 'test1'
openx-> ORDER BY node_name, projection_name, column_name;
    node_name     | projection_name | column_name |  encodings   | compressions
------------------+-----------------+-------------+--------------+--------------
 v_openx_node0001 | test1_b1        | epoch       | Int_Delta    | none
 v_openx_node0001 | test1_b1        | language_id | Uncompressed | int delta
 v_openx_node0004 | test1_b0        | epoch       | Int_Delta    | none
 v_openx_node0004 | test1_b0        | language_id | Uncompressed | int delta
(4 rows)

openx=> SELECT operation_start_timestamp, node_name, projection_name, ros_count, total_ros_used_bytes, operation_status, is_executing
openx-> FROM tuple_mover_operations
openx-> WHERE operation_name = 'Mergeout' AND table_schema = 'test' AND table_name = 'test1'
openx-> ORDER BY operation_start_timestamp DESC;
   operation_start_timestamp   |    node_name     | projection_name | ros_count | total_ros_used_bytes | operation_status | is_executing
-------------------------------+------------------+-----------------+-----------+----------------------+------------------+--------------

(0 rows)

openx=> SELECT mr."time", mr.node_name, pr.projection_name, mr.request_type, mr.event_type
openx-> FROM dc_mergeout_requests mr
openx-> JOIN projections pr ON mr.projection_oid = pr.projection_id
openx-> WHERE pr.anchor_table_name = 'test1' AND pr.projection_schema = 'test'
openx-> ORDER BY mr."time" DESC;
             time              |    node_name     | projection_name |   request_type   |    event_type
-------------------------------+------------------+-----------------+------------------+-------------------
 2020-09-25 05:20:14.45868-05  | v_openx_node0004 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.45865-05  | v_openx_node0004 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.447868-05 | v_openx_node0001 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.44785-05  | v_openx_node0001 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440361-05 | v_openx_node0006 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440342-05 | v_openx_node0006 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440057-05 | v_openx_node0005 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440032-05 | v_openx_node0005 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440029-05 | v_openx_node0007 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439886-05 | v_openx_node0007 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439718-05 | v_openx_node0003 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439687-05 | v_openx_node0003 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.43919-05  | v_openx_node0008 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439161-05 | v_openx_node0008 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.437716-05 | v_openx_node0002 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.437698-05 | v_openx_node0002 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.362344-05 | v_openx_node0004 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.362302-05 | v_openx_node0001 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.362216-05 | v_openx_node0001 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.36221-05  | v_openx_node0004 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361829-05 | v_openx_node0006 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361802-05 | v_openx_node0003 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361782-05 | v_openx_node0007 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.36178-05  | v_openx_node0005 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361763-05 | v_openx_node0008 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361717-05 | v_openx_node0006 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.3617-05   | v_openx_node0003 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361683-05 | v_openx_node0008 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361682-05 | v_openx_node0007 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361673-05 | v_openx_node0005 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.360517-05 | v_openx_node0002 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.360433-05 | v_openx_node0002 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
(32 rows)
  • sergey_hsergey_h Vertica Customer ✭

    When i execute next insert in this table and run mergeout - TM re-encoding

    openx=> insert /* +direct*/ into test.test1
openx-> select language_id from  test.test_full limit 10000000;
  OUTPUT
----------
 10000000
(1 row)

openx=> commit;
COMMIT
openx=> select do_tm_task('mergeout','test.test1');
                                                   do_tm_task
-----------------------------------------------------------------------------------------------------------------
 Task: mergeout
(Table: test.test1) (Projection: test.test1_b0)
(Table: test.test1) (Projection: test.test1_b1)

(1 row)

openx=> SELECT node_name, projection_name, column_name, encodings, compressions
openx-> FROM column_storage
openx-> WHERE anchor_table_schema = 'test' AND anchor_table_name = 'test1'
openx-> ORDER BY node_name, projection_name, column_name;
    node_name     | projection_name | column_name | encodings  | compressions
------------------+-----------------+-------------+------------+--------------
 v_openx_node0001 | test1_b1        | epoch       | Int_Delta  | none
 v_openx_node0001 | test1_b1        | language_id | Block_Dict | none
 v_openx_node0004 | test1_b0        | epoch       | Int_Delta  | none
 v_openx_node0004 | test1_b0        | language_id | Block_Dict | none
(4 rows)

openx=> SELECT operation_start_timestamp, node_name, projection_name, ros_count, total_ros_used_bytes, operation_status, is_executing
openx-> FROM tuple_mover_operations
openx-> WHERE operation_name = 'Mergeout' AND table_schema = 'test' AND table_name = 'test1'
openx-> ORDER BY operation_start_timestamp DESC;
   operation_start_timestamp   |    node_name     | projection_name | ros_count | total_ros_used_bytes | operation_status | is_executing
-------------------------------+------------------+-----------------+-----------+----------------------+------------------+--------------
 2020-09-25 05:26:03.602269-05 | v_openx_node0001 | test1_b1        |         2 |             10183168 | Complete         | f
 2020-09-25 05:26:03.454343-05 | v_openx_node0004 | test1_b0        |         2 |             10183168 | Complete         | f
 2020-09-25 05:26:02.336911-05 | v_openx_node0004 | test1_b0        |         2 |             10183168 | Start            | f
 2020-09-25 05:26:02.336263-05 | v_openx_node0001 | test1_b1        |         2 |             10183168 | Start            | f
(4 rows)

openx=> SELECT mr."time", mr.node_name, pr.projection_name, mr.request_type, mr.event_type
openx-> FROM dc_mergeout_requests mr
openx-> JOIN projections pr ON mr.projection_oid = pr.projection_id
openx-> WHERE pr.anchor_table_name = 'test1' AND pr.projection_schema = 'test'
openx-> ORDER BY mr."time" DESC;
             time              |    node_name     | projection_name |   request_type   |    event_type
-------------------------------+------------------+-----------------+------------------+-------------------
 2020-09-25 05:26:03.602291-05 | v_openx_node0001 | test1_b1        | MERGEOUT         | REQUEST_COMPLETED
 2020-09-25 05:26:03.454363-05 | v_openx_node0004 | test1_b0        | MERGEOUT         | REQUEST_COMPLETED
 2020-09-25 05:20:14.45868-05  | v_openx_node0004 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.45865-05  | v_openx_node0004 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.447868-05 | v_openx_node0001 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.44785-05  | v_openx_node0001 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440361-05 | v_openx_node0006 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440342-05 | v_openx_node0006 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440057-05 | v_openx_node0005 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440032-05 | v_openx_node0005 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.440029-05 | v_openx_node0007 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439886-05 | v_openx_node0007 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439718-05 | v_openx_node0003 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439687-05 | v_openx_node0003 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.43919-05  | v_openx_node0008 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.439161-05 | v_openx_node0008 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.437716-05 | v_openx_node0002 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.437698-05 | v_openx_node0002 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_COMPLETED
 2020-09-25 05:20:14.362344-05 | v_openx_node0004 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.362302-05 | v_openx_node0001 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.362216-05 | v_openx_node0001 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.36221-05  | v_openx_node0004 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361829-05 | v_openx_node0006 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361802-05 | v_openx_node0003 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361782-05 | v_openx_node0007 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.36178-05  | v_openx_node0005 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361763-05 | v_openx_node0008 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361717-05 | v_openx_node0006 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.3617-05   | v_openx_node0003 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361683-05 | v_openx_node0008 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361682-05 | v_openx_node0007 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.361673-05 | v_openx_node0005 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.360517-05 | v_openx_node0002 | test1_b1        | RECOMPUTE_LIMITS | REQUEST_QUEUED
 2020-09-25 05:20:14.360433-05 | v_openx_node0002 | test1_b0        | RECOMPUTE_LIMITS | REQUEST_QUEUED
(34 rows)

    And column size changed

    openx=> SELECT
openx-> projection_name,
openx->     column_name,
openx->     encodings,
openx->     compressions,
openx->     ROUND(SUM(used_bytes)/(1024^2),1)::FLOAT AS size_Mb
openx-> FROM
openx->     column_storage
openx-> WHERE
openx->     anchor_table_name = 'test1'
openx->     and projection_schema = 'test'
openx-> GROUP BY
openx->     1,2,3,4
openx-> ORDER BY
openx->     5 DESC;
 projection_name | column_name | encodings  | compressions | size_Mb
-----------------+-------------+------------+--------------+---------
 test1_b0        | epoch       | Int_Delta  | none         |     0.5
 test1_b1        | epoch       | Int_Delta  | none         |     0.5
 test1_b0        | language_id | Block_Dict | none         |     0.1
 test1_b1        | language_id | Block_Dict | none         |     0.1
(4 rows)
  • HibikiHibiki Vertica Employee Employee

    Thank you for sharing the detailed information. I guess Mergeout you ran after changing the column encoding didn't need to merge the ROS containers. Can you check the number of ROS files when you run Mergeout?

    [Original status for each column on each node]
 projection_name | column_name |  encodings   | compressions |    node_name     | ros_count | size_Mb
-----------------+-------------+--------------+--------------+------------------+-----------+---------
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0001 |        38 |     1.5
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0002 |        38 |     1.5
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0003 |        38 |     1.5
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0001 |        38 |     3.2
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0002 |        38 |     3.1
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0003 |        38 |     3.2
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0001 |        38 |     1.5
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0002 |        38 |     1.5
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0003 |        38 |     1.5
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0001 |        38 |     3.2
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0002 |        38 |     3.2
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0003 |        38 |     3.1

=> SELECT do_tm_task('mergeout', 'test.test1');

[The status after Mergeout without changing the column encoding]
 projection_name | column_name |  encodings   | compressions |    node_name     | ros_count | size_Mb
-----------------+-------------+--------------+--------------+------------------+-----------+---------
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0001 |         1 |     2.8
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0002 |         1 |     2.8
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0003 |         1 |     2.8
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0001 |         1 |     3.2
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0002 |         1 |     3.1
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0003 |         1 |     3.2
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0001 |         1 |     2.8
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0002 |         1 |     2.8
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0003 |         1 |     2.8
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0001 |         1 |     3.2
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0002 |         1 |     3.2
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0003 |         1 |     3.1

=> ALTER TABLE test.test1 ALTER COLUMN language_id ENCODING BLOCK_DICT PROJECTIONS (test.test1_b0,test.test1_b1);
=> SELECT do_tm_task('mergeout', 'test.test1');

[The status after Mergeout after changing the column encoding]
 projection_name | column_name |  encodings   | compressions |    node_name     | ros_count | size_Mb
-----------------+-------------+--------------+--------------+------------------+-----------+---------
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0001 |         1 |     2.8
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0002 |         1 |     2.8
 test1_b0        | epoch       | Int_Delta    | none         | v_trial_node0003 |         1 |     2.8
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0001 |         1 |     3.2
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0002 |         1 |     3.1
 test1_b0        | language_id | Uncompressed | int delta    | v_trial_node0003 |         1 |     3.2
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0001 |         1 |     2.8
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0002 |         1 |     2.8
 test1_b1        | epoch       | Int_Delta    | none         | v_trial_node0003 |         1 |     2.8
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0001 |         1 |     3.2
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0002 |         1 |     3.2
 test1_b1        | language_id | Uncompressed | int delta    | v_trial_node0003 |         1 |     3.1

=> INSERT INTO test.test1 SELECT * FROM test.test1;
=> COMMIT;
=> SELECT do_tm_task('mergeout', 'test.test1');

[The status after Mergeout after loading some data into projections]
 projection_name | column_name | encodings  | compressions |    node_name     | ros_count | size_Mb
-----------------+-------------+------------+--------------+------------------+-----------+---------
 test1_b0        | epoch       | Int_Delta  | none         | v_trial_node0001 |         1 |     5.7
 test1_b0        | epoch       | Int_Delta  | none         | v_trial_node0002 |         1 |     5.5
 test1_b0        | epoch       | Int_Delta  | none         | v_trial_node0003 |         1 |     5.6
 test1_b0        | language_id | Block_Dict | none         | v_trial_node0001 |         1 |     5.1
 test1_b0        | language_id | Block_Dict | none         | v_trial_node0002 |         1 |       5
 test1_b0        | language_id | Block_Dict | none         | v_trial_node0003 |         1 |     5.1
 test1_b1        | epoch       | Int_Delta  | none         | v_trial_node0001 |         1 |     5.6
 test1_b1        | epoch       | Int_Delta  | none         | v_trial_node0002 |         1 |     5.7
 test1_b1        | epoch       | Int_Delta  | none         | v_trial_node0003 |         1 |     5.5
 test1_b1        | language_id | Block_Dict | none         | v_trial_node0001 |         1 |     5.1
 test1_b1        | language_id | Block_Dict | none         | v_trial_node0002 |         1 |     5.1
 test1_b1        | language_id | Block_Dict | none         | v_trial_node0003 |         1 |       5

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...