auto">Hello!

Here is some benchmarks with compiled binary from issue_169 branch and vanilla binary v2.2.7 from pgpro ubuntu version.
All backup files were cached in OS file cache because server has 384GB of RAM

# free
              total        used        free      shared  buff/cache   available
Mem:      396137056     3270828    10228528        3340   382637700   390224304
Swap:             0           0           0
#lscpu
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              56
On-line CPU(s) list: 0-55
Thread(s) per core:  2
Core(s) per socket:  14

Here is some benchmarks:

 instance  10       Q4J2U0  2020-01-22 21:49:35+00  DELTA  STREAM    7/7   10m:3s  5648MB    32MB    1.82  140/F40000D0  140/F4FF0D48  OK
 instance  10       Q4H82I  2020-01-21 21:47:14+00  DELTA  STREAM    7/7   9m:53s  5376MB    48MB    1.82  13E/50000D0   13E/62AF4A0   OK
 instance  10       Q4FDER  2020-01-20 21:45:09+00  DELTA  STREAM    7/7   7m:33s  3745MB    32MB    1.79  13B/3B0000D0  13B/3B9CD8E0  OK
 instance  10       Q4DR2N  2020-01-20 00:48:59+00  DELTA  STREAM    7/7  11m:26s  7195MB   912MB    1.79  139/DF062588  13A/16ADA550  OK
 instance  10       Q4BQMV  2020-01-18 23:38:26+00  FULL   STREAM    7/0    1h:5m    48GB   128MB    1.85  135/A60000D0  135/ACDBA918  OK

#vanilla binary from pgpro ubuntu repo
~/scripts/ansible# pg_probackup-10 --version
pg_probackup-10 2.2.7 (PostgreSQL 10.10)


#compiled binary from issue_169 branch
~/scripts/ansible# pg_probackup-devel-10 --version
pg_probackup-devel-10 2.2.7 (PostgreSQL 10.11)

(.venv) root@server:~/scripts/ansible# time pg_probackup-devel-10 restore --skip-block-validation -j 8 -B /backup/postgresql/backup --instance instance -i Q4J2U0 --remote-proto=none -D /backup/postgresql/tmp/instance
INFO: Validating parents for backup Q4J2U0
INFO: Validating backup Q4BQMV
INFO: Backup Q4BQMV data files are valid
INFO: Validating backup Q4DR2N
INFO: Backup Q4DR2N data files are valid
INFO: Validating backup Q4FDER
INFO: Backup Q4FDER data files are valid
INFO: Validating backup Q4H82I
INFO: Backup Q4H82I data files are valid
INFO: Validating backup Q4J2U0
INFO: Backup Q4J2U0 data files are valid
INFO: Backup Q4J2U0 WAL segments are valid
INFO: Backup Q4J2U0 is valid.
INFO: Restore of backup Q4J2U0 completed.

           issue_169                                                  vanilla
1 run
real    4m50.818s                                                  9m10.289
user    16m36.799s                                               16m41.06
sys     3m12.250s                                                  3m10.250

2 run
real    4m12.526s                                                  9m8.740s
user    16m38.221s                                               16m38.63
sys     2m56.392s                                                  3m8.451s

3 run
real    4m11.876                                                   9m3.121s
user    16m40.398                                                16m38.88
sys     3m1.692s                                                   3m6.698s

incremental chain restore optimizations #169

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions