Backuppc rsync occasionally hangs on remote
Clash Royale CLAN TAG#URR8PPP
up vote
0
down vote
favorite
I am using Backuppc for backing up 7 Ubuntu 18.04 machines. These hosts are running the exact same setup and hardware. I am just backing up the htdocs folders and and the db dumps that are generated by using DumpPreUserCmd bash script. Since the # of files and size is pretty small, a full or incremental backup is taking between 1-5 minutes per host. However one host is causing trouble from time to time and I have absolutely no clue what is going on.
Two days ago the incremental backup took 440 minutes for 2169 #files (26MB). I checked the free memory and cpu on the remote and the server while the backup was running and couldn't identify any problems. Actually the rsync process on the remote was stuck with 0% CPU usage and was only showing some workload every other minute. (Also the NewFileList was only updated every 5-10 minutes on the server) Next day the incremental backup was finished within 2 minutes. Today I was facing the same issue. So I manually stopped the backup and re-queued it. This time is was done in 2 minutes.
Actually I have no idea what is going on since it is only happening to this particular host which has the same setup as the other hosts.
top - 13:04:51 up 6 days, 2:05, 1 user, load average: 0,01, 0,01, 0,00
Tasks: 1 total, 0 running, 1 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0,3 us, 0,0 sy, 0,0 ni, 97,1 id, 0,0 wa, 0,0 hi, 0,3 si, 2,3 st
KiB Mem : 994144 total, 69084 free, 379932 used, 545128 buff/cache
KiB Swap: 1310712 total, 694520 free, 616192 used. 396812 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6107 backuppc 20 0 21944 9536 2380 S 0,0 1,0 0:01.58 rsync
strace
select(2, , [1], , tv_sec=60, tv_usec=0) = 1 (out [1], left tv_sec=59, tv_usec=999963)
write(1, ""nn#: libraries/classes/Plugins/"..., 18206) = 16384
Any ideas on how to debug this issue?
ubuntu rsync backup
asked 2 days ago
travisbotello
11
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |Â
up vote
0
down vote
favorite
I am using Backuppc for backing up 7 Ubuntu 18.04 machines. These hosts are running the exact same setup and hardware. I am just backing up the htdocs folders and and the db dumps that are generated by using DumpPreUserCmd bash script. Since the # of files and size is pretty small, a full or incremental backup is taking between 1-5 minutes per host. However one host is causing trouble from time to time and I have absolutely no clue what is going on.
Two days ago the incremental backup took 440 minutes for 2169 #files (26MB). I checked the free memory and cpu on the remote and the server while the backup was running and couldn't identify any problems. Actually the rsync process on the remote was stuck with 0% CPU usage and was only showing some workload every other minute. (Also the NewFileList was only updated every 5-10 minutes on the server) Next day the incremental backup was finished within 2 minutes. Today I was facing the same issue. So I manually stopped the backup and re-queued it. This time is was done in 2 minutes.
Actually I have no idea what is going on since it is only happening to this particular host which has the same setup as the other hosts.
top - 13:04:51 up 6 days, 2:05, 1 user, load average: 0,01, 0,01, 0,00
Tasks: 1 total, 0 running, 1 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0,3 us, 0,0 sy, 0,0 ni, 97,1 id, 0,0 wa, 0,0 hi, 0,3 si, 2,3 st
KiB Mem : 994144 total, 69084 free, 379932 used, 545128 buff/cache
KiB Swap: 1310712 total, 694520 free, 616192 used. 396812 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6107 backuppc 20 0 21944 9536 2380 S 0,0 1,0 0:01.58 rsync
strace
select(2, , [1], , tv_sec=60, tv_usec=0) = 1 (out [1], left tv_sec=59, tv_usec=999963)
write(1, ""nn#: libraries/classes/Plugins/"..., 18206) = 16384
Any ideas on how to debug this issue?
ubuntu rsync backup
asked 2 days ago
travisbotello
11
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Runstraceon the rsync processes and see what calls are stalling. Is it a read() or a write()? Can you reproduce the problem with any other tools (such as bytaring up the same tree)?
– BowlOfRed
yesterday
When Istracethersyncprocess I can see that it is running incredibly slow. It is ca combination ofselect()andwrite()sequences
– travisbotello
yesterday
Actually theselect()is stalling every other minute.
– travisbotello
yesterday
add a comment |Â
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I am using Backuppc for backing up 7 Ubuntu 18.04 machines. These hosts are running the exact same setup and hardware. I am just backing up the htdocs folders and and the db dumps that are generated by using DumpPreUserCmd bash script. Since the # of files and size is pretty small, a full or incremental backup is taking between 1-5 minutes per host. However one host is causing trouble from time to time and I have absolutely no clue what is going on.
Two days ago the incremental backup took 440 minutes for 2169 #files (26MB). I checked the free memory and cpu on the remote and the server while the backup was running and couldn't identify any problems. Actually the rsync process on the remote was stuck with 0% CPU usage and was only showing some workload every other minute. (Also the NewFileList was only updated every 5-10 minutes on the server) Next day the incremental backup was finished within 2 minutes. Today I was facing the same issue. So I manually stopped the backup and re-queued it. This time is was done in 2 minutes.
Actually I have no idea what is going on since it is only happening to this particular host which has the same setup as the other hosts.
top - 13:04:51 up 6 days, 2:05, 1 user, load average: 0,01, 0,01, 0,00
Tasks: 1 total, 0 running, 1 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0,3 us, 0,0 sy, 0,0 ni, 97,1 id, 0,0 wa, 0,0 hi, 0,3 si, 2,3 st
KiB Mem : 994144 total, 69084 free, 379932 used, 545128 buff/cache
KiB Swap: 1310712 total, 694520 free, 616192 used. 396812 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6107 backuppc 20 0 21944 9536 2380 S 0,0 1,0 0:01.58 rsync
strace
select(2, , [1], , tv_sec=60, tv_usec=0) = 1 (out [1], left tv_sec=59, tv_usec=999963)
write(1, ""nn#: libraries/classes/Plugins/"..., 18206) = 16384
Any ideas on how to debug this issue?
ubuntu rsync backup
asked 2 days ago
travisbotello
11
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
I am using Backuppc for backing up 7 Ubuntu 18.04 machines. These hosts are running the exact same setup and hardware. I am just backing up the htdocs folders and and the db dumps that are generated by using DumpPreUserCmd bash script. Since the # of files and size is pretty small, a full or incremental backup is taking between 1-5 minutes per host. However one host is causing trouble from time to time and I have absolutely no clue what is going on.
Two days ago the incremental backup took 440 minutes for 2169 #files (26MB). I checked the free memory and cpu on the remote and the server while the backup was running and couldn't identify any problems. Actually the rsync process on the remote was stuck with 0% CPU usage and was only showing some workload every other minute. (Also the NewFileList was only updated every 5-10 minutes on the server) Next day the incremental backup was finished within 2 minutes. Today I was facing the same issue. So I manually stopped the backup and re-queued it. This time is was done in 2 minutes.
Actually I have no idea what is going on since it is only happening to this particular host which has the same setup as the other hosts.
top - 13:04:51 up 6 days, 2:05, 1 user, load average: 0,01, 0,01, 0,00
Tasks: 1 total, 0 running, 1 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0,3 us, 0,0 sy, 0,0 ni, 97,1 id, 0,0 wa, 0,0 hi, 0,3 si, 2,3 st
KiB Mem : 994144 total, 69084 free, 379932 used, 545128 buff/cache
KiB Swap: 1310712 total, 694520 free, 616192 used. 396812 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6107 backuppc 20 0 21944 9536 2380 S 0,0 1,0 0:01.58 rsync
strace
select(2, , [1], , tv_sec=60, tv_usec=0) = 1 (out [1], left tv_sec=59, tv_usec=999963)
write(1, ""nn#: libraries/classes/Plugins/"..., 18206) = 16384
Any ideas on how to debug this issue?
ubuntu rsync backup
ubuntu rsync backup
asked 2 days ago
travisbotello
11
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 2 days ago
travisbotello
11
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited yesterday
asked 2 days ago
travisbotello
11
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 2 days ago
travisbotello
11
asked 2 days ago
travisbotello
11
11
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
travisbotello is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Runstraceon the rsync processes and see what calls are stalling. Is it a read() or a write()? Can you reproduce the problem with any other tools (such as bytaring up the same tree)?
– BowlOfRed
yesterday
When Istracethersyncprocess I can see that it is running incredibly slow. It is ca combination ofselect()andwrite()sequences
– travisbotello
yesterday
Actually theselect()is stalling every other minute.
– travisbotello
yesterday
add a comment |Â
Runstraceon the rsync processes and see what calls are stalling. Is it a read() or a write()? Can you reproduce the problem with any other tools (such as bytaring up the same tree)?
– BowlOfRed
yesterday
When Istracethersyncprocess I can see that it is running incredibly slow. It is ca combination ofselect()andwrite()sequences
– travisbotello
yesterday
Actually theselect()is stalling every other minute.
– travisbotello
yesterday
Run
strace on the rsync processes and see what calls are stalling. Is it a read() or a write()? Can you reproduce the problem with any other tools (such as by taring up the same tree)?– BowlOfRed
yesterday
Run
strace on the rsync processes and see what calls are stalling. Is it a read() or a write()? Can you reproduce the problem with any other tools (such as by taring up the same tree)?– BowlOfRed
yesterday
When I
strace the rsync process I can see that it is running incredibly slow. It is ca combination of select() and write() sequences– travisbotello
yesterday
When I
strace the rsync process I can see that it is running incredibly slow. It is ca combination of select() and write() sequences– travisbotello
yesterday
Actually the
select() is stalling every other minute.– travisbotello
yesterday
Actually the
select() is stalling every other minute.– travisbotello
yesterday
add a comment |Â
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
travisbotello is a new contributor. Be nice, and check out our Code of Conduct.
travisbotello is a new contributor. Be nice, and check out our Code of Conduct.
travisbotello is a new contributor. Be nice, and check out our Code of Conduct.
travisbotello is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f473685%2fbackuppc-rsync-occasionally-hangs-on-remote%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Run
straceon the rsync processes and see what calls are stalling. Is it a read() or a write()? Can you reproduce the problem with any other tools (such as bytaring up the same tree)?– BowlOfRed
yesterday
When I
stracethersyncprocess I can see that it is running incredibly slow. It is ca combination ofselect()andwrite()sequences– travisbotello
yesterday
Actually the
select()is stalling every other minute.– travisbotello
yesterday