What is the best approach to ssh to remote host and run commands multiple times?
Clash Royale CLAN TAG#URR8PPP
up vote
0
down vote
favorite
I am trying to write a bash script to grep some logs on remote host and save it on my local desktop.
Here is the part of the script I write to ssh to remote host, grep the log I need and save it locally, the problem with this script is that I am constantly getting Killed by signal 15 after around 30 min when I start running the script. My guess is that remote host kicks me out since I have stayed on it for too long, but I cannot do anything about that since the log I need to search is huge.
# SSH and Grep Transfer Logs
echo "Grep Transfer Logs..."
assh $hostName "zgrep $CID path/to/log/*" > $CID_$refineDateTime_TransferLog.txt
# Process Wallet Transfer Log and Get Preload Request IDs
echo "Process Transfer Logs..."
RIDs=`./ProcessTransferLog.pl $CID_$refineDateTime_TransferLog.txt $CID_$refineDateTime_TransferLogSummary.csv`
# Grab Business Log and for Each RID
for RID in $RIDs//;/ ; do
echo "Grep Business Logs ("$RID")..."
assh $hostName "zgrep $RID /path/to/log/*" > $CID_$refineDateTime_BusinessLog_$RID.txt
done
I would like to know the root cause of this problem and if there is a way to solve this.
shell-script remote
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
asked Oct 1 '16 at 2:07
Jialun Liu
40117
add a comment |
up vote
0
down vote
favorite
I am trying to write a bash script to grep some logs on remote host and save it on my local desktop.
Here is the part of the script I write to ssh to remote host, grep the log I need and save it locally, the problem with this script is that I am constantly getting Killed by signal 15 after around 30 min when I start running the script. My guess is that remote host kicks me out since I have stayed on it for too long, but I cannot do anything about that since the log I need to search is huge.
# SSH and Grep Transfer Logs
echo "Grep Transfer Logs..."
assh $hostName "zgrep $CID path/to/log/*" > $CID_$refineDateTime_TransferLog.txt
# Process Wallet Transfer Log and Get Preload Request IDs
echo "Process Transfer Logs..."
RIDs=`./ProcessTransferLog.pl $CID_$refineDateTime_TransferLog.txt $CID_$refineDateTime_TransferLogSummary.csv`
# Grab Business Log and for Each RID
for RID in $RIDs//;/ ; do
echo "Grep Business Logs ("$RID")..."
assh $hostName "zgrep $RID /path/to/log/*" > $CID_$refineDateTime_BusinessLog_$RID.txt
done
I would like to know the root cause of this problem and if there is a way to solve this.
shell-script remote
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
asked Oct 1 '16 at 2:07
Jialun Liu
40117
I am not sure why you are getting the "killed by signal 15", Have you considered thescpcommand to transfer the file from remote host to your machine?
– Timothy Pulliam
Oct 1 '16 at 3:10
@TimothyPulliam Thanks for your help, the problem is the logs are at least few GBs, I am trying to avoid downloading all that file to local. It does not seem that efficient.
– Jialun Liu
Oct 1 '16 at 7:30
I am a idiot, I set a time out when I run the script, that is why I get the "Killed by signal 15" all the time.
– Jialun Liu
Oct 4 '16 at 7:34
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I am trying to write a bash script to grep some logs on remote host and save it on my local desktop.
Here is the part of the script I write to ssh to remote host, grep the log I need and save it locally, the problem with this script is that I am constantly getting Killed by signal 15 after around 30 min when I start running the script. My guess is that remote host kicks me out since I have stayed on it for too long, but I cannot do anything about that since the log I need to search is huge.
# SSH and Grep Transfer Logs
echo "Grep Transfer Logs..."
assh $hostName "zgrep $CID path/to/log/*" > $CID_$refineDateTime_TransferLog.txt
# Process Wallet Transfer Log and Get Preload Request IDs
echo "Process Transfer Logs..."
RIDs=`./ProcessTransferLog.pl $CID_$refineDateTime_TransferLog.txt $CID_$refineDateTime_TransferLogSummary.csv`
# Grab Business Log and for Each RID
for RID in $RIDs//;/ ; do
echo "Grep Business Logs ("$RID")..."
assh $hostName "zgrep $RID /path/to/log/*" > $CID_$refineDateTime_BusinessLog_$RID.txt
done
I would like to know the root cause of this problem and if there is a way to solve this.
shell-script remote
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
asked Oct 1 '16 at 2:07
Jialun Liu
40117
I am trying to write a bash script to grep some logs on remote host and save it on my local desktop.
Here is the part of the script I write to ssh to remote host, grep the log I need and save it locally, the problem with this script is that I am constantly getting Killed by signal 15 after around 30 min when I start running the script. My guess is that remote host kicks me out since I have stayed on it for too long, but I cannot do anything about that since the log I need to search is huge.
# SSH and Grep Transfer Logs
echo "Grep Transfer Logs..."
assh $hostName "zgrep $CID path/to/log/*" > $CID_$refineDateTime_TransferLog.txt
# Process Wallet Transfer Log and Get Preload Request IDs
echo "Process Transfer Logs..."
RIDs=`./ProcessTransferLog.pl $CID_$refineDateTime_TransferLog.txt $CID_$refineDateTime_TransferLogSummary.csv`
# Grab Business Log and for Each RID
for RID in $RIDs//;/ ; do
echo "Grep Business Logs ("$RID")..."
assh $hostName "zgrep $RID /path/to/log/*" > $CID_$refineDateTime_BusinessLog_$RID.txt
done
I would like to know the root cause of this problem and if there is a way to solve this.
shell-script remote
shell-script remote
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
asked Oct 1 '16 at 2:07
Jialun Liu
40117
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
asked Oct 1 '16 at 2:07
Jialun Liu
40117
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
edited Nov 23 at 14:14
Rui F Ribeiro
38.3k1476127
38.3k1476127
asked Oct 1 '16 at 2:07
Jialun Liu
40117
asked Oct 1 '16 at 2:07
Jialun Liu
40117
asked Oct 1 '16 at 2:07
Jialun Liu
40117
40117
I am not sure why you are getting the "killed by signal 15", Have you considered thescpcommand to transfer the file from remote host to your machine?
– Timothy Pulliam
Oct 1 '16 at 3:10
@TimothyPulliam Thanks for your help, the problem is the logs are at least few GBs, I am trying to avoid downloading all that file to local. It does not seem that efficient.
– Jialun Liu
Oct 1 '16 at 7:30
I am a idiot, I set a time out when I run the script, that is why I get the "Killed by signal 15" all the time.
– Jialun Liu
Oct 4 '16 at 7:34
add a comment |
I am not sure why you are getting the "killed by signal 15", Have you considered thescpcommand to transfer the file from remote host to your machine?
– Timothy Pulliam
Oct 1 '16 at 3:10
@TimothyPulliam Thanks for your help, the problem is the logs are at least few GBs, I am trying to avoid downloading all that file to local. It does not seem that efficient.
– Jialun Liu
Oct 1 '16 at 7:30
I am a idiot, I set a time out when I run the script, that is why I get the "Killed by signal 15" all the time.
– Jialun Liu
Oct 4 '16 at 7:34
I am not sure why you are getting the "killed by signal 15", Have you considered the
scp command to transfer the file from remote host to your machine?– Timothy Pulliam
Oct 1 '16 at 3:10
I am not sure why you are getting the "killed by signal 15", Have you considered the
scp command to transfer the file from remote host to your machine?– Timothy Pulliam
Oct 1 '16 at 3:10
@TimothyPulliam Thanks for your help, the problem is the logs are at least few GBs, I am trying to avoid downloading all that file to local. It does not seem that efficient.
– Jialun Liu
Oct 1 '16 at 7:30
@TimothyPulliam Thanks for your help, the problem is the logs are at least few GBs, I am trying to avoid downloading all that file to local. It does not seem that efficient.
– Jialun Liu
Oct 1 '16 at 7:30
I am a idiot, I set a time out when I run the script, that is why I get the "Killed by signal 15" all the time.
– Jialun Liu
Oct 4 '16 at 7:34
I am a idiot, I set a time out when I run the script, that is why I get the "Killed by signal 15" all the time.
– Jialun Liu
Oct 4 '16 at 7:34
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f313563%2fwhat-is-the-best-approach-to-ssh-to-remote-host-and-run-commands-multiple-times%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
I am not sure why you are getting the "killed by signal 15", Have you considered the
scpcommand to transfer the file from remote host to your machine?– Timothy Pulliam
Oct 1 '16 at 3:10
@TimothyPulliam Thanks for your help, the problem is the logs are at least few GBs, I am trying to avoid downloading all that file to local. It does not seem that efficient.
– Jialun Liu
Oct 1 '16 at 7:30
I am a idiot, I set a time out when I run the script, that is why I get the "Killed by signal 15" all the time.
– Jialun Liu
Oct 4 '16 at 7:34