Only copy files from a particular date from s3 storage
Clash Royale CLAN TAG#URR8PPP
up vote
0
down vote
favorite
I would like to only copy files from S3 that are from today out of a certain bucket with 100s of files. I tried the following: $ aws s3 ls s3://cve-etherwan/ --recursive --region=us-west-2 | grep 2018-11-06 | awk 'system("aws s3 sync s3://cve-etherwan/$4 . --region=us-west-2") '
but it doesn't quite work, I also get files from other dates.
How do I do this correctly?
date file-copy aws amazon-s3
add a comment |Â
up vote
0
down vote
favorite
I would like to only copy files from S3 that are from today out of a certain bucket with 100s of files. I tried the following: $ aws s3 ls s3://cve-etherwan/ --recursive --region=us-west-2 | grep 2018-11-06 | awk 'system("aws s3 sync s3://cve-etherwan/$4 . --region=us-west-2") '
but it doesn't quite work, I also get files from other dates.
How do I do this correctly?
date file-copy aws amazon-s3
add a comment |Â
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I would like to only copy files from S3 that are from today out of a certain bucket with 100s of files. I tried the following: $ aws s3 ls s3://cve-etherwan/ --recursive --region=us-west-2 | grep 2018-11-06 | awk 'system("aws s3 sync s3://cve-etherwan/$4 . --region=us-west-2") '
but it doesn't quite work, I also get files from other dates.
How do I do this correctly?
date file-copy aws amazon-s3
I would like to only copy files from S3 that are from today out of a certain bucket with 100s of files. I tried the following: $ aws s3 ls s3://cve-etherwan/ --recursive --region=us-west-2 | grep 2018-11-06 | awk 'system("aws s3 sync s3://cve-etherwan/$4 . --region=us-west-2") '
but it doesn't quite work, I also get files from other dates.
How do I do this correctly?
date file-copy aws amazon-s3
date file-copy aws amazon-s3
asked 7 mins ago
cerr
68782239
68782239
add a comment |Â
add a comment |Â
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f480279%2fonly-copy-files-from-a-particular-date-from-s3-storage%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password