How to wget a textile with a folder name and URL?
Multi tool use
Clash Royale CLAN TAG#URR8PPP
up vote
0
down vote
favorite
I have a text file with a specific folder name and URL with a delimiter 't'. I wish to download all the URL files into their respective folder directories. What do I do?
Also, this is actually the ImageNet URL file with SYSNET indicator at the front.
Is there any alternative way to download ImageNet image into their respective folder like this?
folder1 http://example1.com
folder2 http://example2.com
folder3 http://example3.com
linux wget
edited Oct 2 '17 at 12:07
Grayson Kent
19711
asked Oct 2 '17 at 10:34
JefferyLR
93
add a comment |Â
up vote
0
down vote
favorite
I have a text file with a specific folder name and URL with a delimiter 't'. I wish to download all the URL files into their respective folder directories. What do I do?
Also, this is actually the ImageNet URL file with SYSNET indicator at the front.
Is there any alternative way to download ImageNet image into their respective folder like this?
folder1 http://example1.com
folder2 http://example2.com
folder3 http://example3.com
linux wget
edited Oct 2 '17 at 12:07
Grayson Kent
19711
asked Oct 2 '17 at 10:34
JefferyLR
93
1
You can use awk to parse the data and then use the built in system function to execute the wget command so something like awk ' system("wget -O ""$1"/filename.txt" ""$1""") ' sourcefile.txt
– Raman Sailopal
Oct 2 '17 at 10:47
Do you mind provide some example? Im still new to linux...
– JefferyLR
Oct 2 '17 at 10:48
I just did. With awk, $1 will represent the first space delimited piece of data on each line and so folder1 on the first line. $2 will represent the second piece of data and so http.... We then use the system function and pass it the built wget command to be executed.
– Raman Sailopal
Oct 2 '17 at 10:53
add a comment |Â
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I have a text file with a specific folder name and URL with a delimiter 't'. I wish to download all the URL files into their respective folder directories. What do I do?
Also, this is actually the ImageNet URL file with SYSNET indicator at the front.
Is there any alternative way to download ImageNet image into their respective folder like this?
folder1 http://example1.com
folder2 http://example2.com
folder3 http://example3.com
linux wget
edited Oct 2 '17 at 12:07
Grayson Kent
19711
asked Oct 2 '17 at 10:34
JefferyLR
93
I have a text file with a specific folder name and URL with a delimiter 't'. I wish to download all the URL files into their respective folder directories. What do I do?
Also, this is actually the ImageNet URL file with SYSNET indicator at the front.
Is there any alternative way to download ImageNet image into their respective folder like this?
folder1 http://example1.com
folder2 http://example2.com
folder3 http://example3.com
linux wget
linux wget
edited Oct 2 '17 at 12:07
Grayson Kent
19711
asked Oct 2 '17 at 10:34
JefferyLR
93
edited Oct 2 '17 at 12:07
Grayson Kent
19711
asked Oct 2 '17 at 10:34
JefferyLR
93
edited Oct 2 '17 at 12:07
Grayson Kent
19711
edited Oct 2 '17 at 12:07
Grayson Kent
19711
edited Oct 2 '17 at 12:07
Grayson Kent
19711
19711
asked Oct 2 '17 at 10:34
JefferyLR
93
asked Oct 2 '17 at 10:34
JefferyLR
93
asked Oct 2 '17 at 10:34
JefferyLR
93
93
1
You can use awk to parse the data and then use the built in system function to execute the wget command so something like awk ' system("wget -O ""$1"/filename.txt" ""$1""") ' sourcefile.txt
– Raman Sailopal
Oct 2 '17 at 10:47
Do you mind provide some example? Im still new to linux...
– JefferyLR
Oct 2 '17 at 10:48
I just did. With awk, $1 will represent the first space delimited piece of data on each line and so folder1 on the first line. $2 will represent the second piece of data and so http.... We then use the system function and pass it the built wget command to be executed.
– Raman Sailopal
Oct 2 '17 at 10:53
add a comment |Â
1
You can use awk to parse the data and then use the built in system function to execute the wget command so something like awk ' system("wget -O ""$1"/filename.txt" ""$1""") ' sourcefile.txt
– Raman Sailopal
Oct 2 '17 at 10:47
Do you mind provide some example? Im still new to linux...
– JefferyLR
Oct 2 '17 at 10:48
I just did. With awk, $1 will represent the first space delimited piece of data on each line and so folder1 on the first line. $2 will represent the second piece of data and so http.... We then use the system function and pass it the built wget command to be executed.
– Raman Sailopal
Oct 2 '17 at 10:53
1
1
You can use awk to parse the data and then use the built in system function to execute the wget command so something like awk ' system("wget -O ""$1"/filename.txt" ""$1""") ' sourcefile.txt
– Raman Sailopal
Oct 2 '17 at 10:47
You can use awk to parse the data and then use the built in system function to execute the wget command so something like awk ' system("wget -O ""$1"/filename.txt" ""$1""") ' sourcefile.txt
– Raman Sailopal
Oct 2 '17 at 10:47
Do you mind provide some example? Im still new to linux...
– JefferyLR
Oct 2 '17 at 10:48
Do you mind provide some example? Im still new to linux...
– JefferyLR
Oct 2 '17 at 10:48
I just did. With awk, $1 will represent the first space delimited piece of data on each line and so folder1 on the first line. $2 will represent the second piece of data and so http.... We then use the system function and pass it the built wget command to be executed.
– Raman Sailopal
Oct 2 '17 at 10:53
I just did. With awk, $1 will represent the first space delimited piece of data on each line and so folder1 on the first line. $2 will represent the second piece of data and so http.... We then use the system function and pass it the built wget command to be executed.
– Raman Sailopal
Oct 2 '17 at 10:53
add a comment |Â
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Â
draft saved
draft discarded
Â
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f395618%2fhow-to-wget-a-textile-with-a-folder-name-and-url%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
1
You can use awk to parse the data and then use the built in system function to execute the wget command so something like awk ' system("wget -O ""$1"/filename.txt" ""$1""") ' sourcefile.txt
– Raman Sailopal
Oct 2 '17 at 10:47
Do you mind provide some example? Im still new to linux...
– JefferyLR
Oct 2 '17 at 10:48
I just did. With awk, $1 will represent the first space delimited piece of data on each line and so folder1 on the first line. $2 will represent the second piece of data and so http.... We then use the system function and pass it the built wget command to be executed.
– Raman Sailopal
Oct 2 '17 at 10:53