Compare first and second column of two files and print the row from second file if there is a match
Clash Royale CLAN TAG#URR8PPP
I went through the answers in the following question but I couldn't get expected output as shown below.
comparing the first column of two files and printing the entire row of the second file if the first columns match
File 1
CLASS|124655
CLASS|124656
CLASS|124657
CLASS|124658
File 2
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
CLASS|124665|JEFF|JONES||
CLASS|124665||||1236556
Expected output
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
I tried grep -f file1 file2 but it got killed by the Kernel and it was taking too long to process. File 1 and File 2 have more than 1m records.
linux text-processing awk
add a comment |
I went through the answers in the following question but I couldn't get expected output as shown below.
comparing the first column of two files and printing the entire row of the second file if the first columns match
File 1
CLASS|124655
CLASS|124656
CLASS|124657
CLASS|124658
File 2
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
CLASS|124665|JEFF|JONES||
CLASS|124665||||1236556
Expected output
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
I tried grep -f file1 file2 but it got killed by the Kernel and it was taking too long to process. File 1 and File 2 have more than 1m records.
linux text-processing awk
add a comment |
I went through the answers in the following question but I couldn't get expected output as shown below.
comparing the first column of two files and printing the entire row of the second file if the first columns match
File 1
CLASS|124655
CLASS|124656
CLASS|124657
CLASS|124658
File 2
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
CLASS|124665|JEFF|JONES||
CLASS|124665||||1236556
Expected output
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
I tried grep -f file1 file2 but it got killed by the Kernel and it was taking too long to process. File 1 and File 2 have more than 1m records.
linux text-processing awk
I went through the answers in the following question but I couldn't get expected output as shown below.
comparing the first column of two files and printing the entire row of the second file if the first columns match
File 1
CLASS|124655
CLASS|124656
CLASS|124657
CLASS|124658
File 2
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
CLASS|124665|JEFF|JONES||
CLASS|124665||||1236556
Expected output
CLASS|124655|STEVE|SMITH||
CLASS|124656|ROGERS|KNIGHT||
CLASS|124657|MITCHELL|BRADFORD||
CLASS|124657||||1236536
CLASS|124658|NORMAN|JONES||
CLASS|124658||||1236539
I tried grep -f file1 file2 but it got killed by the Kernel and it was taking too long to process. File 1 and File 2 have more than 1m records.
linux text-processing awk
linux text-processing awk
asked Jan 21 at 20:09
BalaBala
1305
1305
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
An awk
solution would be this:
$ awk -v FS="|" 'NR==FNR get[$1" get[$1"|"$2]' f1.txt f2.txt
Don't know if this works for 1m records.
Thanks. It worked.
– Bala
Jan 21 at 20:45
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f495849%2fcompare-first-and-second-column-of-two-files-and-print-the-row-from-second-file%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
An awk
solution would be this:
$ awk -v FS="|" 'NR==FNR get[$1" get[$1"|"$2]' f1.txt f2.txt
Don't know if this works for 1m records.
Thanks. It worked.
– Bala
Jan 21 at 20:45
add a comment |
An awk
solution would be this:
$ awk -v FS="|" 'NR==FNR get[$1" get[$1"|"$2]' f1.txt f2.txt
Don't know if this works for 1m records.
Thanks. It worked.
– Bala
Jan 21 at 20:45
add a comment |
An awk
solution would be this:
$ awk -v FS="|" 'NR==FNR get[$1" get[$1"|"$2]' f1.txt f2.txt
Don't know if this works for 1m records.
An awk
solution would be this:
$ awk -v FS="|" 'NR==FNR get[$1" get[$1"|"$2]' f1.txt f2.txt
Don't know if this works for 1m records.
answered Jan 21 at 20:19
finswimmerfinswimmer
52416
52416
Thanks. It worked.
– Bala
Jan 21 at 20:45
add a comment |
Thanks. It worked.
– Bala
Jan 21 at 20:45
Thanks. It worked.
– Bala
Jan 21 at 20:45
Thanks. It worked.
– Bala
Jan 21 at 20:45
add a comment |
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f495849%2fcompare-first-and-second-column-of-two-files-and-print-the-row-from-second-file%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown