Transform tar into cpio without rooting?

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
3
down vote

favorite












I have a tarball containing many files with root:root owner and/or special device inodes. cpio only accepts paths existing in the file system when it is creating a cpio archive. And I don't want to have to sudo in order to transform tar into cpio, while I want to preserve all the permissions, owners, and special inodes.



Is there some clean way of handling this?



EDIT1:



I believe that fakeroot can be seen as somewhat clean way. However it does not scale as expected - nearly 1,000x speed difference:



[user@computer root]$ ls -l ../fanbox.tar
-rw-rw-r-- 1 user user 56555520 May 22 03:33 ../fanbox.tar
[user@computer root]$ time tar -x --delay-directory-restore -f ../fanbox.tar
tar: dev/null: Cannot mknod: Operation not permitted
tar: dev/random: Cannot mknod: Operation not permitted
tar: dev/urandom: Cannot mknod: Operation not permitted
tar: Exiting with failure status due to previous errors

real 0m0.255s
user 0m0.062s
sys 0m0.193s
[user@computer root]$ rm -rf *
[user@computer root]$ time fakeroot tar -x --delay-directory-restore -f ../fanbox.tar

real 3m49.381s
user 0m0.812s
sys 0m2.760s
[user@computer root]$


Based on the output of time command I guess it is because of the communication between fakeroot and faked.



For reference, there is no much difference between a 2M tarball and 50M tarball when I changed fakeroot into sudo bash in my script. And also I believe that the problem is the number of files in the tarball, not the size: I used the same script on a ~10M tarball with two 5M binaries, and the script is not so slow.







share|improve this question

















  • 2




    what exactly do you want to transform? you could look into the pax command, i.e. pax -r -f filename.tar -s'/^///' will remove the leading slash from files in the archive allowing you to extract the file into any directory
    – Subbeh
    May 18 at 6:17











  • I will need to be root to preserve owner and to just create the special nodes. That forces me to write in my shell script something like sudo rm -rf root each time, which is definitely not a clean way.
    – Thiner
    May 18 at 6:20










  • Why do you like to convert into an inferior format anyway?
    – schily
    Jun 6 at 14:35










  • @schily You cannot make a linux initramfs with a tarball, I believe.
    – Thiner
    Jun 18 at 7:48










  • The content of a filesystem can be filled up by either tar or cpio
    – schily
    Jun 18 at 8:00














up vote
3
down vote

favorite












I have a tarball containing many files with root:root owner and/or special device inodes. cpio only accepts paths existing in the file system when it is creating a cpio archive. And I don't want to have to sudo in order to transform tar into cpio, while I want to preserve all the permissions, owners, and special inodes.



Is there some clean way of handling this?



EDIT1:



I believe that fakeroot can be seen as somewhat clean way. However it does not scale as expected - nearly 1,000x speed difference:



[user@computer root]$ ls -l ../fanbox.tar
-rw-rw-r-- 1 user user 56555520 May 22 03:33 ../fanbox.tar
[user@computer root]$ time tar -x --delay-directory-restore -f ../fanbox.tar
tar: dev/null: Cannot mknod: Operation not permitted
tar: dev/random: Cannot mknod: Operation not permitted
tar: dev/urandom: Cannot mknod: Operation not permitted
tar: Exiting with failure status due to previous errors

real 0m0.255s
user 0m0.062s
sys 0m0.193s
[user@computer root]$ rm -rf *
[user@computer root]$ time fakeroot tar -x --delay-directory-restore -f ../fanbox.tar

real 3m49.381s
user 0m0.812s
sys 0m2.760s
[user@computer root]$


Based on the output of time command I guess it is because of the communication between fakeroot and faked.



For reference, there is no much difference between a 2M tarball and 50M tarball when I changed fakeroot into sudo bash in my script. And also I believe that the problem is the number of files in the tarball, not the size: I used the same script on a ~10M tarball with two 5M binaries, and the script is not so slow.







share|improve this question

















  • 2




    what exactly do you want to transform? you could look into the pax command, i.e. pax -r -f filename.tar -s'/^///' will remove the leading slash from files in the archive allowing you to extract the file into any directory
    – Subbeh
    May 18 at 6:17











  • I will need to be root to preserve owner and to just create the special nodes. That forces me to write in my shell script something like sudo rm -rf root each time, which is definitely not a clean way.
    – Thiner
    May 18 at 6:20










  • Why do you like to convert into an inferior format anyway?
    – schily
    Jun 6 at 14:35










  • @schily You cannot make a linux initramfs with a tarball, I believe.
    – Thiner
    Jun 18 at 7:48










  • The content of a filesystem can be filled up by either tar or cpio
    – schily
    Jun 18 at 8:00












up vote
3
down vote

favorite









up vote
3
down vote

favorite











I have a tarball containing many files with root:root owner and/or special device inodes. cpio only accepts paths existing in the file system when it is creating a cpio archive. And I don't want to have to sudo in order to transform tar into cpio, while I want to preserve all the permissions, owners, and special inodes.



Is there some clean way of handling this?



EDIT1:



I believe that fakeroot can be seen as somewhat clean way. However it does not scale as expected - nearly 1,000x speed difference:



[user@computer root]$ ls -l ../fanbox.tar
-rw-rw-r-- 1 user user 56555520 May 22 03:33 ../fanbox.tar
[user@computer root]$ time tar -x --delay-directory-restore -f ../fanbox.tar
tar: dev/null: Cannot mknod: Operation not permitted
tar: dev/random: Cannot mknod: Operation not permitted
tar: dev/urandom: Cannot mknod: Operation not permitted
tar: Exiting with failure status due to previous errors

real 0m0.255s
user 0m0.062s
sys 0m0.193s
[user@computer root]$ rm -rf *
[user@computer root]$ time fakeroot tar -x --delay-directory-restore -f ../fanbox.tar

real 3m49.381s
user 0m0.812s
sys 0m2.760s
[user@computer root]$


Based on the output of time command I guess it is because of the communication between fakeroot and faked.



For reference, there is no much difference between a 2M tarball and 50M tarball when I changed fakeroot into sudo bash in my script. And also I believe that the problem is the number of files in the tarball, not the size: I used the same script on a ~10M tarball with two 5M binaries, and the script is not so slow.







share|improve this question













I have a tarball containing many files with root:root owner and/or special device inodes. cpio only accepts paths existing in the file system when it is creating a cpio archive. And I don't want to have to sudo in order to transform tar into cpio, while I want to preserve all the permissions, owners, and special inodes.



Is there some clean way of handling this?



EDIT1:



I believe that fakeroot can be seen as somewhat clean way. However it does not scale as expected - nearly 1,000x speed difference:



[user@computer root]$ ls -l ../fanbox.tar
-rw-rw-r-- 1 user user 56555520 May 22 03:33 ../fanbox.tar
[user@computer root]$ time tar -x --delay-directory-restore -f ../fanbox.tar
tar: dev/null: Cannot mknod: Operation not permitted
tar: dev/random: Cannot mknod: Operation not permitted
tar: dev/urandom: Cannot mknod: Operation not permitted
tar: Exiting with failure status due to previous errors

real 0m0.255s
user 0m0.062s
sys 0m0.193s
[user@computer root]$ rm -rf *
[user@computer root]$ time fakeroot tar -x --delay-directory-restore -f ../fanbox.tar

real 3m49.381s
user 0m0.812s
sys 0m2.760s
[user@computer root]$


Based on the output of time command I guess it is because of the communication between fakeroot and faked.



For reference, there is no much difference between a 2M tarball and 50M tarball when I changed fakeroot into sudo bash in my script. And also I believe that the problem is the number of files in the tarball, not the size: I used the same script on a ~10M tarball with two 5M binaries, and the script is not so slow.









share|improve this question












share|improve this question




share|improve this question








edited May 22 at 8:00
























asked May 18 at 6:02









Thiner

163




163







  • 2




    what exactly do you want to transform? you could look into the pax command, i.e. pax -r -f filename.tar -s'/^///' will remove the leading slash from files in the archive allowing you to extract the file into any directory
    – Subbeh
    May 18 at 6:17











  • I will need to be root to preserve owner and to just create the special nodes. That forces me to write in my shell script something like sudo rm -rf root each time, which is definitely not a clean way.
    – Thiner
    May 18 at 6:20










  • Why do you like to convert into an inferior format anyway?
    – schily
    Jun 6 at 14:35










  • @schily You cannot make a linux initramfs with a tarball, I believe.
    – Thiner
    Jun 18 at 7:48










  • The content of a filesystem can be filled up by either tar or cpio
    – schily
    Jun 18 at 8:00












  • 2




    what exactly do you want to transform? you could look into the pax command, i.e. pax -r -f filename.tar -s'/^///' will remove the leading slash from files in the archive allowing you to extract the file into any directory
    – Subbeh
    May 18 at 6:17











  • I will need to be root to preserve owner and to just create the special nodes. That forces me to write in my shell script something like sudo rm -rf root each time, which is definitely not a clean way.
    – Thiner
    May 18 at 6:20










  • Why do you like to convert into an inferior format anyway?
    – schily
    Jun 6 at 14:35










  • @schily You cannot make a linux initramfs with a tarball, I believe.
    – Thiner
    Jun 18 at 7:48










  • The content of a filesystem can be filled up by either tar or cpio
    – schily
    Jun 18 at 8:00







2




2




what exactly do you want to transform? you could look into the pax command, i.e. pax -r -f filename.tar -s'/^///' will remove the leading slash from files in the archive allowing you to extract the file into any directory
– Subbeh
May 18 at 6:17





what exactly do you want to transform? you could look into the pax command, i.e. pax -r -f filename.tar -s'/^///' will remove the leading slash from files in the archive allowing you to extract the file into any directory
– Subbeh
May 18 at 6:17













I will need to be root to preserve owner and to just create the special nodes. That forces me to write in my shell script something like sudo rm -rf root each time, which is definitely not a clean way.
– Thiner
May 18 at 6:20




I will need to be root to preserve owner and to just create the special nodes. That forces me to write in my shell script something like sudo rm -rf root each time, which is definitely not a clean way.
– Thiner
May 18 at 6:20












Why do you like to convert into an inferior format anyway?
– schily
Jun 6 at 14:35




Why do you like to convert into an inferior format anyway?
– schily
Jun 6 at 14:35












@schily You cannot make a linux initramfs with a tarball, I believe.
– Thiner
Jun 18 at 7:48




@schily You cannot make a linux initramfs with a tarball, I believe.
– Thiner
Jun 18 at 7:48












The content of a filesystem can be filled up by either tar or cpio
– schily
Jun 18 at 8:00




The content of a filesystem can be filled up by either tar or cpio
– schily
Jun 18 at 8:00










1 Answer
1






active

oldest

votes

















up vote
3
down vote













You can use fakeroot. As the name says, it fakes the root user, by intercepting serveral syscalls with a LD_LIBRARY_PATH/LD_PRELOAD library wrapper, to have the process believe it's running as root. This has been created for the purpose of building and packaging applications without having to be root, including using make install which typically would be run as root. It's especially well suited to create archives.



During this, a forked daemon faked will run in order to remember all faked file ownership rights or informations on special files the child processes believes they made. So all operations have to be done in the same "instance", or faked will exit and forget what it was remembering.



$ fakeroot
# tar xf ...
# find foo ... | cpio -o ...
# exit
$


Other example showing faked's interaction:



$ mknod /tmp/vaporware b 8 0
mknod: /tmp/vaporware: Operation not permitted
$ fakeroot
# mknod /tmp/vaporware b 8 0
# ls -l /tmp/vaporware
brw-r--r-- 1 root root 8, 0 May 18 08:33 /tmp/vaporware
# exit
$ ls -l /tmp/vaporware
-rw-r--r--. 1 user user 0 May 18 08:33 /tmp/vaporware





share|improve this answer























  • Sorry for undoing the acception. fakeroot does not scale. When I do the same on a 50MB tar file, basically when I untar the file in a fakeroot environment, it becomes annoyingly slow, like 1min or so. Untaring the same tarball outside fakeroot finishes almost instantly. I cannot imagine what would happen if the size gets higher. Any better methods?
    – Thiner
    May 22 at 7:34











  • thanks for explaining. and sorry, that was the only rabbit I had in my hat for this... there are variants of fakeroot based on other interception methods. for example fakeroot-ng based on ptrace instead of LD_PRELOAD. You could give it a shot and see if it works faster
    – A.B
    May 22 at 12:49











Your Answer







StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
convertImagesToLinks: false,
noModals: false,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);








 

draft saved


draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f444523%2ftransform-tar-into-cpio-without-rooting%23new-answer', 'question_page');

);

Post as a guest






























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes








up vote
3
down vote













You can use fakeroot. As the name says, it fakes the root user, by intercepting serveral syscalls with a LD_LIBRARY_PATH/LD_PRELOAD library wrapper, to have the process believe it's running as root. This has been created for the purpose of building and packaging applications without having to be root, including using make install which typically would be run as root. It's especially well suited to create archives.



During this, a forked daemon faked will run in order to remember all faked file ownership rights or informations on special files the child processes believes they made. So all operations have to be done in the same "instance", or faked will exit and forget what it was remembering.



$ fakeroot
# tar xf ...
# find foo ... | cpio -o ...
# exit
$


Other example showing faked's interaction:



$ mknod /tmp/vaporware b 8 0
mknod: /tmp/vaporware: Operation not permitted
$ fakeroot
# mknod /tmp/vaporware b 8 0
# ls -l /tmp/vaporware
brw-r--r-- 1 root root 8, 0 May 18 08:33 /tmp/vaporware
# exit
$ ls -l /tmp/vaporware
-rw-r--r--. 1 user user 0 May 18 08:33 /tmp/vaporware





share|improve this answer























  • Sorry for undoing the acception. fakeroot does not scale. When I do the same on a 50MB tar file, basically when I untar the file in a fakeroot environment, it becomes annoyingly slow, like 1min or so. Untaring the same tarball outside fakeroot finishes almost instantly. I cannot imagine what would happen if the size gets higher. Any better methods?
    – Thiner
    May 22 at 7:34











  • thanks for explaining. and sorry, that was the only rabbit I had in my hat for this... there are variants of fakeroot based on other interception methods. for example fakeroot-ng based on ptrace instead of LD_PRELOAD. You could give it a shot and see if it works faster
    – A.B
    May 22 at 12:49















up vote
3
down vote













You can use fakeroot. As the name says, it fakes the root user, by intercepting serveral syscalls with a LD_LIBRARY_PATH/LD_PRELOAD library wrapper, to have the process believe it's running as root. This has been created for the purpose of building and packaging applications without having to be root, including using make install which typically would be run as root. It's especially well suited to create archives.



During this, a forked daemon faked will run in order to remember all faked file ownership rights or informations on special files the child processes believes they made. So all operations have to be done in the same "instance", or faked will exit and forget what it was remembering.



$ fakeroot
# tar xf ...
# find foo ... | cpio -o ...
# exit
$


Other example showing faked's interaction:



$ mknod /tmp/vaporware b 8 0
mknod: /tmp/vaporware: Operation not permitted
$ fakeroot
# mknod /tmp/vaporware b 8 0
# ls -l /tmp/vaporware
brw-r--r-- 1 root root 8, 0 May 18 08:33 /tmp/vaporware
# exit
$ ls -l /tmp/vaporware
-rw-r--r--. 1 user user 0 May 18 08:33 /tmp/vaporware





share|improve this answer























  • Sorry for undoing the acception. fakeroot does not scale. When I do the same on a 50MB tar file, basically when I untar the file in a fakeroot environment, it becomes annoyingly slow, like 1min or so. Untaring the same tarball outside fakeroot finishes almost instantly. I cannot imagine what would happen if the size gets higher. Any better methods?
    – Thiner
    May 22 at 7:34











  • thanks for explaining. and sorry, that was the only rabbit I had in my hat for this... there are variants of fakeroot based on other interception methods. for example fakeroot-ng based on ptrace instead of LD_PRELOAD. You could give it a shot and see if it works faster
    – A.B
    May 22 at 12:49













up vote
3
down vote










up vote
3
down vote









You can use fakeroot. As the name says, it fakes the root user, by intercepting serveral syscalls with a LD_LIBRARY_PATH/LD_PRELOAD library wrapper, to have the process believe it's running as root. This has been created for the purpose of building and packaging applications without having to be root, including using make install which typically would be run as root. It's especially well suited to create archives.



During this, a forked daemon faked will run in order to remember all faked file ownership rights or informations on special files the child processes believes they made. So all operations have to be done in the same "instance", or faked will exit and forget what it was remembering.



$ fakeroot
# tar xf ...
# find foo ... | cpio -o ...
# exit
$


Other example showing faked's interaction:



$ mknod /tmp/vaporware b 8 0
mknod: /tmp/vaporware: Operation not permitted
$ fakeroot
# mknod /tmp/vaporware b 8 0
# ls -l /tmp/vaporware
brw-r--r-- 1 root root 8, 0 May 18 08:33 /tmp/vaporware
# exit
$ ls -l /tmp/vaporware
-rw-r--r--. 1 user user 0 May 18 08:33 /tmp/vaporware





share|improve this answer















You can use fakeroot. As the name says, it fakes the root user, by intercepting serveral syscalls with a LD_LIBRARY_PATH/LD_PRELOAD library wrapper, to have the process believe it's running as root. This has been created for the purpose of building and packaging applications without having to be root, including using make install which typically would be run as root. It's especially well suited to create archives.



During this, a forked daemon faked will run in order to remember all faked file ownership rights or informations on special files the child processes believes they made. So all operations have to be done in the same "instance", or faked will exit and forget what it was remembering.



$ fakeroot
# tar xf ...
# find foo ... | cpio -o ...
# exit
$


Other example showing faked's interaction:



$ mknod /tmp/vaporware b 8 0
mknod: /tmp/vaporware: Operation not permitted
$ fakeroot
# mknod /tmp/vaporware b 8 0
# ls -l /tmp/vaporware
brw-r--r-- 1 root root 8, 0 May 18 08:33 /tmp/vaporware
# exit
$ ls -l /tmp/vaporware
-rw-r--r--. 1 user user 0 May 18 08:33 /tmp/vaporware






share|improve this answer















share|improve this answer



share|improve this answer








edited May 18 at 6:35


























answered May 18 at 6:22









A.B

2,4901315




2,4901315











  • Sorry for undoing the acception. fakeroot does not scale. When I do the same on a 50MB tar file, basically when I untar the file in a fakeroot environment, it becomes annoyingly slow, like 1min or so. Untaring the same tarball outside fakeroot finishes almost instantly. I cannot imagine what would happen if the size gets higher. Any better methods?
    – Thiner
    May 22 at 7:34











  • thanks for explaining. and sorry, that was the only rabbit I had in my hat for this... there are variants of fakeroot based on other interception methods. for example fakeroot-ng based on ptrace instead of LD_PRELOAD. You could give it a shot and see if it works faster
    – A.B
    May 22 at 12:49

















  • Sorry for undoing the acception. fakeroot does not scale. When I do the same on a 50MB tar file, basically when I untar the file in a fakeroot environment, it becomes annoyingly slow, like 1min or so. Untaring the same tarball outside fakeroot finishes almost instantly. I cannot imagine what would happen if the size gets higher. Any better methods?
    – Thiner
    May 22 at 7:34











  • thanks for explaining. and sorry, that was the only rabbit I had in my hat for this... there are variants of fakeroot based on other interception methods. for example fakeroot-ng based on ptrace instead of LD_PRELOAD. You could give it a shot and see if it works faster
    – A.B
    May 22 at 12:49
















Sorry for undoing the acception. fakeroot does not scale. When I do the same on a 50MB tar file, basically when I untar the file in a fakeroot environment, it becomes annoyingly slow, like 1min or so. Untaring the same tarball outside fakeroot finishes almost instantly. I cannot imagine what would happen if the size gets higher. Any better methods?
– Thiner
May 22 at 7:34





Sorry for undoing the acception. fakeroot does not scale. When I do the same on a 50MB tar file, basically when I untar the file in a fakeroot environment, it becomes annoyingly slow, like 1min or so. Untaring the same tarball outside fakeroot finishes almost instantly. I cannot imagine what would happen if the size gets higher. Any better methods?
– Thiner
May 22 at 7:34













thanks for explaining. and sorry, that was the only rabbit I had in my hat for this... there are variants of fakeroot based on other interception methods. for example fakeroot-ng based on ptrace instead of LD_PRELOAD. You could give it a shot and see if it works faster
– A.B
May 22 at 12:49





thanks for explaining. and sorry, that was the only rabbit I had in my hat for this... there are variants of fakeroot based on other interception methods. for example fakeroot-ng based on ptrace instead of LD_PRELOAD. You could give it a shot and see if it works faster
– A.B
May 22 at 12:49













 

draft saved


draft discarded


























 


draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f444523%2ftransform-tar-into-cpio-without-rooting%23new-answer', 'question_page');

);

Post as a guest













































































Popular posts from this blog

How to check contact read email or not when send email to Individual?

Bahrain

Postfix configuration issue with fips on centos 7; mailgun relay