) You should specify a tape archive file such as 'a.tar', rather than a RAR-format file. r: Recursively compress all files and directories contained within DIRECTORY/ in the zip file (otherwise you only get the top level files). Is there a way to run the command so I can split the files into 3gb chunks while in flight to google drive? I cant figure out where to put the "| split -bytes=3GB -" in the command to make the upload to google drive split the file into 3gb increments. 1 This isnt correct: untar (tarfile 'a.rar'. The -r (recipient) option must be followed by the email address of the person you’re sending the file to. The -armor option tells gpg to create an ASCII file. My problem is the tar.gz file created running this command can become so huge that if I download it back to another machine and try to untar it, it just crashes the computer. The -encrypt option tells gpg to encrypt the file, and the -sign option tells it to sign the file with your details. "tar cvfz - userdata/ | rclone rcat google-team-share: -v" This works perfectly so I know the logic works. tar -tvf archive.tar List all files in archive.tar verbosely. Examples tar -cf archive.tar foo bar Create archive.tar from files foo and bar. tarfile. Description GNU tar saves many files together into a single tape or disk archive, and can restore individual files from the archive. Changed in version 3.3: Added support for lzma compression. I am trying to run the 2 above commands as 1 command so I can tar gz files while dumping the data directly to google with the rclone rcat command. handles directories, regular files, hardlinks, symbolic links, fifos, character devices and block devices and is able to acquire and restore file information like timestamp, access permissions and owner. Then after I get X number of tar.gz files of 3GB I run this command to upload everything. Rprofile (or executing it manually): Sys.setenv (TAR '/usr/bin/tar') Alternatively, you can provide the tar path as an argument when calling untar. You can fix this by adding the following to your. "tar cvfz - USERDATA/ | split -bytes=3GB - ." R on OS X 10.9 (Mavericks) seems to set a wrong TAR environment variable. I use tar gz to split these multi-terabyte datasets into 3gb chunks. #Error: Error in untar2(tarfile, files, list, exdir) :Īppreciate feedback - I've been lurking around StackOverflow for some time to use other people's solutions.I have huge data sets on my server and to upload them to Google Team Shares/Google Drive. Untar(path.expand(ArchFile),list=TRUE,exdir=subDir,compressed="gzip") #Check for file directories and create if directory if it doesn't exist #enter full url including file name between ' ' marks #Set directory locations, data file and fetch data file from internet 1 When I call the R function untar ('', files vectoroffilenames) the inner files get extracted perfectly fine, but the following output appears on the console for all of them: /bin/tar: folder/subfolder/somefile.R: Not found in archive Again, the files do get extracted just fine, I can inspect them, the operation is a success. #If there is a load package error, use install.packages("") I did install 7-zip on my computer, restart and of course restart R: `#DOWNLOADING AND UNZIPPING TAR FILE Script notes one solution found (issues, lines 28-31), but I don't really understand it. Running Windows 10, 64 bit, R set to: C:\Program Files\R\R-3.2.2 Would that be the problem? Full error: Error in untar2(tarfile, files, list, exdir) : unsupported entry type ‘’ I manually unpacked and it was tar.gz, unpacked to. I would be fine with unzip, however this particular file I want to analyze is. I'm running a script with input parameters that are referenced in the code to automate the directory creation, download of file and untar of file.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |