Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Trying To Split a Large File
Top Forums UNIX for Beginners Questions & Answers Trying To Split a Large File Post 303030787 by rbatte1 on Friday 15th of February 2019 12:55:44 PM
Old 02-15-2019
The split command will give no screen output if it works. It will have created files in the current directory, probably names xaa, xab, xac etc. so you probably end at xbj or somewhere like that. You can force it to create files matching a specific pattern (and directory) if you choose and you might be allowed to use the --verbose flag to see it creating files.

From the commands you have shown us, I don't see where crunch1.txt comes in to it. Can you capture everything on the screen in one go from this:-

Code:
set -x                                                      # Turn on debug
ls -l ~/Documents/Wordlists/file.txt                        # Show us what the input file is (... and assuming it is below your home directory)
file ~/Documents/Wordlists/file.txt                         # Show us if it is complex or plain text
head ~/Documents/Wordlists/file.txt                         # Show us if it is complex or plain text
cd $(mktmp -d)                                              # Creates & changes to a new directory in /tmp so we know it's empty.
split --verbose -b 1000m  ~/Documents/Wordlists/file.txt    # Attempt the work
pwd ; ls -l                                                 # Show us the output
set +x                                                      # Turn on debug

If you can paste this back wrapped in CODE tags then we can see where we are.



Thanks, in advance,
Robin
These 3 Users Gave Thanks to rbatte1 For This Post:
Neo RavinderSingh13 RudiC
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split A Large File

Hi, I have a large file(csv format) that I need to split into 2 files. The file looks something like Original_file.txt first name, family name, address a, b, c, d, e, f, and so on for over 100,00 lines I need to create two files from this one file. The condition is i need to ensure... (4 Replies)
Discussion started by: nbvcxzdz
4 Replies

2. Shell Programming and Scripting

Split a large file with patterns and size

Hi, I have a large file with a repeating pattern in it. Now i want the file split into the block of patterns with a specified no. of lines in each file. i.e. The file is like 1... 2... 2... 3... 1... 2... 3... 1... 2... 2... 2... 2... 2... 3... where 1 is the start of the block... (5 Replies)
Discussion started by: sudhamacs
5 Replies

3. Shell Programming and Scripting

Split Large File

HI, i've to split a large file which inputs seems like : Input file name_file.txt 00001|AAAA|MAIL|DATEOFBIRTHT|....... 00001|AAAA|MAIL|DATEOFBIRTHT|....... 00002|BBBB|MAIL|DATEOFBIRTHT|....... 00002|BBBB|MAIL|DATEOFBIRTHT|....... 00003|CCCC|MAIL|DATEOFBIRTHT|.......... (1 Reply)
Discussion started by: AMARA
1 Replies

4. Shell Programming and Scripting

split large file based on field criteria

I have a file containing date/time sorted data of the form ... 2009/06/10,20:59:59.950,XAG/USD,Q,1,1115, 14.3025,100,1,1 2009/06/10,20:59:59.950,XAG/USD,Q,1,1116, 14.3026,125,1,1 2009/06/10,20:59:59.950,XAG/USD,R,0,0, , 0,0,0 2009/06/10,20:59:59.950,XAG/USD,R,1,0, 14.1910,100,1,1... (6 Replies)
Discussion started by: asriva
6 Replies

5. Shell Programming and Scripting

Splitting a large file, split command will not do.

Hello Everyone, I have a large file that needs to be split into many seperate files, however the text in between the blank lines need to be intact. The file looks like SomeText SomeText SomeText SomeOtherText SomeOtherText .... Since the number of lines of text are different for... (3 Replies)
Discussion started by: jwillis0720
3 Replies

6. Shell Programming and Scripting

Split large file based on last digit from a column

Hello, What's the best way to split a large into multiple files based on the last digit in the first column. input file: f 2738483300000x0y03772748378831x1y13478378358383x2y23743878383802x3y33787828282820x4y43748838383881x5y5 Desired Output: f0 3738483300000x0y03787828282820x4y4 f1... (9 Replies)
Discussion started by: alain.kazan
9 Replies

7. Shell Programming and Scripting

Split a large file

I have a 3 GB text file that I would like to split. How can I do this? It's a giant comma-separated list of numbers. I would like to make it into about 20 files of ~100 MB each, with a custom header and footer. The file can only be split on commas, but they're plentiful. Something like... (3 Replies)
Discussion started by: CRGreathouse
3 Replies

8. UNIX for Dummies Questions & Answers

Split large file to smaller fastly

hi , I have a requirement input file: 1 1111111111111 108 1 1111111111111 109 1 1111111111111 109 1 1111111111111 110 1 1111111111111 111 1 1111111111111 111 1 1111111111111 111 1 1111111111111 112 1 1111111111111 112 1 1111111111111 112 The output should be, (19 Replies)
Discussion started by: mechvijays
19 Replies

9. UNIX for Beginners Questions & Answers

sed awk: split a large file to unique file names

Dear Users, Appreciate your help if you could help me with splitting a large file > 1 million lines with sed or awk. below is the text in the file input file.txt scaffold1 928 929 C/T + scaffold1 942 943 G/C + scaffold1 959 960 C/T +... (6 Replies)
Discussion started by: kapr0001
6 Replies

10. UNIX for Advanced & Expert Users

How to split large file with different record delimiter?

Hi, I have received a file which is 20 GB. We would like to split the file into 4 equal parts and process it to avoid memory issues. If the record delimiter is unix new line, I could use split command either with option l or b. The problem is that the line terminator is |##| How to use... (5 Replies)
Discussion started by: Ravi.K
5 Replies

LEARN ABOUT MOJAVE

zipcloak

zipcloak(1)						      General Commands Manual						       zipcloak(1)

NAME

       zipcloak - encrypt entries in a zipfile

SYNOPSIS

       zipcloak [-d] [-b path] [-h] [-v] [-L] zipfile

ARGUMENTS

       zipfile	Zipfile to encrypt entries in

OPTIONS

       -b path
       --temp-path path
	      Use the directory given by path for the temporary zip file.

       -d
       --decrypt
	      Decrypt encrypted entries (copy if given wrong password).

       -h
       --help
	      Show a short help.

       -L
       --license
	      Show software license.

       -O path
       --output-file zipfile
	      Write output to new archive zipfile, leaving original archive as is.

       -q
       --quiet
	      Quiet operation.	Suppresses some informational messages.

       -v
       --version
	      Show version information.

DESCRIPTION

       zipcloak encrypts all unencrypted entries in the zipfile.  This is the default action.

       The -d option is used to decrypt encrypted entries in the zipfile.

       zipcloak uses original zip encryption which is considered weak.

       Note:  The encryption code of this program is not copyrighted and is put in the public domain.  It was originally written in Europe and can
	      be freely distributed from any country including the U.S.A.  (Previously if this program was imported into the U.S.A, it	could  not
	      be  re-exported  from  the  U.S.A to another country.)  See the file README.CR included in the source distribution for more on this.
	      Otherwise, the Info-ZIP license applies.

EXAMPLES

       To be added.

BUGS

       Large files (> 2 GB) and large archives not yet supported.

       Split archives not yet supported.  A work around is to convert the split archive to a single-file archive using zip and then  use  zipcloak
       on the single-file archive.  If needed, the resulting archive can then be split again using zip.

SEE ALSO

       zip(1), unzip(1)

AUTHOR

       Info-ZIP

								v3.0 of 8 May 2008						       zipcloak(1)
All times are GMT -4. The time now is 03:08 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy