Trying To Split a Large File Post: 303030788

Sponsored Content

Top Forums UNIX for Beginners Questions & Answers Trying To Split a Large File Post 303030788 by sub terra on Friday 15th of February 2019 01:43:45 PM

02-15-2019

Registered User

After you said I may not see it doing anything I went looking back through. In my home dir I have file xaa thru xad and those were not there when I looked before and have not done anything since. But yes those are in the home dir. But they are off in size. Two files are 1gb but 2 are less than half a gig. My file I was splitting is 35gb and some change.

--- Post updated at 06:43 PM ---

I also ran yours

Code:

split --verbose -b 1000m  ~/Documents/Wordlists/crunch1.txt

and it is creating the files. I have a theory. When I didn't see anything returning then after a couple of minutes I closed the console and went back looking online to see what I had missed. When I closed the console I am assuming I stopped the action. That is why I only had those files I mentioned before. With it creating the files now and I can see what it is doing I can see that it takes some time. I need to stay with verbose with everything so I can get a better understanding of what it is doing for no forward.
Coming out of a mostly Windows environment and into Kali is just going to take some getting used to.

I am going to have to give this vm more hard drive.

More than anything I want to thank you! I mean thank you biggly as Trump would say.

Below is the results

Code:

root@kali:~# split --verbose -b 1000m  ~/Documents/Wordlists/crunch1.txt
creating file 'xaa'
creating file 'xab'
creating file 'xac'
creating file 'xad'
creating file 'xae'
creating file 'xaf'
creating file 'xag'
creating file 'xah'
creating file 'xai'
creating file 'xaj'
creating file 'xak'
creating file 'xal'
creating file 'xam'
creating file 'xan'
creating file 'xao'
creating file 'xap'
creating file 'xaq'
creating file 'xar'
creating file 'xas'
creating file 'xat'
creating file 'xau'
creating file 'xav'
creating file 'xaw'
split: xaw: No space left on device

sub terra

View Public Profile for sub terra

Find all posts by sub terra

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split A Large File

Hi, I have a large file(csv format) that I need to split into 2 files. The file looks something like Original_file.txt first name, family name, address a, b, c, d, e, f, and so on for over 100,00 lines I need to create two files from this one file. The condition is i need to ensure...

2. Shell Programming and Scripting

Split a large file with patterns and size

Hi, I have a large file with a repeating pattern in it. Now i want the file split into the block of patterns with a specified no. of lines in each file. i.e. The file is like 1... 2... 2... 3... 1... 2... 3... 1... 2... 2... 2... 2... 2... 3... where 1 is the start of the block...

3. Shell Programming and Scripting

Split Large File

4. Shell Programming and Scripting

split large file based on field criteria

I have a file containing date/time sorted data of the form ... 2009/06/10,20:59:59.950,XAG/USD,Q,1,1115, 14.3025,100,1,1 2009/06/10,20:59:59.950,XAG/USD,Q,1,1116, 14.3026,125,1,1 2009/06/10,20:59:59.950,XAG/USD,R,0,0, , 0,0,0 2009/06/10,20:59:59.950,XAG/USD,R,1,0, 14.1910,100,1,1...

5. Shell Programming and Scripting

Splitting a large file, split command will not do.

Hello Everyone, I have a large file that needs to be split into many seperate files, however the text in between the blank lines need to be intact. The file looks like SomeText SomeText SomeText SomeOtherText SomeOtherText .... Since the number of lines of text are different for...

6. Shell Programming and Scripting

Split large file based on last digit from a column

Hello, What's the best way to split a large into multiple files based on the last digit in the first column. input file: f 2738483300000x0y03772748378831x1y13478378358383x2y23743878383802x3y33787828282820x4y43748838383881x5y5 Desired Output: f0 3738483300000x0y03787828282820x4y4 f1...

7. Shell Programming and Scripting

Split a large file

I have a 3 GB text file that I would like to split. How can I do this? It's a giant comma-separated list of numbers. I would like to make it into about 20 files of ~100 MB each, with a custom header and footer. The file can only be split on commas, but they're plentiful. Something like...

8. UNIX for Dummies Questions & Answers

Split large file to smaller fastly

hi , I have a requirement input file: 1 1111111111111 108 1 1111111111111 109 1 1111111111111 109 1 1111111111111 110 1 1111111111111 111 1 1111111111111 111 1 1111111111111 111 1 1111111111111 112 1 1111111111111 112 1 1111111111111 112 The output should be,

9. UNIX for Beginners Questions & Answers

sed awk: split a large file to unique file names

Dear Users, Appreciate your help if you could help me with splitting a large file > 1 million lines with sed or awk. below is the text in the file input file.txt scaffold1 928 929 C/T + scaffold1 942 943 G/C + scaffold1 959 960 C/T +...

10. UNIX for Advanced & Expert Users

How to split large file with different record delimiter?

Hi, I have received a file which is 20 GB. We would like to split the file into 4 equal parts and process it to avoid memory issues. If the record delimiter is unix new line, I could use split command either with option l or b. The problem is that the line terminator is |##| How to use...

LEARN ABOUT FREEBSD

ftpconfig

ftpconfig(1M)						  System Administration Commands					     ftpconfig(1M)

NAME

       ftpconfig - set up anonymous FTP

SYNOPSIS

       ftpconfig [ftpdir]

       ftpconfig -d ftpdir

DESCRIPTION

       The ftpconfig script is executed by the super user to set up anonymous FTP. Anonymous FTP allows users to remotely log on to the FTP server
       by specifying the user name  ftp or anonymous and the user's email  address as password. The anonymous users  are  logged  on  to  the  FTP
       Server  and  given  access to a restricted file area with its own file system root. See chroot(2). The FTP area has  its own minimal system
       files.

       This command will copy and set up all the components needed to operate an anonymous FTP server, including creating the  ftp  user  account,
       creating  device  nodes,  copying  /usr/lib files, and copying timezone data.  The passwd and group files set up have been stripped down to
       prevent malicious users from finding login names on the server.	The anonymous file area will be placed	under  ftpdir.	If  the  ftp  user
       account already exists, then the current FTP area is used, and the system files in it are updated. All other files are left untouched. This
       command should be run to update the anonymous FTP area's configuration whenever a system patch is installed, or the system is upgraded.

OPTIONS

       -d	Create a new or update an existing ftpdir without creating or updating the ftp user account. Use this option when  creating  guest
		FTP user accounts.

OPERANDS

       The following operands are supported:

       ftpdir	The absolute pathname of the directory under which the anonymous FTP area is set up.

EXIT STATUS

       The following exit values are returned:

       0	Successful completion

       1	Improper usage of the command

       2	Command failed

ATTRIBUTES

       See attributes(5)  for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWftpu			   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Evolving			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       ftpaddhost(1M), in.ftpd(1M), useradd(1M), chroot(2), attributes(5)

SunOS 5.10							    1 May 2003							     ftpconfig(1M)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split A Large File

Discussion started by: nbvcxzdz

2. Shell Programming and Scripting

Split a large file with patterns and size

Discussion started by: sudhamacs

3. Shell Programming and Scripting

Split Large File

Discussion started by: AMARA

4. Shell Programming and Scripting

split large file based on field criteria

Discussion started by: asriva