Sponsored Content
Full Discussion: Split A Large File
Top Forums Shell Programming and Scripting Split A Large File Post 89525 by sergilda on Monday 14th of November 2005 07:04:11 AM
Old 11-14-2005
Hi,

you can make the first file by using:

head -60000 filename > filename_1to60000

you can make the second one as follow:

echo 'first name, family name, address' > filename_60001to100000
tail +60001 filename >> filename_60001to100000

Kind regards
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split a large file with patterns and size

Hi, I have a large file with a repeating pattern in it. Now i want the file split into the block of patterns with a specified no. of lines in each file. i.e. The file is like 1... 2... 2... 3... 1... 2... 3... 1... 2... 2... 2... 2... 2... 3... where 1 is the start of the block... (5 Replies)
Discussion started by: sudhamacs
5 Replies

2. Shell Programming and Scripting

Split Large File

HI, i've to split a large file which inputs seems like : Input file name_file.txt 00001|AAAA|MAIL|DATEOFBIRTHT|....... 00001|AAAA|MAIL|DATEOFBIRTHT|....... 00002|BBBB|MAIL|DATEOFBIRTHT|....... 00002|BBBB|MAIL|DATEOFBIRTHT|....... 00003|CCCC|MAIL|DATEOFBIRTHT|.......... (1 Reply)
Discussion started by: AMARA
1 Replies

3. Shell Programming and Scripting

split large file based on field criteria

I have a file containing date/time sorted data of the form ... 2009/06/10,20:59:59.950,XAG/USD,Q,1,1115, 14.3025,100,1,1 2009/06/10,20:59:59.950,XAG/USD,Q,1,1116, 14.3026,125,1,1 2009/06/10,20:59:59.950,XAG/USD,R,0,0, , 0,0,0 2009/06/10,20:59:59.950,XAG/USD,R,1,0, 14.1910,100,1,1... (6 Replies)
Discussion started by: asriva
6 Replies

4. Shell Programming and Scripting

Splitting a large file, split command will not do.

Hello Everyone, I have a large file that needs to be split into many seperate files, however the text in between the blank lines need to be intact. The file looks like SomeText SomeText SomeText SomeOtherText SomeOtherText .... Since the number of lines of text are different for... (3 Replies)
Discussion started by: jwillis0720
3 Replies

5. Shell Programming and Scripting

Split large file based on last digit from a column

Hello, What's the best way to split a large into multiple files based on the last digit in the first column. input file: f 2738483300000x0y03772748378831x1y13478378358383x2y23743878383802x3y33787828282820x4y43748838383881x5y5 Desired Output: f0 3738483300000x0y03787828282820x4y4 f1... (9 Replies)
Discussion started by: alain.kazan
9 Replies

6. Shell Programming and Scripting

Split a large file

I have a 3 GB text file that I would like to split. How can I do this? It's a giant comma-separated list of numbers. I would like to make it into about 20 files of ~100 MB each, with a custom header and footer. The file can only be split on commas, but they're plentiful. Something like... (3 Replies)
Discussion started by: CRGreathouse
3 Replies

7. UNIX for Dummies Questions & Answers

Split large file to smaller fastly

hi , I have a requirement input file: 1 1111111111111 108 1 1111111111111 109 1 1111111111111 109 1 1111111111111 110 1 1111111111111 111 1 1111111111111 111 1 1111111111111 111 1 1111111111111 112 1 1111111111111 112 1 1111111111111 112 The output should be, (19 Replies)
Discussion started by: mechvijays
19 Replies

8. UNIX for Beginners Questions & Answers

sed awk: split a large file to unique file names

Dear Users, Appreciate your help if you could help me with splitting a large file > 1 million lines with sed or awk. below is the text in the file input file.txt scaffold1 928 929 C/T + scaffold1 942 943 G/C + scaffold1 959 960 C/T +... (6 Replies)
Discussion started by: kapr0001
6 Replies

9. UNIX for Advanced & Expert Users

How to split large file with different record delimiter?

Hi, I have received a file which is 20 GB. We would like to split the file into 4 equal parts and process it to avoid memory issues. If the record delimiter is unix new line, I could use split command either with option l or b. The problem is that the line terminator is |##| How to use... (5 Replies)
Discussion started by: Ravi.K
5 Replies

10. UNIX for Beginners Questions & Answers

Trying To Split a Large File

Trying to split a 35gb file into 1000mb parts. My research shows I should you this. split -b 1000m file.txt and my return is "split: cannot open 'crunch1.txt' for reading: No such file or directory" so I tried split -b 1000m Documents/Wordlists/file.txt and I get nothing other than the curser just... (3 Replies)
Discussion started by: sub terra
3 Replies
caspar-typesetting(7)						  MISCELLANEOUS 					     caspar-typesetting(7)

  NAME
      caspar-typesetting - Makefile snippets for common typesetting tasks

  SYNOPSIS
      In a Makefile, write

	include caspar/mk/docbook.mk

      or

	include caspar/mk/pod.mk

      .

  DESCRIPTION
      The  caspar  docbook.mk  and pod.mk files are Makefile snippets for common typesetting tasks, like typesetting LaTeX (see [3]), DocBook XML,
      DocBook SGML (see [2]) and POD (see [1]) documents.  You just have to type make, instead of stuff  like  jade  -t  tex  -d  caspar/print.dsl
      /usr/share/sgml/declaration/xml.dcl foobar.dbx.

  USAGE
      In a directory where you maintain .dbx (Docbook XML) or .tex (LaTeX) files, do

	 $ echo include caspar/mk/docbook.mk > Makefile

	 $ vi karenina.dbx
	 $ make karenina.view
	 $ make karenina.print

	 $ vi svejk.tex
	 $ make svejk.view
	 $ make svejk.print

	 $ make
	 $ make clean

      Other targets: filename.ps, filename.pdf, filename.2ps, filename.html, filename.printbig, filename.dvi.

      Variables  you  might  like  to  set  in	your  Makefile:  XMLDCL (default is /usr/share/sgml/declaration/xml.dcl; if you're not on a Debian
      GNU/Linux system, you'll likely have to adjust this), HTML_DSL, PRINT_DSL.

      In a directory where you maintain .pod files, do

	 $ echo include caspar/mk/pod.mk > Makefile
	 $ vi lire.pod
	 $ perldoc ./lire.pod
	 $ make lire.pdf
	 $ make
	 $ less lire.overstrike-txt
	 $ make clean

      Other targets: filename.ps, filename.html, filename.txt, ...  (Similar to the ones supplied by docbook.mk).

  EXAMPLES
      Some examples: Overriding the caspar-supplied DSSSL files: Create your own print.dls and html.dsl, in the same directory as your Docbook XML
      files. Your Makefile should read:

       PRINT_DSL = print.dsl
       HTML_DSL = html.dsl
       include caspar/mk/docbook.mk

      Overriding the standard html-to-text convertor:

       $ W3M=lynx make svejk.txt

      .

  FILES
      caspar/mk/docbook.mk, caspar/mk/pod.mk

  ENVIRONMENT
      For  docbook.mk: files: XMLDCL, HTML_DSL, PRINT_DSL; utilities: JADE, PDFJADETEX, PDFLATEX, JADETEX, LATEX, W3M, DVIPS, PSNUP, LPR, GV; set-
      tings: JADE_MAXERRORS. These variables can get adjusted in Makefile, as well as in the shell environment.

      pod.mk Uses no environment variables.

  AUTHOR
      Joost van Baal-Ili

  SEE ALSO
      caspar(7) [1] perlpod(1) about Perl's Plain Old Documentation format

      [2] DocBook: The Definitive Guide on http://docbook.org/,

      [3] The LaTeX Project Homepage on http://www.latex-project.org/.

      Some comments on advanced usage are in the files docbook.mk and pod.mk itself.

  caspar-typesetting 20120508					      8 mai 2012					       caspar-typesetting(7)
All times are GMT -4. The time now is 10:12 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy