Login or Register to Ask a Question and Join Our Community


UNIX for Advanced & Expert Users

splitting the files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users splitting the files
# 1  
Old 02-12-2008
splitting the files
Hi,
How can i split the big file by the lines?. For eg. I wanna split the file from the line 140 to 1700.
# 2  
Old 02-12-2008
Quote:
Originally Posted by sharif
Hi,
How can i split the big file by the lines?. For eg. I wanna split the file from the line 140 to 1700.
You only want those lines from 140 to 1700, is it ?

Code:
sed -n -e "140,1700p" bigfile.txt > newfile.txt

# 3  
Old 02-12-2008
one more,

Code:
awk ' NR >= 140 && NR <= 1700 ' source > dest

# 4  
Old 02-12-2008
ok, lets see how many ways we can find. Here is one in pure (Korn-)shell:

Code:
#! /bin/ksh

typeset -i iStartLine=140
typeset -i iEndLine=1700
typeset -i iLineCnt=0
typeset    fSrcFile="/path/to/bigfile"
typeset    fTgtFile="/path/to/file.snippet"
typeset    chLineBuffer=""

exec 3>$fTgtFile
cat $fSrcFile | while read chLineBuffer ; do
     (( iLineCnt += 1 ))
     if [ \( $iLineCnt -ge $iStartLine \) -a \( $iLineCnt -le $iEndLine \) ] ; then
          print -u3 "$chLineBuffer"
     fi
done
exec 3>&-

exit 0

bakunin
# 5  
Old 02-12-2008
or the short and simple:

Code:
head -1700 file | tail +140

Smilie
# 6  
Old 02-12-2008
Passing variable
Quote:
Originally Posted by matrixmadhan
one more,

Code:
awk ' NR >= 140 && NR <= 1700 ' source > dest

Hi Madhan,
It's working fine. Thank u very much. Can I pass the variable instead of the actual number?.
(NR >= startline NR <= endline).
# 7  
Old 02-12-2008
awk ' NR >=beg && NR <= end ' beg=2 end=5 data.txt


hope this helps.....
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Automate splitting of files , scp files as each split completes and combine files on target server

i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies

2. UNIX for Dummies Questions & Answers

Splitting log files

I am trying to split my IRSSI logs into weekly and monthly .log files. My log format looks like this: --- Day changed Fri Mar 04 2016 00:11 <Jack> Test --- Day changed Sat Mar 05 2016 00:11 <Jack> Test --- Day changed Sun Mar 06 2016 15:20 <Jack> Test The script I have been playing... (2 Replies)
Discussion started by: Stacked
2 Replies

3. Shell Programming and Scripting

Splitting files into 100 files with field value

I want a script to split my file upon the last field (15) As file A,b,c,.......,01 C,v,n,.......,02 C,r,v,........,01 F,s,a,........,03 X,y,d,........,99 To make output 01.txt A,b,c,.......,01 C,r,v,........,01 02.txt C,v,n,.......,02 (12 Replies)
Discussion started by: teefa
12 Replies

4. Shell Programming and Scripting

Splitting files

Hello all I have a file which has around 80 million records, I want to split it to 12 equal files, I tried using the split command but it is allowing me to split according to number of lines or by size. Is there a way i can split the file into 12 files without worrying about the number of lines... (7 Replies)
Discussion started by: Sri3001
7 Replies

5. UNIX for Dummies Questions & Answers

Splitting Files Help

Hi Gurus, Lets say i have a file with some 30 records... How can i split that file into 3 files Also it shud be dynamic in the sense.. I wouldnt mind if file 1 has 15, file 2 has 10 and file 3 has 5.... Please help.. Thanks (6 Replies)
Discussion started by: saggiboy10
6 Replies

6. Shell Programming and Scripting

Splitting files from one file

Hi, I have an input file like: 111 abcdefgh asdfghjk dfghjkl 222 aaaaaaa bbbbbb 333 djfhfgjktitjhgfkg 444 djdhfjkhfjkghjkfg hsbfjksdbhjkgherjklg fjkhfjklsahjgh fkrjkgnj I want to read this input file and make separate output files with the header as numric value like "111"... (9 Replies)
Discussion started by: saltysumi
9 Replies

7. UNIX for Dummies Questions & Answers

splitting the files

Hi, I have some files with 2 million odd records which i need to split into chunks of 0.5 millions. I have the file sorted with a key column in order. The same key value can appear as 4 or 5 records in the file. Hence after splitting we are checking whether all the key values are present in the... (5 Replies)
Discussion started by: dnat
5 Replies

8. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50... (3 Replies)
Discussion started by: arund_01
3 Replies

9. Shell Programming and Scripting

Splitting large files

Hi Unix gurus, We have a masterfile which is to be split into smallerfiles with names as masterfile00,masterfile01,masterfile03...etal I was able to split the file using the "Split" cmd but as masterfileaa,masterfileab.. Is it posiible to change the default suffix? or is there any other... (2 Replies)
Discussion started by: Rvbs
2 Replies

10. Shell Programming and Scripting

splitting the files

Hi, I'am using HP-UX.I have a input file which has 102 drop statements in it.I'am using csplit to split the files.The upper limit is 99 only.I'am using the -n 102 option.It says "suffix size not vaild".Any suggestions how to do it using csplit? Thanx in advance, sounder. (1 Reply)
Discussion started by: sounder123
1 Replies
Login or Register to Ask a Question