remove lines from file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting remove lines from file
# 1  
Old 03-11-2009
remove lines from file

Hi gurus,

i'm trying to remove a number of lines from a large file using the following command:

sed '1,5000d' oldfile > newfile

Somehow the lines in the old file are not deleted...

Am I doing this wrongly? Any suggestions? Smilie

Thanks! Smilie

wee
# 2  
Old 03-11-2009
What do you expect ?
If you want to delete in original file read man sed for -i option.
# 3  
Old 03-11-2009
Quote:
Originally Posted by danmero
What do you expect ?
If you want to delete in original file read man sed for -i option.
like this:
Code:
sed -i '1,5000 d' oldfile

from the GNU sed manual:
Code:
       -i[SUFFIX], --in-place[=SUFFIX]

              edit files in place (makes backup if extension supplied)

# 4  
Old 03-11-2009
hey gurus...

perhaps i did not make myself clear...

well i have this really huge file which i cannot open up using vi (due to the constraint in which /tmp buffer could not hold)

so i need to extract out the oldest information within the file (say maybe the first 10000 lines) and pipe out to another file while at the same time the 10000 lines will be removed from the old file.

which is why i'm using sed to do it but somehow it's not matching my ideal results...

please advise. thanks.

wee
# 5  
Old 03-12-2009
first check wthether you have latest version of sed which comes with -i option
you can check this in man page if you have that you can do
Code:
sed -i '1,10000d' huge_file > temp_file

if you don't have the -i option
Code:
sed -n '1,10000p' huge_file > file1
sed -n '10001,$p' huge_file > temp_file
cat temp_file >huge_file

# 6  
Old 03-12-2009
sorry i dont have the -i option for sed...probably this is the older version.

will try out the other option.

update later. thanks. Smilie

wee
# 7  
Old 03-12-2009
hi what does $p stands for? variable?

somehow it does not seem to do what i'm expected it to do...

supposed i have this file with 200000 lines in it, so what i'm trying to do is to remove the first 100000 lines and pipe it to another file so that i can use vi to open the original file.

hmm...sounds complicated? Smilie

thanks gurus. Smilie

wee
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk remove/grab lines from file with pattern from other file

Sorry for the weird title but i have the following problem. We have several files which have between 10000 and about 500000 lines in them. From these files we want to remove lines which contain a pattern which is located in another file (around 20000 lines, all EAN codes). We also want to get... (28 Replies)
Discussion started by: SDohmen
28 Replies

2. Shell Programming and Scripting

Remove lines that are subsets of other lines in File

Hello everyone, Although it seems easy, I've been stuck with this problem for a moment now and I can't figure out a way to get it done. My problem is the following: I have a file where each line is a sequence of IP addresses, example : 10.0.0.1 10.0.0.2 10.0.0.5 10.0.0.1 10.0.0.2... (5 Replies)
Discussion started by: MisterJellyBean
5 Replies

3. Shell Programming and Scripting

Remove lines in file

I have a file that contains the following: Party_Id1;Party_id2;Party_id3; 1;2;3; 0 0 4;5;6; 0 7;8;9; How can I adjust the file so it looks like this: Party_Id1;Party_id2;Party_id3; 1;2;3; 4;5;6; 7;8;9; I Think the '0' is something like a carriage return, I don't know. But how... (2 Replies)
Discussion started by: katled
2 Replies

4. UNIX for Dummies Questions & Answers

Want to remove all lines but not latest 50 lines from a file

Hi, I have a huge file which has Lacs of lines. File system got full. I want your guys help to suggest me a solution so that I can remove all lines from that file but not last 50,000 lines. I want solution which can remove lines from existing file so that I can have some space left with. (28 Replies)
Discussion started by: prashant2507198
28 Replies

5. Shell Programming and Scripting

Remove last 4 lines of a file

Hi, I have a file from which I need to remove the last n lines. I was successful in removing only the last line using : sed '$d' file_name Could you please help me with the command. Thanks, H2 Please use code tags when posting data and code samples! (8 Replies)
Discussion started by: H squared
8 Replies

6. Shell Programming and Scripting

Remove lines from file

Hey Gang- I have a list of servers. I want to exclude servers that begin with and end with certain characters. Is there an easy command to do this? Example wvm1234dev wvm1234pro uvm1122dev uvm1122bku uvm1344dev I want to exclude any lines that start with "wvm" OR "uvm" AND end... (7 Replies)
Discussion started by: idiotboy
7 Replies

7. Shell Programming and Scripting

remove : lines from file

A small question I have a test.txt file I have contents as: a:google b:yahoo : c:facebook : d:hotmail How do I remove the line with : my output should be a:google b:yahoo c:facebook d:hotmail (5 Replies)
Discussion started by: aronmelon
5 Replies

8. UNIX for Dummies Questions & Answers

vi to remove lines in file

All, I have a text file with several entries like below: personname personname.domain.com I know there is a way to use vi to remove only the personname.domain.com line. Can someone help? I believe that it involves /s/g/ something...I just can't remember the exact syntax. Thanks (2 Replies)
Discussion started by: kjbaumann
2 Replies

9. Shell Programming and Scripting

To remove the lines in my file

Hi, There seems to some hack attempts in my site. I have attached the index page of my site and I need to remove the below lines from the index page. The below lines are at the center of the file. --> </style> <script>E V A L( unescape(... (5 Replies)
Discussion started by: gsiva
5 Replies

10. Shell Programming and Scripting

remove lines from file

file: 1 xxxxxxx 2 xxx xxx 5 xxx xxx ... 180 xxxxxx 200 xxx how to remove any lines with the first number range 1-180 (9 Replies)
Discussion started by: bluemoon1
9 Replies
Login or Register to Ask a Question