Delete vertical lines in an text file


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Delete vertical lines in an text file
# 1  
Old 03-02-2010
Delete vertical lines in an text file

Hi everybody!

I need to delete several vertical lines in a huge text file.
It should work like the example below. Delete the vertical lines 2 and 8.

Code:
123456789
masldfjla
afsajfwel
sajfljsaf
safsarfrl
sajfeljwq

1345679
msldfja
asajfwl
sjfljsf
sfsarfl
sjfeljq

Is there a program for this task?

Thank you!

Last edited by Franklin52; 03-02-2010 at 08:04 AM.. Reason: Please use code tags!
# 2  
Old 03-02-2010
You can use the following command to satisfy your requirement.

Code:
sed -ri 's/(.{1}).{1}(.{5}).{1}(.*)/\1\2\3/g' <inputfilename>

# 3  
Old 03-02-2010
Sorry maybe i should explain it better...
The text file looks like this:

Code:
masldfjla
afsajfwel
sajfljsaf
safsarfrl
sajfeljwq

There are no numbers in the real file.
The next problem is that i have to delete 70.000 vertical lines from a text file with up to 150.000 vertical lines.
The best would be something to put in the numbers of the vertical lines to delete.

Last edited by Franklin52; 03-02-2010 at 08:04 AM.. Reason: Please use code tags!
# 4  
Old 03-02-2010
Can you provide a better example of the input file and the desired output.

Please use code tags.
# 5  
Old 03-02-2010
I guess this should do what you want and you can modify it on your actual data by changing the numbers in the For Loop and If condition...

Code:
awk '{for( i=1; i<=9; i++){
if( i != 2 && i !=8){s=substr($0,i,1);printf s}}
printf "\n"}' infile

# 6  
Old 03-02-2010
The complete file has 150.000 vertical lines and 200 horizontal lines.
Input:
Code:
FSLMFFLVMMNLIGLV-PFVY
ICVLMLVMTLNLSGMV-PGVF
ALLFNSVVFANCFGMI-PYVF
AALFASLLVLNLLGLV-PYVF
SSLFMMIIIFNLLGLI-PYMF
STLFFYLLSINLLGFF-IFTL
TFISVLLLSVNLVGML-PFIK
ISLFIFIVFLNVLGLF-PYVF
FSVFFVILAMNLLGML-PFGF
VSLFVLVGYLNPMGLY-PYMF

I would like to input the vertical line numbers to delete.

Like 1, 2, 3, 17, .... and the the vertical lines 1, 2, 3, 17 are deleted.

Output:
Code:
MFFLVMMNLIGLVPFVY
LMLVMTLNLSGMVPGVF
FNSVVFANCFGMIPYVF
FASLLVLNLLGLVPYVF
FMMIIIFNLLGLIPYMF
FFYLLSINLLGFFIFTL
SVLLLSVNLVGMLPFIK
FIFIVFLNVLGLFPYVF
FFVILAMNLLGMLPFGF
FVLVGYLNPMGLYPYMF

# 7  
Old 03-02-2010
Code:
awk '{for( i=1; i<=9; i++){ #In place of 9, put the number of vertical lines you have
if( i != 2 && i !=8){s=substr($0,i,1);printf s}}#By putting Ampersend, you can compare and put all the vertical lines you want to delete
printf "\n"}' infile

 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Convert a horizontal lines to vertical lines in a csv file

Hi.. I need some help in converting the below horizontal lines to vertical lines format. can anyone help me on this. input file Hour,1,2,3,4,5 90RT,106,111,111,112,111 output file Hour,90RT 1,106 2,111 3,111 4,112 5,111 (3 Replies)
Discussion started by: Raghuram717
3 Replies

2. Shell Programming and Scripting

Tried many options but unable to delete blank lines from text file

Hi, I tried the following options but was unable to delete blank lines from file Input file = temp.hash.txt temp.hash.txt content 90 0 89.56 0 0 57575.4544 56.89 (9 Replies)
Discussion started by: uuuunnnn
9 Replies

3. Shell Programming and Scripting

Delete all CONSECUTIVE text lines from file shell scripting

Hi I have a text file like below. THe content of the text will vary. Entire text file have four consecutive lines followed with blank line. I want to delete the occurrence of the two consicutive lines in the text file. I don't have pattern to match and delete. Just i need to delete all... (5 Replies)
Discussion started by: RJSKR28
5 Replies

4. Shell Programming and Scripting

How to delete lines of a text file based on another text file?

I have 2 TXT files with with 8 columns in them(tab separated). First file has 2000 entries whereas 2nd file has 300 entries. The first file has ALL the lines of second file. Now I need to remove those 300 lines (which are in both files) from first file so that first file's line count become... (2 Replies)
Discussion started by: prvnrk
2 Replies

5. Shell Programming and Scripting

How to delete lines from text file?

hi guys, I have very large txt files (200GB) and just want to to delete the first two lines (headers). So far I used sed -i '1,2d' infile.txtbut this command always takes extremely long as it writes all again. Is there a better way to do it (ie just to delete the lines without writing all... (2 Replies)
Discussion started by: TuAd
2 Replies

6. Shell Programming and Scripting

Need help in changing vertical lines to horizontal line in a file

Hi, I have a file like below robert PREF: 3 AVAIL: henry PREF: 234 AVAIL: john PREF: 145,178 AVAIL: 123 matt PREF: 564,932 AVAIL: ten PREF: 389 AVAIL: kill (2 Replies)
Discussion started by: rocky1954
2 Replies

7. Shell Programming and Scripting

looking for a script that will delete lines in a text file

it will grep for a line and then delete these line. how do i begin to write this script if theres no available one? (3 Replies)
Discussion started by: garfish
3 Replies

8. Shell Programming and Scripting

How to delete first 5 lines and last five lines in all text files

Hi I want to delete first five and last five lines in text files without opening the file and also i want to keep the same file name for all the files. Thanks in advance!!! Ragav (10 Replies)
Discussion started by: ragavendran31
10 Replies

9. Shell Programming and Scripting

Delete blocks of lines from text file

Hello, Hello Firends, I have file like below. I want to remove selected blocks say abc,pqr,lst. how can i remove those blocks from file. zone abc { blah blah blah } zone xyz { blah blah blah } zone pqr { blah blah blah } (4 Replies)
Discussion started by: nrbhole
4 Replies

10. Programming

Delete specific lines in a text file

Hi, experts, I would like to create a function that can calculate the total number of lines in a saved text file and delete specific lines in that particular file (I only want the last few lines). Hav anybody have the experience and giv me a hand in this? (9 Replies)
Discussion started by: dniz
9 Replies
Login or Register to Ask a Question