Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

bash - joining lines in a file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting bash - joining lines in a file
# 1  
Old 03-01-2011
bash - joining lines in a file
I’m writing a bash shell script and I want to join lines together where two variables on each line are the same ie.

Code:
12345variablestuff43212morevariablestuff
12345variablestuff43212morevariablestuff
34657variablestuff78945morevariablestuff
34657variablestuff78945morevariablestuff
98789variablestuff48975morevariablestuff

I want the file to end up looking like this:

Code:
12345variablestuff43212morevariablestuff12345variablestuff43212morevariablestuff
34657variablestuff78945morevariablestuff34657variablestuff78945morevariablestuff
98789variablestuff48975morevariablestuff

There can be any number of matching rows (16 max at the moment) as there seems to be a lot of duplication but I only need to join the first 4 rows as they appear on the file. (I have at the moment deleted the duplicates, but it seems that the duplication is actually necessary in rare cases Smilie)
Thanks so much in advance for any help with this!
Last edited by radoulov; 03-01-2011 at 07:16 AM.. Reason: Code tags, please!
# 2  
Old 03-01-2011
With sed..
Code:
sed '/^[0-9]\+/{N;s/\(^[0-9]\+.*\)\n\(\1.*\)/\1\2/}' inputfile > outfile

# 3  
Old 03-01-2011
Thanks for you response.

This hasn't done the trick for me though. The file that I'm working on is fixed length and contains both text and numerics throughout. The variables that I am matching on have 7 digits followed by 1/2 characters, if there is no second character this is a space.

Many thanks again in advance!
# 4  
Old 03-01-2011
I was guessing that the file you posted is not your real file you work upon. Have modified the command to match only the numerics at the beginning between the lines 1 and 2,3 and 4 etc..If this does not work post your sample data of the real file.
Code:
sed '/^[0-9]\+/{N;s/\(^[0-9]\+\)\(.*\)\n\(\1.*\)/\1\2\3/}'  inputfile > outfile

This User Gave Thanks to michaelrozar17 For This Post:
Cultcha
# 5  
Old 03-01-2011
That's done the trick!!

Thanks a million!!

---------- Post updated at 08:43 AM ---------- Previous update was at 07:16 AM ----------

Sorry to come back to you on this again.

It seems that not all rows have joined appropriately. Here's the input:

Code:
 
1234567DR$MYSELF              $ANDI                $9876543H $          12346.87$     497.52$     123.56$XY$ $12
1234567DR$MYSELF              $ANDI                $9876543H $              0.00$       0.00$       0.00$TR$ $10

# 6  
Old 03-01-2011
Code:
awk '{printf $0}' file_name > out_file

Last edited by Franklin52; 03-02-2011 at 03:20 AM.. Reason: Please use code tags
# 7  
Old 03-01-2011
Hi, thanks for the response, but there are two variables that should match before joining the lines.

The first and the fourth columns have to match.

These will change after one line/two lines/three lines etc... throughout.
Last edited by Cultcha; 03-01-2011 at 10:49 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Joining especific lines in "2n" lines file

Hi to everybody. I have a "2n" lines file. I would like to create a new file with only "n" lines, each line in the new file formed by the proper odd line of the old file joined with the following even line (separated by a space) of the old file. I'd prefer using sed or bash. -example-... (5 Replies)
Discussion started by: felino
5 Replies

2. Shell Programming and Scripting

Issue in Concatenation/Joining of lines in a dynamically generated file

Hi, I have a file containing many records delimited by pipe (|). Each record should contain 17 columnns/fields. there are some fields having fields less than 17.So i am extracting those records to a file using the below command awk 'BEGIN {FS="|"} NF !=17 {print}' feedfile.txt... (8 Replies)
Discussion started by: TomG
8 Replies

3. Shell Programming and Scripting

Joining lines in TXT file based on first character

Hi, I have a pipe delimeted text file where lines have been split over 2 lines and I need to join them back together. For example the file I have is similar to the following: aaa|bbb |ccc ddd|eee fff|ggg |hhh I ideally need to have it looking like the following aaa|bbb|ccc ddd|eee... (5 Replies)
Discussion started by: fuji_s
5 Replies

4. Shell Programming and Scripting

joining multi-line file into single lines

Hi, I have a file like mentioned below..For each specific id starting with > I want to join the sequence in multiple lines to a single line..Is there a simple way in awk or sed to do this >ENST00000558922 cdna:KNOWN TCCAGGATCCAGCCTCCCGATCACCGCGCTAGTCCTCGCCCTGCCTGGGCTTCCCCAGAG... (2 Replies)
Discussion started by: Diya123
2 Replies

5. Shell Programming and Scripting

Joining lines in a file - help!

I'm looking for a way to join lines in a file; e.,g consider the following R|This is line 1 R|This is line 2 R|This is line 3 R|This is line 4 R|This is line 5 what i want to end up with is R|This is line 1 R|This is line 2 R|This is line 3 R|This is line 4 R|This is line 5 so... (15 Replies)
Discussion started by: Storms
15 Replies

6. Shell Programming and Scripting

Joining lines in a text file using AWK or SED

Hi All I'm struggling a bit here :( I need a way of joining lines contained in a text file. I've seen numerous SED and AWK examples and none of them seem to be working for me. The text file has 4 lines: DELL1427 DOC 30189342 79 Now bear with me on this one as I'm actually... (4 Replies)
Discussion started by: huskie69
4 Replies

7. UNIX for Dummies Questions & Answers

JOINING MULTIPLE LINES IN A TEXT FILE USING GAWK

sir... am having a data file of customer master., containing some important fields as a set one line after another., what i want is to have one set of these fields(rows) one after another in line.........then the second set... and so on... till the last set completed. I WANT THE DATA... (0 Replies)
Discussion started by: KANNI786
0 Replies

8. UNIX for Dummies Questions & Answers

Joining lines of a text file using GAWK

sir... am having a data file of customer master., containing some important fields as a set one line after another., what i want is to have one set of these fields(rows) one after another in line.........then the second set... and so on... till the last set completed. ... (0 Replies)
Discussion started by: KANNI786
0 Replies

9. Shell Programming and Scripting

Joining 2 lines in a file together

Hi guys, I've got a log file which has entries that look like this: ------------------------------------------------------------------------------- 06/08/04 07:57:57 AMQ9002: Channel program started. EXPLANATION: Channel program 'INSCCPQ1.HSMTSPQ1' started. ACTION: None. ... (3 Replies)
Discussion started by: m223464
3 Replies

10. Shell Programming and Scripting

Joining lines in log file

Hi, I need to develop a script to join multiple three lines in a log file into one line for processing with awk and grep. I looked at tr with no success. The first line contains the date time information. The second line contains the error line. The third line is a blank line. Thanks, Mike (3 Replies)
Discussion started by: bubba112557
3 Replies
Login or Register to Ask a Question