Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Cutting a file with multiple delimiters into columns
Top Forums Shell Programming and Scripting Cutting a file with multiple delimiters into columns Post 302409711 by Franklin52 on Friday 2nd of April 2010 06:29:53 AM
Old 04-02-2010
Quote:
Originally Posted by steadyonabix
That's nice Franklin. What was your thinking with $1=$1? I don't understand it.

Did you notice $2=$2 removes the extra blank lines from the output?
steadyonabix,

I've used $1=$1 to rearrange the line but didn't realize that it gives 2 extra blanc lines caused by the newline character.

Thanks for noticing that!

Since the line ends up with a newline character, a better way is to add an newline as extra fieldseparator:
Code:
awk -F"[:;,\n]" '$1=$1' RS=";;;" OFS="\t"

Regards
Last edited by Franklin52; 04-02-2010 at 10:14 AM.. Reason: Additional comment
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

cutting columns if delimiter has more than one charecter

Hi, My file looks like abc$%sdfhs$%sdf$%sdfaf$% here as seen delimiter is $%...now how cas i take out second field as cut command expect delimiter as single charecter only.....is there is any other way thanks and regards mahabunta (9 Replies)
Discussion started by: mahabunta
9 Replies

2. Shell Programming and Scripting

Cutting Columns and Moving in to a file

Guys, Can any one tell me how can we cut the columns and move each column in to a separate file using awk? I have a tab delimited file as shown below, 1213 wattt werree 2345 skhasdjh aasas I want to output this in to three files named a.txt,b.txt and c.txt say a.txt... (3 Replies)
Discussion started by: Serious Sam
3 Replies

3. Shell Programming and Scripting

Cutting columns starting at the end of each line...

Hi Guys, Can you help me with a sed or a csh script that will have an output from the input below. Cutting the columns starting from the end of the line and not from the start of the line? Sample1 - The underscore character "_" is actually a space...i need to put it as underscore here coz... (2 Replies)
Discussion started by: elmer1503
2 Replies

4. UNIX for Dummies Questions & Answers

cutting columns if delimiter has more than one charecter (|^)

Hi All, I am having a file with the delimiter '|^'. File name:test_dlim.csv I want to cut the first field of this using awk command. I tried with the help of the following link:... (2 Replies)
Discussion started by: boopathyvasagam
2 Replies

5. Shell Programming and Scripting

Sorting problem: Multiple delimiters, multiple keys

Hello If you wanted to sort a .csv file that was filled with lines like this: <Ticker>,<Date as YYYYMMDD>,<Time as H:M:S>,<Volume>,<Corr> (H : , M, S: ) by date, does anybody know of a better solution than to turn the 3rd and 4th colons of every line into commas, sorting on four keys,... (20 Replies)
Discussion started by: Ryan.
20 Replies

6. UNIX for Dummies Questions & Answers

cutting multiple columns into multiple files

Hypothetically, suppose that file1 id v1 v2 v3 v4 v5 v6 v7..........v100 1 1 1 1 1 1 2 2 .....50 2 1 1 1 1 1 2 2 .....50 3 1 1 1 1 1 2 2 .....50 4 1 1 1 1 1 2 2 .....50 5 1 1 1 1 1 2 2 .....50 I want to write a loop such that I take the id# and the first 5 columns (v1-v5) into the... (3 Replies)
Discussion started by: johnkim0806
3 Replies

7. Shell Programming and Scripting

Awk match multiple columns in multiple lines in single file

Hi, Input 7488 7389 chr1.fa chr1.fa 3546 9887 chr5.fa chr9.fa 7387 7898 chrX.fa chr3.fa 7488 7389 chr21.fa chr3.fa 7488 7389 chr1.fa chr1.fa 3546 9887 chr9.fa chr5.fa 7898 7387 chrX.fa chr3.fa Desired Output 7488 7389 chr1.fa chr1.fa 2 3546 9887 chr5.fa chr9.fa 2... (2 Replies)
Discussion started by: jacobs.smith
2 Replies

8. UNIX for Dummies Questions & Answers

Seperate columns according to delimiters

Hi all I need your help to separate colomns based on "-" delimiter for a very big file 30 millions rows I have a colmun looking like this : clomun 1 1-100000989-A_ATC 1-10000179-AAAAA 1-100002154-TGTTA 1-100002155-GTTAG 1-100002443 1-100002490 1-100002619 I need to separte in three... (5 Replies)
Discussion started by: biopsy
5 Replies

9. UNIX for Dummies Questions & Answers

Cutting specific columns from lines

I am trying to remove columns 81-97 from a line that can be as long as 114 characters. Because a number of lines might not have under 80 characters, using the cut command following by paste could be a problem. While sed might work, is there some other utility that could do this more easily? ... (9 Replies)
Discussion started by: wbport
9 Replies

10. Shell Programming and Scripting

Getting fields from a file having multiple delimiters

Hi All, I have a file with a single row having the following text ABC.ABC.ABC,Database,New123,DBNAME,F,ABC.ABC.ABC_APP,"@FUNCTION1("ENT1") ,@FUNCTION2("ENT2")",R, I want an output in the following format ABC.ABC.ABC DBNAME ABC.ABC.ABC_APP '@FUNCTION1("ENT1")... (3 Replies)
Discussion started by: dev.devil.1983
3 Replies

LEARN ABOUT ULTRIX

cr

cr(1)							      General Commands Manual							     cr(1)

NAME

       cr - converts text files between nix EOL and dos EOL

SYNOPSIS

       cr  - | +  <input file> <output file>

DESCRIPTION

       Text  files,  such  as tle files, that come from a dos source usualy have the ^M symbol at the end of every line. Cr converts files between
       the dos newline format and the normal *nix newline format by stripping the ^M to convert dos to *nix, using the '-' option, or adding ^M to
       a *nix file to create the proper dos file when the '+' option is used.

       Although this extra character is not often a problem, programs like seesat5, which are data driven will encounter parsing problems when the
       extra character is present. It is these problems that cr is intended to repair.

   Options
       - | +  One or the other of these options is required. The '-' option is used to remove ^M from all newlines found in the dos file. The  '+'
	      option is used to add ^M to every newline found in a *nix file.

       input file
	      Fully delineated path to the input file. As this program is used in the dos environment as well, standard input is not used.

       output file
	      Fully delineated path to the output file. As this program is used in the dos environment as well, standart output is not used.

SEE ALSO

       seesat5(1), seesat5(7), SEESAT5.INI(5), tle(5)

BUGS

       Cr  is  not an inteligent program. It methodicaly replaces/removes the offending character when it finds it in the correct context. Newline
       sequences found in contexts other than 'newline' will be replaced/removed just like those found in the proper  context.	Passing  a  binary
       file through cr is not advised, for this reason. Send all inqueries to Dale Scheetz <dwarf@polaris.net>.

Debian Linux							    2 April 96								     cr(1)
All times are GMT -4. The time now is 06:15 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy