02-07-2012
Deleting new line characters
Hi,
I have a weird requirement. I am having a file with 12fields in it and the end of the line for each record is "\n" (Just \n and no carriage returns) and the field delimiter is "|". Problem is I can have new line characters in any field in the data and these new line characters can even come in the last field (This is the problem as it is very tricky to identify where the field is completing).
Can any one help me how can I delete these new line characters which are present in the data.
Please help me how can I do
1. If I have a decimal field as first field
2. Having string field as first field and this field as well having new line characters in it -- Looks to me it is almost impossible to cleane this file but want a confirmation from the expertise.
Let me know if I am not clear with my question.
Thanks in advance.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I am trying to do two things in my script. I will really appreciate any help in this regards.
Is there a way to delete a last line from a pipe delimited flat file if the last line is blank. If the line is not blank then do nothing.....
Is there a way to count a word that are starting... (4 Replies)
Discussion started by: rkumar28
4 Replies
2. Shell Programming and Scripting
How would one go about deleting the first two characters on each line of a file on Unix? I thought about using awk, but cannot seem to find if it can explicitly do this. In this case there might or might not be a field separator. Meaning that the data might look like this.
01999999999... (5 Replies)
Discussion started by: scotbuff
5 Replies
3. Shell Programming and Scripting
Hi All
is there a way to delete last n characters from a word
like say i have employee_new
i want to delete _new. and just get only employee
I want this in AIX Shell scripting
Thanks (3 Replies)
Discussion started by: rajaryan4545
3 Replies
4. Shell Programming and Scripting
I've got a file that would have lines similar to:
12345678 x.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00
23456781 x.00 xx.00 xx.00 xx.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00
34567812 x.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00
45678123 x.00 xx.00 xx.00 xx.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00 xx.00... (10 Replies)
Discussion started by: Cailet
10 Replies
5. UNIX for Dummies Questions & Answers
I have a file that looks like this:
It is a huge file and basically I want to delete everything at the > line except for the number after “C”.
>c1154... (2 Replies)
Discussion started by: kylle345
2 Replies
6. Shell Programming and Scripting
Hi,
I have a log file whose size is number of characters in the file with multiple lines.
Example:
SQL*Loader: Release 10.2.0.4.0 - Production on Sat Sep 12 07:55:29 2009
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Control File: ../adm/ctl/institution.ctl
Character Set... (4 Replies)
Discussion started by: rajeshorpu
4 Replies
7. Shell Programming and Scripting
Hi,
I want to delete rows whenever column one has the letters 'rpa'. The file is tab seperated.
e.g.
years 1
bears 1
cats 2
rpat 3
rpa99 4
rpa011 5
then removing 'rpa' containing rows based on the first column
years 1
bears 1
cats 2
thanks (7 Replies)
Discussion started by: phil_heath
7 Replies
8. Shell Programming and Scripting
Hi All,
I have a text file with the following text in it:
file:///About/accessibility.html
file:///About/disclaimer.html
file:///About/disclaimer.html#disclaimer
file:///pubmed?term=%22Dacre%20I%22%5BAuthor%5D
file:///pubmed?term=%22Madigan%20J%22%5BAuthor%5D... (8 Replies)
Discussion started by: shoaibjameel123
8 Replies
9. Shell Programming and Scripting
Hi All,
I am struck with an issue. I need to delete '%' and 'G' from all lines in the input file.
Below is what I want to do.
InputFile
04/09/2012.21:58:17,well9,rootfs,3.9G,2.7G,1.1G,71%,/
04/09/2012.21:58:17,well9,/dev/hda2,3.9G,2.7G,1.1G,71%,/... (6 Replies)
Discussion started by: vharsha
6 Replies
10. UNIX for Dummies Questions & Answers
Hi
I have a file:
r58778.3|SOURCES={KEY=f665931a...,fw,221-705}|ERRORS={16_1:T,30_1:T,56_1:C,57_1:T,59_1:A,101_1:A,115:-,158_1:C,186_1:A,204:-,271_1:T,305:-,350_1:C,368_1:G,442_1:C,472_1:G,477_1:A}|SOURCE_1="Contig_1092402550638"(f665931a359e36cea0976db191ff60ff09cc816e)
I want to retain... (15 Replies)
Discussion started by: Alyaa
15 Replies
LEARN ABOUT OPENSOLARIS
fmlcut
fmlcut(1F) FMLI Commands fmlcut(1F)
NAME
fmlcut - cut out selected fields of each line of a file
SYNOPSIS
fmlcut -clist [filename]...
fmlcut -flist [-dchar] [-s] [filename]...
DESCRIPTION
The fmlcut function cuts out columns from a table or fields from each line in filename; in database parlance, it implements the projection
of a relation. fmlcut can be used as a filter; if filename is not specified or is -, the standard input is read. list specifies the fields
to be selected. Fields can be fixed length (character positions) or variable length (separated by a field delimiter character), depending
on whether -c or -f is specified.
Note: Either the -c or the -f option must be specified.
OPTIONS
list A comma-separated list of integer field numbers (in increasing order), with optional - to indicate ranges. For example: 1,4,7;
1-3,8; -5,10 (short for 1-5,10); or 3- (short for third through last field).
-clist If -c is specified, list specifies character positions (for instance, -c1-72 would pass the first 72 characters of each line).
Note: No space intervenes between -c and list.
-flist If -f is specified, list is a list of fields assumed to be separated in the file by the default delimiter character, TAB, or by
char if the -d option is specified. For example, -f1,7 copies the first and seventh field only. Lines with no delimiter charac-
ters are passed through intact (useful for table subheadings), unless -s is specified. Note: No space intervenes between -f and
list. The following options can be used if you have specified -f.
-dchar If -d is specified, char is the field delimiter. Space or other characters with special meaning to FMLI must be quoted.
Note: No space intervenes between -d and char . The default field delimiter is TAB.
-s Suppresses lines with no delimiter characters. If -s is not specified, lines with no delimiters will be passed through
untouched.
EXAMPLES
Example 1 Getting login IDs and names
The following example gets the login IDs and names.
example% fmlcut -d: -f1,5 /etc/passwd
Example 2 Getting the current login name
The next example gets the current login name.
example% `who am i | fmlcut -f1 -d" "`
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWcsu |
+-----------------------------+-----------------------------+
SEE ALSO
fmlgrep(1F), attributes(5)
DIAGNOSTICS
fmlcut returns the following exit values:
0 when the selected field is successfully cut out
2 on syntax errors
The following error messages may be displayed on the FMLI message line:
ERROR: line too long
A line has more than 1023 characters or fields, or there is no new-line character.
ERROR: bad list for c/f option
Missing -c or -f option or incorrectly specified list. No error occurs if a line has fewer fields than the list calls for.
ERROR: no fields
The list is empty.
ERROR: no delimiter
Missing char on -d option.
NOTES
fmlcut cannot correctly process lines longer than 1023 characters, or lines with no newline character.
SunOS 5.11 5 Jul 1990 fmlcut(1F)