02-09-2012
Quote:
Originally Posted by
ngkumar
Brilliant...It's working now
Thanks Scrutinizer...If you don't mind can you explain wht the command does.
Once again a big thanks
Hi, thanks..
The sed places a newline above any line that starts with at least one number followed by a pipe symbol. So now each record is separated by two newline characters
The awk uses the two consecutive newline characters to distinguish records (it does this when RS is empty). We now have an entire record in $0 and we can delete all the newlines with a gsub.
Quote:
---------- Post updated at 07:29 AM ---------- Previous update was at 07:12 AM ----------
As well would it be possible to cleane the file if the first feild is a string and has new line characers in it.
Possibly. Could you post a sample?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I am trying to do two things in my script. I will really appreciate any help in this regards.
Is there a way to delete a last line from a pipe delimited flat file if the last line is blank. If the line is not blank then do nothing.....
Is there a way to count a word that are starting... (4 Replies)
Discussion started by: rkumar28
4 Replies
2. Shell Programming and Scripting
How would one go about deleting the first two characters on each line of a file on Unix? I thought about using awk, but cannot seem to find if it can explicitly do this. In this case there might or might not be a field separator. Meaning that the data might look like this.
01999999999... (5 Replies)
Discussion started by: scotbuff
5 Replies
3. Shell Programming and Scripting
Hi All
is there a way to delete last n characters from a word
like say i have employee_new
i want to delete _new. and just get only employee
I want this in AIX Shell scripting
Thanks (3 Replies)
Discussion started by: rajaryan4545
3 Replies
4. Shell Programming and Scripting
I've got a file that would have lines similar to:
12345678 x.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00
23456781 x.00 xx.00 xx.00 xx.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00
34567812 x.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00
45678123 x.00 xx.00 xx.00 xx.00 xx.00 x.00 xxx.00 xx.00 xx.00 xx.00 xx.00... (10 Replies)
Discussion started by: Cailet
10 Replies
5. UNIX for Dummies Questions & Answers
I have a file that looks like this:
It is a huge file and basically I want to delete everything at the > line except for the number after “C”.
>c1154... (2 Replies)
Discussion started by: kylle345
2 Replies
6. Shell Programming and Scripting
Hi,
I have a log file whose size is number of characters in the file with multiple lines.
Example:
SQL*Loader: Release 10.2.0.4.0 - Production on Sat Sep 12 07:55:29 2009
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Control File: ../adm/ctl/institution.ctl
Character Set... (4 Replies)
Discussion started by: rajeshorpu
4 Replies
7. Shell Programming and Scripting
Hi,
I want to delete rows whenever column one has the letters 'rpa'. The file is tab seperated.
e.g.
years 1
bears 1
cats 2
rpat 3
rpa99 4
rpa011 5
then removing 'rpa' containing rows based on the first column
years 1
bears 1
cats 2
thanks (7 Replies)
Discussion started by: phil_heath
7 Replies
8. Shell Programming and Scripting
Hi All,
I have a text file with the following text in it:
file:///About/accessibility.html
file:///About/disclaimer.html
file:///About/disclaimer.html#disclaimer
file:///pubmed?term=%22Dacre%20I%22%5BAuthor%5D
file:///pubmed?term=%22Madigan%20J%22%5BAuthor%5D... (8 Replies)
Discussion started by: shoaibjameel123
8 Replies
9. Shell Programming and Scripting
Hi All,
I am struck with an issue. I need to delete '%' and 'G' from all lines in the input file.
Below is what I want to do.
InputFile
04/09/2012.21:58:17,well9,rootfs,3.9G,2.7G,1.1G,71%,/
04/09/2012.21:58:17,well9,/dev/hda2,3.9G,2.7G,1.1G,71%,/... (6 Replies)
Discussion started by: vharsha
6 Replies
10. UNIX for Dummies Questions & Answers
Hi
I have a file:
r58778.3|SOURCES={KEY=f665931a...,fw,221-705}|ERRORS={16_1:T,30_1:T,56_1:C,57_1:T,59_1:A,101_1:A,115:-,158_1:C,186_1:A,204:-,271_1:T,305:-,350_1:C,368_1:G,442_1:C,472_1:G,477_1:A}|SOURCE_1="Contig_1092402550638"(f665931a359e36cea0976db191ff60ff09cc816e)
I want to retain... (15 Replies)
Discussion started by: Alyaa
15 Replies
LEARN ABOUT CENTOS
shell-quote
SHELL-QUOTE(1) User Contributed Perl Documentation SHELL-QUOTE(1)
NAME
shell-quote - quote arguments for safe use, unmodified in a shell command
SYNOPSIS
shell-quote [switch]... arg...
DESCRIPTION
shell-quote lets you pass arbitrary strings through the shell so that they won't be changed by the shell. This lets you process commands
or files with embedded white space or shell globbing characters safely. Here are a few examples.
EXAMPLES
ssh preserving args
When running a remote command with ssh, ssh doesn't preserve the separate arguments it receives. It just joins them with spaces and
passes them to "$SHELL -c". This doesn't work as intended:
ssh host touch 'hi there' # fails
It creates 2 files, hi and there. Instead, do this:
cmd=`shell-quote touch 'hi there'`
ssh host "$cmd"
This gives you just 1 file, hi there.
process find output
It's not ordinarily possible to process an arbitrary list of files output by find with a shell script. Anything you put in $IFS to
split up the output could legitimately be in a file's name. Here's how you can do it using shell-quote:
eval set -- `find -type f -print0 | xargs -0 shell-quote --`
debug shell scripts
shell-quote is better than echo for debugging shell scripts.
debug() {
[ -z "$debug" ] || shell-quote "debug:" "$@"
}
With echo you can't tell the difference between "debug 'foo bar'" and "debug foo bar", but with shell-quote you can.
save a command for later
shell-quote can be used to build up a shell command to run later. Say you want the user to be able to give you switches for a command
you're going to run. If you don't want the switches to be re-evaluated by the shell (which is usually a good idea, else there are
things the user can't pass through), you can do something like this:
user_switches=
while [ $# != 0 ]
do
case x$1 in
x--pass-through)
[ $# -gt 1 ] || die "need an argument for $1"
user_switches="$user_switches "`shell-quote -- "$2"`
shift;;
# process other switches
esac
shift
done
# later
eval "shell-quote some-command $user_switches my args"
OPTIONS
--debug
Turn debugging on.
--help
Show the usage message and die.
--version
Show the version number and exit.
AVAILABILITY
The code is licensed under the GNU GPL. Check http://www.argon.org/~roderick/ or CPAN for updated versions.
AUTHOR
Roderick Schertler <roderick@argon.org>
perl v5.16.3 2010-06-11 SHELL-QUOTE(1)