07-08-2004
removing spurious charactors from file
Morning,
Hopefully someone can help an newbie!
I have been getting a number of file corruptions with
Rogue "Control M" charactors [ carriage return ].
The effect is:
Should be
aaaa
bbbb
cccc
dddd
(4 lines)
But getting
aaaa
bb<Ctl M>
bb
ccccc
dddd
(5 lines)
I am having to correct this manually using vi...
Anyone know a way to do this in a script?
Effectively I want to delete any occurrances of the string
"^M\n"
I can't use tr as
tr -d "^M" leaves two lines.
tr -d "^M\n" also deletes the genuine "\n" at end of line.
Any suggestions? sed?
The problem with manuals is that you need to know what to look up!
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
grep `whoami` $1 >> file
this lets me take out the username from a file and then i move it to a file but i need it to do one step at a time because i want the occurences to be numbered like
1)HOME=/home/joe.bloggs
2)LOGNAME=joe.bloggs
instead of just
HOME=/home/joe.bloggs... (1 Reply)
Discussion started by: iago
1 Replies
2. Shell Programming and Scripting
Hi all,
I know this is **awfully** general but.....
I have a script which does, basically...
for file in `find command`; do
some stuff
more stuff
echo '.\c'
done
I want to output the '.' char just to give an idea of progress. However, it works fine for a while and then I... (2 Replies)
Discussion started by: ajcannon
2 Replies
3. UNIX for Dummies Questions & Answers
Hello,
I have a file that lists a few hundred values.
Example:
abca
abcb
abcc
abcd
I have a 2nd file with a few thousand lines. I need to remove every line from the 2nd file that contains any of the values listed in first file.
Example of strings to delete:
line1 *abca* end of... (1 Reply)
Discussion started by: upstate_boy
1 Replies
4. Shell Programming and Scripting
I am special requirements to rename file.
I have files with names like below:
1_firstname1_lastname1.html
2_firstname2_lastname2.html
3_fistname3_lastname2.html
I would like these file to be renamed as below
firstname1_lastname1.html
firstname2_lastname2.html... (5 Replies)
Discussion started by: McLan
5 Replies
5. UNIX for Dummies Questions & Answers
I am trying to remove the lines listed in example File A from File B to achieve File C. Both files are much larger than the examples below. (File B has up to 6,000 lines).
I have searched the forums and I have not been able to find an answer to this particular question.
I tried
grep -v -f... (2 Replies)
Discussion started by: pezziza
2 Replies
6. Shell Programming and Scripting
I have two files like ABC_DEF_yyyyymmdd_hhmiss_XXX.txt and ABC_DEF_yyyyymmdd_hhmiss_YYY.txt. The date part is going to be changing everytime. How do i remove this date part of the file and create a single file like ABC_DEF_XXX.txt. (8 Replies)
Discussion started by: varlax
8 Replies
7. Programming
Dear All
I have 200 data files and each files has many duplicates.
I am looking for the automated awk script such that it checks and removes the duplicates from the each file and saving them as new files for all 200 files in the respective folder.
For example my data looks like this..
... (12 Replies)
Discussion started by: bala06
12 Replies
8. Linux
I have a .CSV file when I check for the special characters in the file using the command cat -vet filename.csv, i get very lengthy lines with "^@", "^I^@" and "^@^M" characters in between each alphabet in all of the records. Using the code below file filename.csv I get the output as
I have a... (2 Replies)
Discussion started by: dhruuv369
2 Replies
9. UNIX for Dummies Questions & Answers
Hi Everybody! First post! Totally noobie.
I'm using the terminal to read a poorly formatted book.
The text file contains, in the middle of paragraphs, hyphenation to split words that are supposed to be on multiple pages. It looks ve -- ry much like this.
I was hoping to use grep -v " -- "... (5 Replies)
Discussion started by: AxeHandle
5 Replies
10. UNIX for Beginners Questions & Answers
Hi Folks,
I have a requirement of file management on different servers.
Source Server is SERVER-A.
Two servers will fetch files from SERVER-A: SERVER1 and SERVER2.
4th SERVER is SERVER-B, It will fetch files from SERVER1. If SERVER1 goes DOWN, SERVER-B will fetch pending files from... (2 Replies)
Discussion started by: Raza Ali
2 Replies
GREP(1) General Commands Manual GREP(1)
NAME
grep - search a file for a pattern
SYNOPSIS
grep [ option ... ] pattern [ file ... ]
DESCRIPTION
Grep searches the input files (standard input default) for lines (with newlines excluded) that match the pattern, a regular expression as
defined in regexp(6). Normally, each line matching the pattern is `selected', and each selected line is copied to the standard output.
The options are
-c Print only a count of matching lines.
-h Do not print file name tags (headers) with output lines.
-i Ignore alphabetic case distinctions. The implementation folds into lower case all letters in the pattern and input before interpre-
tation. Matched lines are printed in their original form.
-l (ell) Print the names of files with selected lines; don't print the lines.
-L Print the names of files with no selected lines; the converse of -l.
-n Mark each printed line with its line number counted in its file.
-s Produce no output, but return status.
-v Reverse: print lines that do not match the pattern.
Output lines are tagged by file name when there is more than one input file. (To force this tagging, include /dev/null as a file name
argument.)
Care should be taken when using the shell metacharacters $*[^|()= and newline in pattern; it is safest to enclose the entire expression in
single quotes '...'.
SOURCE
/sys/src/cmd/grep.c
SEE ALSO
ed(1), awk(1), sed(1), sam(1), regexp(6)
DIAGNOSTICS
Exit status is null if any lines are selected, or non-null when no lines are selected or an error occurs.
GREP(1)