Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to replace ^J in unix file
Top Forums Shell Programming and Scripting How to replace ^J in unix file Post 302468270 by ikki on Tuesday 2nd of November 2010 08:18:48 AM
Old 11-02-2010
When dealing with characters, that are not easy to type in an editor, I usually find the "offending" character with od. od can be found on most *nixes, and supports multiple ways to display it's input.

Here are a few examples. First I created some arbitary data:
Code:
perl -e 'print chr($_) for (1..10);' > some_data

And the outputs of od for that file:

Hexadecimal 2-byte output:
Code:
$ od -h < some_data
0000000 0201 0403 0605 0807 0a09
0000012

Hexadecimal 2-byte output with the characters next to it:
Code:
$ od -hc < some_data
0000000 0201 0403 0605 0807 0a09
        001 002 003 004 005 006  \a  \b  \t  \n
0000012

Octal 2-byte output with the characters:
Code:
$ od -oc < some_data
0000000 001001 002003 003005 004007 005011
        001 002 003 004 005 006  \a  \b  \t  \n
0000012

Octal output with the characters:
Code:
$ od -bc < some_data
0000000 001 002 003 004 005 006 007 010 011 012
        001 002 003 004 005 006  \a  \b  \t  \n
0000012

Then just use sed or something similar to remove/translate the characters.

EDIT: Added last example.
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how to replace certain patterns in a file thru unix!!

Hi Friends, well what i want to do is that suppose i have a file say like .... ronaldduckdancecoolman donaldmuckdancepooltactics fonaldguckdancetoolbutcomps .... okok i agree this is a ridiculous data for a file. :-) now i want that the characters in each line fromposition 16 to say 19... (6 Replies)
Discussion started by: mexx_freedom
6 Replies

2. Shell Programming and Scripting

replace delimiter : with '\001' in unix data file

HI can any one tell me how to replace a delimiter : with another delimiter '\001' it is a non printable octal character. thanks in adv spandu (4 Replies)
Discussion started by: spandu
4 Replies

3. UNIX for Dummies Questions & Answers

How to replace the string in unix file?

Hi Am getting "Line too long" error in opening a file using vi editor but it is opening using cat. How can i edit the file to replace some string in it. Thanks (5 Replies)
Discussion started by: param_it
5 Replies

4. Shell Programming and Scripting

Replace Date field in Unix File

I have a data file having first 19 characters having the date in the below format- 2010-04-29-00.00.00 I have to check this date field ( first 19 characters) against some specific dates and if date is not in 3 valid dates ( business date available to me , business date - 1 , businessdate... (10 Replies)
Discussion started by: varunrbs
10 Replies

5. Shell Programming and Scripting

Help needed :Search and Replace a string pattern with empty in an xml file in unix

Search and Replace a string pattern with empty in an xml file in unix: My xml file would be like this : <Accounts><Name>Harish</Name><mobile>90844444444444445999 </mobile><TRIG>srcujim-1</TRIG></Accounts><Accounts><Name>Satish</Name><mobile>908999</mobile><TRIG>ettertrtt-1</TRIG></Accounts> ... (1 Reply)
Discussion started by: harish_s_ampeo
1 Replies

6. UNIX for Dummies Questions & Answers

How to replace a file on Unix server with file from my c: drive

I have a Logging.xml file located on my laptop c: drive. I want to take this file and replace the Logging.xml that is currently on my Aix 6.1 Unix server with it. Here is the where the file is located. It is the Logging.xml file ... (8 Replies)
Discussion started by: gregvc
8 Replies

7. Shell Programming and Scripting

Replace first 3 characters in a unix file in all lines

Replace first 3 characters in a unix file (say replace "A&B" with "C&D") in all lines of the file. Need a sed or awk script to do this. Kindly help! -Kumar (4 Replies)
Discussion started by: vasan2815
4 Replies

8. Emergency UNIX and Linux Support

Need to replace a column value in UNIX file

Hi All, I am having a file like below 01098546 3 56120610010377101008311121 001382 71 003 5011339 01099413 1 42120500010247081106112121 000304 46 002 2011339 I want to replace the 78 column from 3 to 4 and I need the file as below 01098546 ... (1 Reply)
Discussion started by: arunkumar_mca
1 Replies

9. UNIX for Beginners Questions & Answers

Views How to replace a CRLF char from a variable length file in the middle of a string in UNIX?

My sample file is variable length, with out any field delimiters. It has min of 18 chars length and the 'CRLF' is potentially between 12-14 chars. How do I replace this with a space? I still want to keep end of record, but just want to remove these new lines chars in the middle of the data. ... (7 Replies)
Discussion started by: chandrath
7 Replies

LEARN ABOUT REDHAT

mac2unix

dos2unix(1)						      General Commands Manual						       dos2unix(1)

NAME

       dos2unix - DOS/MAC to UNIX text file format converter

SYNOPSYS

       dos2unix [options] [-c convmode] [-o file ...] [-n infile outfile ...]

       Options:

       [-hkqV] [--help] [--keepdate] [--quiet] [--version]

DESCRIPTION

       This manual page documents dos2unix, the program that converts plain text files in DOS/MAC format to UNIX format.

OPTIONS

       The following options are available:

       -h --help
	      Print online help.

       -k --keepdate
	      Keep the date stamp of output file same as input file.

       -q --quiet
	      Quiet mode. Suppress all warning and messages.

       -V --version
	      Prints version information.

       -c --convmode convmode
	      Sets conversion mode. Simulates dos2unix under SunOS.

       -o --oldfile file ...
	      Old file mode. Convert the file and write output to it. The program default to run in this mode. Wildcard names may be used.

       -n --newfile infile outfile ...
	      New  file  mode.	Convert the infile and write output to outfile. File names must be given in pairs and wildcard names should NOT be
	      used or you WILL lost your files.

EXAMPLES

       Get input from stdin and write output to stdout.

	      dos2unix

       Convert and replace a.txt. Convert and replace b.txt.

	      dos2unix a.txt b.txt

	      dos2unix -o a.txt b.txt

       Convert and replace a.txt in ASCII conversion mode.  Convert and replace b.txt in ISO conversion mode.  Convert	c.txt  from  Mac  to  Unix
       ascii format.

	      dos2unix a.txt -c iso b.txt

	      dos2unix -c ascii a.txt -c iso b.txt

	      dos2unix -c mac a.txt b.txt

       Convert and replace a.txt while keeping original date stamp.

	      dos2unix -k a.txt

	      dos2unix -k -o a.txt

       Convert a.txt and write to e.txt.

	      dos2unix -n a.txt e.txt

       Convert a.txt and write to e.txt, keep date stamp of e.txt same as a.txt.

	      dos2unix -k -n a.txt e.txt

       Convert and replace a.txt. Convert b.txt and write to e.txt.

	      dos2unix a.txt -n b.txt e.txt

	      dos2unix -o a.txt -n b.txt e.txt

       Convert c.txt and write to e.txt. Convert and replace a.txt.  Convert and replace b.txt. Convert d.txt and write to f.txt.

	      dos2unix -n c.txt e.txt -o a.txt b.txt -n d.txt f.txt

DIAGNOSTICS

BUGS

       The program does not work properly under MSDOS in stdio processing mode.  If you know why is that so, please tell me.

AUTHORS

       Benjamin Lin - <blin@socs.uts.edu.au>

       Bernd Johannes Wuebben (mac2unix mode) <wuebben@kde.org>

MISCELLANY

       Tested environment:

	      Linux 1.2.0 with GNU C 2.5.8

	      SunOS 4.1.3 with GNU C 2.6.3

	      MS-DOS 6.20 with Borland C++ 4.02

       Suggestions and bug reports are welcome.

SEE ALSO

       unix2dos(1) mac2unix(1)

1995.03.31							   dos2unix v3.0						       dos2unix(1)
All times are GMT -4. The time now is 11:01 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy