removing non-printable chars from multiple files

Tags

file, multiple files, shell scripts

Top Forums Shell Programming and Scripting removing non-printable chars from multiple files

01-19-2009

Registered User

4, 0

Join Date: Dec 2007

Last Activity: 5 June 2011, 2:20 PM EDT

Posts: 4

Thanks Given: 0

Thanked 0 Times in 0 Posts

removing non-printable chars from multiple files

How do I remove non-printable characters from all txt files and output the results to one file?

I've tried the following:

Code:

tr -cd '[:print:]\n' < *.txt > out.txt

and it gives ambiguous redirect error.

How can I get it to operate on all txt files in the current directory and append the output to out.txt?

revax

View Public Profile for revax

Find all posts by revax

01-19-2009

Registered User

6,575, 572

Join Date: Sep 2007

Last Activity: 5 November 2019, 9:08 AM EST

Location: St. Gallen, Switzerland

Posts: 6,575

Thanks Given: 179

Thanked 572 Times in 484 Posts

Try this:

Code:

ls -1 | while read FNAME; do tr -d '[:cntrl:]' < "${FNAME}" > "${FNAME}".out; done

zaxxon

View Public Profile for zaxxon

Find all posts by zaxxon

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Web Development

Stripping of Non-Printable Chars in the Who Is Online Page

Noticed that after changing our site and HTML be to UTF-8 compliant per HTML5 standards, we started to see unprintable chars in the country and city name from the geoip database which converts IP addresses to country and city names. So, I just added this code to that PHP plugin which seems to do...

2. Shell Programming and Scripting

Removing a ? from multiple files

Hi all, I have about 1.8 million files in a directory structre, that contain a ? on the end, for example: /testdocs/1/mar/08/08/images/user/{1234-1234-1234-1234}0? Is there a way to go through the testdocs folder, recursively, and remove the ? from all docs that have one on the end? ...

3. UNIX for Beginners Questions & Answers

Change encoding, no removing special chars. inconv

Hi all, I'm using iconv command to change files encoding to UTF-8 If my input file has chars as those are removed creating the file without those special chars. I tried using iconv -c, but there is still the removal. Is there a way to keep those special chars changing just the...

4. Shell Programming and Scripting

Removing carriage returns from multiple lines in multiple files of different number of columns

Hello Gurus, I have a multiple pipe separated files which have records going over multiple Lines. End of line separator is \n and records going over multiple lines have <CR> as separator. below is example from one file. 1|ABC DEF|100|10 2|PQ RS T|200|20 3| UVWXYZ|300|30 4| GHIJKL|400|40...

5. Shell Programming and Scripting

Rename and add chars to multiple files at once

i have a little over 100 files named page1.jpg through page106.jpg. How can I rename them all to remove the page word and add 00 in front of the remaining numbers? I realize this might be multiple commands but cp page*.jpg *.jpg didn't work like I thought it would.

6. Shell Programming and Scripting

Removing rows and chars from text file

Dear community, maybe I'm asking the moon :rolleyes:, but I'm scratching my head to find a solution for it. :wall: I have a file called query.out (coming from Oracle query), the file is like this: ADDR TOTAL -------------------- ---------- TGROUPAGGR...

7. Shell Programming and Scripting

Removing unknow chars from file names.

I'm trying to move a large folder to an external drive but some files have these weird chars that the external drive won't accept. Does anyone know any command of any bash script that will look through a given folder and remove any weird chars?

8. UNIX for Dummies Questions & Answers

removing non printable characters

Hi, in a file, i have records as below: 123|62|absnb|267629 123|267|28728|uiuip 123|567|26761|2676 i want to remove the non printable characters after the end of each record. I guess there are certain charcters but not visible. i don't know what character that is exactly. I used...

9. Shell Programming and Scripting

Removing Non-printable characters in unix file

Hi, We have a non printable character "�" in our file , we want to remove this character, we tried tr -dc '' < oldfile> newfile but this command is removing all new line entries along with the non printable character and all the records are coming in one line(it is changing the format of the...

10. Shell Programming and Scripting

Removing M^ from multiple files

to do this i usually type dos2unix <file> -o <file> and this will remove the M^ from the end of each file. well i have over 100 files that someone copied that i need. how do i remove the M^. i saw a perl script but i am not familiar with .pl at all really

Shell Programming and Scripting