Removing special chars from file and maintain field separator

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to split data with a delimiter having chars and special chars

Hi Team, I have a file a1.txt with data as follows. dfjakjf...asdfkasj</EnableQuotedIDs><SQL><SelectStatement modified='1' type='string'><! The delimiter string: <SelectStatement modified='1' type='string'><! dlm="<SelectStatement modified='1' type='string'><! The above command is...

2. UNIX for Beginners Questions & Answers

Change encoding, no removing special chars. inconv

Hi all, I'm using iconv command to change files encoding to UTF-8 If my input file has chars as those are removed creating the file without those special chars. I tried using iconv -c, but there is still the removal. Is there a way to keep those special chars changing just the...

3. Shell Programming and Scripting

shell scripting to determine special chars in file

Hi, I need all your help to achieve the below functionality. I have a big 2 GB file and inside the file we need to identify, whether having a comma(,) or pipe(|) or tab or fixed position or semicolon(;) delimiter. If any of those delimiter found need to replace the file with pipe(|)...

4. Shell Programming and Scripting

Matching two files with special field separator

Hello, I have a file with such structure: >ENSGALG00000000011|ENSGALT00000000012|57|1123|1125 AACTGTGTGTTTTTT >ENSGALG00000000012|ENSGALT00000000013|57|1145|1155 AAAAAAGGTCCTGTGTGC >ENSGALG00000000015|ENSGALT00000000014|57|1144|1155 AAAATGTGTGTGTGTGTGTGTG I want to use another file...

5. Shell Programming and Scripting

How to reverse all columns of a file having some field separator?

Hello, I have a file: xandyandz x & y & z x*y*z*a I require output as: zandyandx z & y & x a*z*y*x here all lines have different field seperator (and & * )based on that i want to reverse the column of a file. Pl. help.

6. Shell Programming and Scripting

Removing rows and chars from text file

Dear community, maybe I'm asking the moon :rolleyes:, but I'm scratching my head to find a solution for it. :wall: I have a file called query.out (coming from Oracle query), the file is like this: ADDR TOTAL -------------------- ---------- TGROUPAGGR...

7. Shell Programming and Scripting

Removing unknow chars from file names.

I'm trying to move a large folder to an external drive but some files have these weird chars that the external drive won't accept. Does anyone know any command of any bash script that will look through a given folder and remove any weird chars?

8. Shell Programming and Scripting

awk, comma as field separator and text inside double quotes as a field.

Hi, all I need to get fields in a line that are separated by commas, some of the fields are enclosed with double quotes, and they are supposed to be treated as a single field even if there are commas inside the quotes. sample input: for this line, 5 fields are supposed to be extracted, they...

9. Shell Programming and Scripting

Help in formating a file with field separator

hi thanks a lot But pls help me if my input file is the below format: Name priya 2010-09-21 10:43:49 TEXT ID 1 hi TEXT ID 2 how TEXT ID 3 r TEXT ID 4 u Name2 priya2 2010-09-21 10:43:49 TEXT ID 1 hi1 TEXT ID 2 how1 TEXT ID 3 r1

10. Solaris

removing special characters, white spaces from a field in a file

what my code is doing, it is executing a sql file and the resullset of the query is getting stored in the text file in a fixed format. for that fixed format i have used the following code:: Code: awk -F":"...

LEARN ABOUT DEBIAN

dtfits

dtfits(1)						      General Commands Manual							 dtfits(1)

NAME

       dtfits - display FITS table

SYNOPSIS

       dtfits <table>

DESCRIPTION

       dtfits  dumps the contents of a FITS table in an ASCII format, either into a user-specified file or on stdout. The output is formatted on a
       fixed number of columns to make it readable by human beings. Additional informations are printed out before the table  values  are  dumped,
       these informations can be skipped by using the -d option.

       Last,  if  you  want  to dump the table into an easily parsable format (for a piece of software), you might want to use the -s option which
       specifies a character to use as separator. All data fields will be printed out separated by this character only. This allows to use  string
       parsers	to  cut down the output lines into tokens by looking for this separator. Fields (lines) will still be delimited by the end-of-line
       character. This option produces ASCII tables which are easy to parse for a piece of software but mostly unreadable to human beings.

       Notice that dtfits only accepts one single FITS table in input.

OPTIONS

       -d     Skip information output about the table and column names. Outputs only the table values. Beware that if the FITS file contains  sev-
	      eral extensions, they will all appear one after another, separated only by two blank lines. In that case, it would be preferrable to
	      keep the complete output and parse out the returned stream to differentiate which data come from where.

       -s <char>
	      Use the character <char> as separator in output. This option is useful if you want to produce a table that should  be  parsed  by  a
	      piece  of software (see above description). The separator can only be a single non-null character. To avoid special characters being
	      interpreted by the shell, it is recommended to provide this character always between simple or double quotes. Example:
	      dtfits -s '&' table.tfits

       If you want to use a special character as separator, such as a tab, use ^V to insert your character, such as:
       dtfits -s '^V<TAB>' table.tfits

       which means: you type CTRL-V and then the tab key.

SEE ALSO

       dfits

FILES

       FITS tables are stored into extensions. If there are several tables in a file, they will all be displayed one after  another  in  the  same
       output stream.

								    22 Dec 1999 							 dtfits(1)

UNIX for Advanced & Expert Users