Hidden control characters in a Unix Text File!

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need to strip control-A characters from a column in a file

Hi All, I currently have flat file with 32 columns. The field delimiter is cntl-A ( \x01). The file has been extracted from an oracle table using a datastage job. However, in the 6th field, the data contains additional control -A characters which came as a part of the table data. I need...

2. Red Hat

Special control characters in file

Hi Guys, We receive some huge files on to Linux server. Source system use FTP mechanism to transfer these files on our server. Occasionally one record is getting corrupted while transfer, some control characters are injecting into the file. How to fix this issue ? please advice ? Sample...

3. Shell Programming and Scripting

How to view the control characters in a file?

Hello, How can I view control and special characters of a text file?. For example, space, tabs, new line chars etc. Can I use hexdump for it? Thanks

4. UNIX for Dummies Questions & Answers

Control characters in UNIX

Hi, My files are showing some control characters in vi editor ^M ^@ and somtimes ^H I removed ^M with %s/^M//g command but how to represent ^@ and ^H e.g. for ^M it is hold ctrl then v and m.. Please help.. I am very new to unix..

5. Shell Programming and Scripting

Request for advise on how to remove control characters in a UNIX file extracted from top command

Hi, Please excuse for posting new thread on control characters, I am facing some difficulties in removing the control character from a file extracted from top command, i am able to see control characters using more command and in vi mode, through cat control characters are not visible ...

6. Shell Programming and Scripting

Removing "Hidden Characters" on a file

Hi - I'm having a problem with hidden characters on Linux. When I produced an output from Oracle database, there is a an extra "Hidden Character" included on the output. How can I remove that character? See below: The extra dollar sign is creating a new line on my .csv output file. I...

7. Shell Programming and Scripting

display all possible control characters from .xml file in unix

Hi, I have a .xml file in unix. We are passing this file through a xml parser. But we are getting some control characters from input file and XML parser is failing for the control character in file.Now I am getting following error, Error at byte 243206625 of file filename_$.xml: Error...

8. UNIX for Advanced & Expert Users

Hidden Characters

Hello all, I have two files, that I suspect may contain hidden characters (EG, three spaces instead of a tab). Does anyone know of any tool that can display this (I have tried using diff, but I'm not quite sure it would do the job)

9. AIX

Randomly appearing control characters in text files

Hi, From some time, we have noticed that our ascii files have started corrupting due to the presence of some random control characters (^@, ^M, ^H, ^D). The characters appear randomly on any file after the process that creates the file finishes. If we rerun the process, the files re creates...

10. Programming

Identifying and removing control characters in a file.

What is the best method to identify an remove control characters in a file. Would it be easier to do this in Unix or in C.

LEARN ABOUT DEBIAN

xmlstarlet

XMLSTARLET(1)							 xmlstarlet Manual						     XMLSTARLET(1)

NAME

       xmlstarlet - command line XML/XSLT toolkit

SYNOPSIS

       xmlstarlet [<options>] [<command>] [<cmd-options>]

INTRODUCTION

       XMLStarlet is a set of command line utilities (tools) which can be used to transform, query, validate, and edit XML documents and files us-
       ing simple set of shell commands in similar way it is done for plain text files using UNIX grep, sed, awk, diff, patch, join, etc commands.
       This  set of command line utilities can be used by those who deal with many XML documents on UNIX shell command prompt as well as for auto-
       mated XML processing with shell scripts.

OPTIONS

       --version
	      Display the version of xmlstarlet.

       --help Display help.

COMMANDS

       Type: xmlstarlet <command> --help <ENTER> for command help

       Available commands include:

       ed (or edit)
	      Edit/update XML document(s).

       sel (or select)
	      Select data or query XML document(s) (XPATH, etc).

       tr (or transform)
	      Transform XML documents(s) using XSLT.

       val (or validate)
	      Validate XML document(s) (well-formed/DTD/XSD/RelaxNG).

       fo (or format)
	      Format XML document(s).

       el (or elements)
	      Display element structure of XML document.

       c14n (or canonic)
	      XML canonicalization.

       ls (or list)
	      List directory as XML.

       esc (or escape)
	      Escape special XML characters.

       unesc (or unescape)
	      Unescape special XML characters.

       pyx (or xmln)
	      Convert XML into PYX format (based on ESIS - ISO 8879).

       p2x (or depyx)
	      Convert PYX into XML.

REFERENCES

       XMLStarlet is a command line  toolkit  to  query/edit/check/transform  XML  documents  (for  more  information  see  http://xmlstar.source-
       forge.net/).

AUTHOR

       Mikhail Grushinskiy.

																     XMLSTARLET(1)

Shell Programming and Scripting