07-11-2013
Special character ^@ in CSV file
All,
I am having a tough time with Linux and CSV file. My CSV file gets generated from Cognos on Linux machine that contains special characters. At first instance when I do vi <filename> to that file, I can't see anything. I did tail -2 and redirected to another temp file and did vi <filename>, I can see control characters ^@. I can remove those characters manually by using :%s/^@//g in vi editor. But, the process need to be done automatically as its all automated. Its needs to be done from shell script. The same file came with some other special character in Solaris and was easy to remove.
Any help would be appreciated.
9 More Discussions You Might Find Interesting
1. Solaris
Hi together
I have 2 systems, mars and venus. The configuration is the same. Every system has a SDLT. I will now backup the datas from mars on the tapedevice from venus.
I have shareed the tapedevice (venus) and mounted on mars.
Now my problem: when I write on the mountet tapedevice, the... (1 Reply)
Discussion started by: MuellerUrs
1 Replies
2. UNIX for Dummies Questions & Answers
I'm having problems deleting a file with a special character and I'm hoping that somebody here can help. The file "-osample1.c" will not remove from my directory. Here is an example of what happens. Any ideas would be appreciated.
> ls *sample1*
ls: illegal option -- .
usage: ls... (2 Replies)
Discussion started by: hart1165
2 Replies
3. Shell Programming and Scripting
hi
i want to delete a particular character in file.
example
file name:abcsample
abc=bbbqw3/
hidh=ajjqiwio4/
xyx=hakjp/
........../
......./
i want to delete that special character (/) in abcsample file.please give the required commands for my requirement.
thank you (3 Replies)
Discussion started by: srivsn
3 Replies
4. Shell Programming and Scripting
hi
i want to delete a particular character in file.
example
file name:abcsample
abc=bbbqw3/
hidh=ajjqiwio4/
xyx=hakjp/
........../
......./
i want to delete that special character (/) in abcsample file Permnently.please give the required commands for my requirement.
required... (1 Reply)
Discussion started by: srivsn
1 Replies
5. UNIX for Dummies Questions & Answers
I have a special character in my file. It displays as a '#' sign but when I do this command I do not find the line.
fgrep 'G#ant' file1
I want to replace the special character with another value but I need to know what character it really is. Any ideas on how to replace this '#' value with... (3 Replies)
Discussion started by: Ryan2786
3 Replies
6. Shell Programming and Scripting
hello,
How to parse a file to see if a specific line is commented by '#' character?
filename: file1
cat file1
...
# /usr/bin/whatever
...
thank you (9 Replies)
Discussion started by: melanie_pfefer
9 Replies
7. Shell Programming and Scripting
Hi,
My file has this special character "^M"
I would like to remove this characters.
eg:
abc,abc,^M
i tried using sed but doesnt work.
i used octal dump command to see special character it returns following:
015
\r
Appreciate your reply. (6 Replies)
Discussion started by: pinnacle
6 Replies
8. Shell Programming and Scripting
Hello
I've searched here and on the 'net for examples of a script or command line function that will remove the $ character from all file names only that can be done within the directory that contains the file names - which are all html files.
ie, I have a directory that contains html files... (6 Replies)
Discussion started by: competitions
6 Replies
9. Shell Programming and Scripting
Hi All -
I am new to unix and scripting. I was asked to export a sql output into .csv format and email the attachment. I could do this however i see some square like boxes or special char at the end of the headings and data values in .csv file. I could not fix this and will need your help.
... (5 Replies)
Discussion started by: Sanchalla
5 Replies
LEARN ABOUT DEBIAN
text::csv::encoded::coder::encodeguess
Text::CSV::Encoded::Coder::EncodeGuess(3pm) User Contributed Perl Documentation Text::CSV::Encoded::Coder::EncodeGuess(3pm)
NAME
Text::CSV::Encoded::Coder::EncodeGuess - Text::CSV::Encoded coder class using Encode::Guess
SYNOPSIS
use Text::CSV::Encoded coder_class => 'Text::CSV::Encoded::Coder::EncodeGuess';
use Spreadsheet::ParseExcel;
my $csv = Text::CSV::Encoded->new();
$csv->encoding( ['ucs2', 'ascii'] ); # guessing ucs2 or ascii?
$csv->encoding_to_combine('shiftjis');
my $excel = Spreadsheet::ParseExcel::Workbook->Parse( $file );
my $sheet = $excel->{Worksheet}->[0];
for my $row ( $sheet->{MinRow} .. $sheet->{MaxRow} ) {
my @fields;
for my $col ( $sheet->{MinCol} .. $sheet->{MaxCol} ) {
my $cell = $sheet->{Cells}[$row][$col];
push @fields, $cell->{Val};
}
$csv->combine( @fields ) or die;
print $csv->string, "
";
}
DESCRIPTION
This module is inherited from Text::CSV::Encoded::Coder::Encode.
USE
Except for 2 attributes, same as Text::CSV::Encoded::Coder::Encode.
encoding_in
$csv = $csv->encoding_in( $encoding_list_ref );
The accessor to an encoding for pre-parsing CSV strings. If no encoding is given, returns current $encoding, otherwise the object itself.
$encoding_list_ref = $csv->encoding_in()
When you pass a list reference, it might guess the encoding from the given list.
$csv->encoding_in( ['shiftjis', 'euc-jp', 'iso-20022-jp'] );
If it cannot guess the encoding, the first encoding of the list is used.
encoding
$csv = $csv->encoding( $encoding_list_ref );
$encoding_list_ref = $csv->encoding();
You can pass a list reference to this attribute only:
* For list data consumed by combine().
* For list reference returned by getline().
In other word, in "combine" and "print", it might guess an encoding for the passing list data. If it cannot guess the encoding, the first
encoding of the list is used.
SEE ALSO
Encode, Encode::Guess
AUTHOR
Makamaka Hannyaharamitu, <makamaka[at]cpan.org>
COPYRIGHT AND LICENSE
Copyright 2008-2010 by Makamaka Hannyaharamitu
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
perl v5.14.2 2010-04-26 Text::CSV::Encoded::Coder::EncodeGuess(3pm)