We receive some huge files on to Linux server. Source system use FTP mechanism to transfer these files on our server. Occasionally one record is getting corrupted while transfer, some control characters are injecting into the file. How to fix this issue ? please advice ?
Sample Corrupted Record:
Correct Record is as follows:
Last edited by jim mcnamara; 09-05-2014 at 05:48 PM..
Hi,
I have a file which has special characters. I can't see them when I "vi" the file. But I am sure there are some special un seen characters. How can I see them?
Please help.
Thx (6 Replies)
Hi,
I have a data like this in a file,
402003279034002000100147626030003300010000000000002000029000000 ær^M^\MÍW^H
I need to replace those special char to some other char like # or $
Is there any ways to do it...
I tried commands tr,sed and many but it was not able to replace because... (1 Reply)
I am getting error when loading data file using ctl file. I get this error only when there is special character.
Below is some data.
DataFile=>
company_id|ciu_id|english_name|iso_country_code|active|partner_name
1-2JT-122||Expert Järvenpää|FI|A|Expert Järvenpää
Control File=>
LOAD DATA... (1 Reply)
Is there any command or shell script to grep any special character from a file ? I have a huge file containing millions of user names; the requirement is to find names containing special characters.
#!/bin/bash
for i in `cat username.txt`
do
#COMMAND to grep special character
done
... (3 Replies)
I have developed a small script to remove the Control M characters that get embedded when we move any file from Windows to Unix. For some reason, its not working in all scenarios. Some times I still see the ^M not being removed. Is there anything missing in the script:
cd ${inputDir}... (7 Replies)
Hello All,
I am facing challenges in order to transfer a file from windows to unix box,the file contains a special character '×' ,now when I am transferring the file from windows to unix that special character converted to something else like 'Ã' ,another thing I have noticed that the hardware is... (1 Reply)
Hi experts :)
I need to replace special characters into a file , in the followiing way :
" --> ""
' --> ''
_--> \_
I tried with the sed command but I'm getting and error ksh: $: not found.
ksh: $: not found.
sed: Function s/\/\/ cannot be parsed.
Any idea ?
Thanks ,
KOLAS... (2 Replies)
Hello,
How can I view control and special characters of a text file?. For example, space, tabs, new line chars etc.
Can I use hexdump for it?
Thanks (3 Replies)
Hi all,
I have a problem with file naming in linux. I have to create a file named like 11/22.csv but shell displays error: no such file or dir. Problem is / character in the file name. I searched unix linux naming concepts and it's restricted in OS. Please tell me if there's any other chance?
OS... (3 Replies)
I want to parse a file containing special characters, below is a sample content of file
content of file :
Serial_no:1$$@#first_name:Rahane$$@last_name:Ajiyenke@@#profession:cricketer!@#*&^
Serial_no:1$$@#first_name:Rahane$$@last_name:Ajiyenke@@#profession:cricketer!@#*&^... (3 Replies)
Discussion started by: rajMjar
3 Replies
LEARN ABOUT FREEBSD
xferlog
XFERLOG(5) File Formats Manual XFERLOG(5)NAME
xferlog - ProFTPD server logfile
DESCRIPTION
The xferlog file contains logging information from the FTP server daemon, proftpd(8). This file usually is found in /var/log but can be
located anywhere by using a proftpd(8) configuration directive. Each server entry is composed of a single line of the following form, with
all fields being separated by spaces.
current-time transfer-time remote-host file-size filename transfer-type special-action-flag direction access-mode
username service-name authentication-method authenticated-user-id completion-status
current-time is the current local time in the form "DDD MMM dd hh:mm:ss YYYY". Where DDD is the day of the week, MMM is the month,
dd is the day of the month, hh is the hour, mm is the minutes, ss is the seconds, and YYYY is the year.
transfer-time is the total time in seconds for the transfer.
remote-host is the remote host name.
file-size is the size of the transferred file in bytes.
filename is the name of the transferred file. If the filename contains any spaces or control characters, each such character is
replaced by an underscore ('_') character.
transfer-type is a single character indicating the type of transfer. Can be one of:
a for an ascii transfer
b for a binary transfer
special-action-flag is one or more single character flags indicating any special action taken. Can be one or more of:
C file was compressed
U file was uncompressed
T file was tar'ed
_ no action was taken
direction is the direction of the transfer. Can be one of:
o outgoing
i incoming
d deleted
access-mode is the method by which the user is logged in. Can be one of:
a (anonymous) is for an anonymous guest user.
r (real) is for a local authenticated user.
username is the local username, or if guest, the ID string given.
service-name is the name of the service being invoked, usually FTP.
authentication-method
is the method of authentication used. Can be one of:
0 none
1 RFC931 Authentication
authenticated-user-id
is the user id returned by the authentication method. A * is used if an authenticated user id is not available.
completion-status is a single character indicating the status of the transfer. Can be one of:
c complete transfer
i incomplete transfer
FILES
/var/log/xferlog
AUTHORS
ProFTPD is written and maintained by a number of people, full credits can be found on http://www.proftpd.org/credits.html
SEE ALSO proftpd(8)
Full documentation on ProFTPD, including configuration and FAQs, is available at http://www.proftpd.org/
For help/support, try the ProFTPD mailing lists, detailed on http://www.proftpd.org/lists.html
Report bugs at http://bugs.proftpd.org/
XFERLOG(5)