I have one requirement. We are getting fixed length file with trailer record on it.
We need to cleanse,validate and process the file.
As part of validation we have to do duplicate file check based on file name and trailer record.
I want to add the file name as last column to file, so that I can use the filed for validation purpose.
Also I have notice that the file is coming with "^M" at the end, which my guess is windows new line character . I have to eliminate this from the file.
For starters, send the file binary mode and you will not get the windows ^M.
If you can't change that (ie client sends ascii only) then convert using either:
Or you could use sed
Or you could use dos2ux (not seen this in a while)
Or you could use:
tr -d "\015" < my_dos_file > new_aix_file
be careful if you go down the orad of using sed/awk scripts - you need to be sure that EVERY line has a ^M or you risk stripping off some real caharacters!
For starters, send the file binary mode and you will not get the windows ^M.
Perhaps a typing error: it is exactly the way round. Send the file in ASCII mode if you transfer it via FTP, not BINARY. Binary will leave the wrong line ends alone, while ASCII will translate them correctly.
Here is a sed-script, which will safely(!) remove "^M"s from the end of the lines:
Enter "^M" in vi this way: in insert-mode press <CTRL>-<V> and then <ENTER>. A "^M" will appear, which is only one character (change to command mode and go over it with the cursor to see it). Do NOT enter it as 2 characters, this will change its meaning completely (and definitely not do what you want to achieve).
Bakunin is correct. Ascii will leave the file to be decoded by local OS (where the local OS will correctly interpret the ascii code as EOL or CR or whatever).
I may have been sleeping when writing my previous post
Also, a good time to point out the ascii character map (referenced in my earlier post, using the tr command to strip out "015") which could be used to do a whole load of file manipulations.
Hi All ,
I am very new to unix script.I am aware of unix commands but never put together in unix script level.If any one can suggest me technical guidance in the below scenario that will highly beneficial.
Data have been already migrated from mainframe to Hadoop file system(HDFS).HDFS server... (15 Replies)
Hi all,
$ echo $SHELL
/bin/bash
Requirement - How to pass oracle sql script as argument to unix shell script?
$ ./output.sh users.sql
Below are the shell scripts and the oracle sql file in the same folder.
Shell Script
$ cat output.sh
#!/bin/bash
.... (7 Replies)
Hi,
Is it possible to ftp a huge zip file from windows to unix server using unix shell scripting?
If so what command i need to use.
thanks in advance. (1 Reply)
Hi, I am new to this subject.....Can someone please help me out with the script...
unix usernm "sdhftst"
unix pwd "chsd13"
windows usernm "dfghtst"
windows pwd "chsd13"
path..../xxx/xxxxx/xxxxxx/xxxxxxx
please can u get me a script...its only one file to get ftp.
Thanks... (2 Replies)
unix script must do the fiollowing
open a file containing comma delimited records
> each record contains 10 fields
> removes the 2nd field and use that same field containing fields 2 to 10
the original record after fprocessing should containing fields 1 and 3
a new erecord must be... (10 Replies)
I need to execute a shell script kept in unix machine from windows. User id, password area available.
For eg.
There's a shell script wich moves all the logs kept in my home directory to a directory named LOGS.
Now i need to get this done through windows; either using a batch file, or java... (4 Replies)
Hi,
I need help urgently for following issue. Pls help me to resolve this issue.
I am calling sql script file(file1.sql) from UNIX Shell Script(script1.ksh) using sql plus and trying to create flat file that contains all records returned from SQL query in SQL script(file1.sql)
I given... (6 Replies)
i need to ftp a file from windows to a unix machine by executing a sript(perl/shell/php) from that unix machine.i can also use HTML and javascript to build forms. (3 Replies)
Hi,
My local server is :/usr/abcd/
Remote server is :/Usr/host/test/
I want to send files from local unix directory(All files starting with O_999) to
remote host unix directory.
Can any body give me the Unix Shell script to do this.
One more doubt: Shall we need to change the file... (1 Reply)