Hi,
If i have a file with xml format, i would like to remove duplicated records and save to a new file. Is it possible...to write script to do it? (8 Replies)
Hi,
First time on the forum. I have converted some files using the Unix to DOS command but need to strip off the last record that is generated from this conversion that contains just a ^Z. Is there any command that would accomplish this without having to do stream editing? (4 Replies)
Hi ,
In need to remove the record marked in red
My input is as below :
1|ETG|63121387883|Alternate|Y
2|||
3|79.58|||GBP||
4|001137001
4|0011372
5|1021701
5|1021901
1|ETG|63121387884|Alternate|Y
2|||
3|79.58|||GBP||
4|001137001
5|1021702
5|1021802
1|ETG|63128363077|Alternate|Y
2|||... (1 Reply)
Hi,
I have a fixed width file with record length 10.
I need to remove multiple newline characters present in each record.
EX:
af\n72/7\n
s\n3\nad\n
2\n\n33r\n
In the above file I want to remove new lines in red color(\n) but not (\n)
Please provide me a solution.
Thanks,
Sri (1 Reply)
Hello
I have a file with data something like this in it :
texttexttext "text .lst" TEXT=" text "
texttexttext "moretext .lst" TEXT=" text "
Question is how do I get rid of space so that the files looks like this :
texttexttext "text.lst" TEXT="text"
texttexttext... (8 Replies)
Dear Friends,
Need your help to fix the issue we are facing.
We have a requirement - Need to remove specific records from a comma separated file and create new file. It should check "filter.csv" file and then accordingly remove records from the input file and generate the output file.(not case... (5 Replies)
Hi,
I need a ksh script for the below requirement:
i have a Delimited flat file with 200 records delimiter is '|~|'
i need a script to insert space at the end if the record is ending with delimiter '|~|'
if it didnt end with delimiter it should not append space.
Example: ram|~|2|~| ... (16 Replies)
Discussion started by: srikanth_sagi
16 Replies
LEARN ABOUT BSD
ddd
DDD(1L)DDD(1L)NAME
ddd - double-speed data dumper
SYNOPSIS
ddd [option=value] ...
DESCRIPTION
Ddd works almost the same way as dd(1), but it has a much better throughput, especially when used with slow i/o-devices, such as tape
drives. The improvement is achieved mainly by dividing the copying process into two processes, one of which reads while the other one
writes and vice versa. Also all code conversion capabilities are omitted. There is no additional overhead copying data between various
conversion buffers.
Ddd was inspired by the vast difference in speed between BSD4.2 and BSD4.3 dumps - in BSD4.3 dump(8) uses alternating processes to write to
raw magnetic tape, thus keeping the tape continuously in motion. I wanted to get the same improvement to remote dumps, so this filter was
needed. Directing all physical I/O through ddd usually increases the throughput of any pipeline of unix commands (if you have enough MIPS
and RAM to handle two extra processes).
OPTIONS
Ddd uses options if, of, ibs and obs exactly as dd(1). Option bs can also be used to specify ibs and obs at once. One option differs
slightly in meaning: cbs can be used to specify the size of the internal buffer. Input and output processes will swap duties when cbs
bytes have been transferred. Default values for all sizes are 512 bytes. As with dd(1), letters k (kilobyte), b (block) or w (word) can
be appended to size values. Other options are not provided.
HINTS
For best performance, block sizes should be rather large. For magnetic tape, I use obs=100b and cbs=500b or so. Large block sizes (~100b)
are also effective for network connections. However, cbs should be small enough for all the data to fit in core, since page faults add
overhead.
AUTHOR
Tapani Lindgren <nispa@cs.hut.fi>
Laboratory of Information Processing Science
Helsinki University of Technology
Finland
SEE ALSO dd(1), tar(1), dump(8)BUGS
Should you find one, let me know!
WARNING
(Applies to U.S. residents & citizens only)
Do not use this program! Get rid of it as soon as you can! It will probably corrupt all your data, break down your computer and cause
severe injury to the operators. Even reading the source code may give you a headache. I warned you! I will take no responsibility what-
soever!
DDD(1L)