I am a beginner in Unix. Though have been asked to write a script to filter(remove duplicates) data from a .dat file. File is very huge containig billions of records.
contents of file looks like
30002157,40342424,OTC,mart_rec,100, ,0
30002157,40343369,OTC,mart_rec,95, ,0... (6 Replies)
Hi, I have a huge file which is about 50GB. There are many lines. The file format likes
21 rs885550 0 9887804 C C T C C C C C C C
21 rs210498 0 9928860 0 0 C C 0 0 0 0 0 0
21 rs303304 0 9941889 A A A A A A A A A A
22 rs303304 0 9941890 0 A A A A A A A A A
The question is that there are a few... (4 Replies)
Trying to cut down the size of some log files. Now that I write this out it looks more dificult than i thought it would be.
Need a bash script or command that goes sequentially through all lines of a file, and does this:
if field1 (space separated) is the number 2012 print the entire line. Do... (7 Replies)
I have a csv file that I would like to remove duplicate lines based on field 1 and sort. I don't care about any of the other fields but I still wanna keep there data intact. I was thinking I could do something like this but I have no idea how to print the full line with this. Please show any method... (8 Replies)
Hi,
I have a file with fields like below:
A;XYZ;102345;222
B;XYZ;123243;333
C;ABC;234234;444
D;MNO;103345;222
E;DEF;124243;333
desired output:
C;ABC;234234;444
D;MNO;103345;222
E;DEF;124243;333
ie, if the 4rth field is a duplicate.. i need only those records where... (5 Replies)
Hi All,
i have input file like below...
CA009156;20091003;M;AWBKCA72;123;;CANADIAN WESTERN BANK;EDMONTON;;2300, 10303, JASPER AVENUE;;T5J 3X6;;
CA009156;20091003;M;AWBKCA72;321;;CANADIAN WESTERN BANK;EDMONTON;;2300, 10303, JASPER AVENUE;;T5J 3X6;;
CA009156;20091003;M;AWBKCA72;231;;CANADIAN... (2 Replies)
Hello,
I have two files file 1 and file 2 each having result of a query on certain database tables and need to compare for Col1 in file1 with Col3 in file2, compare Col2 with Col4 and output the value of Col1 from File1 which is a) not present in Col3 of File2 b) value of Col2 is different from... (2 Replies)
Hi all,
I've got a file that has 12 fields. I've merged 2 files and there will be some duplicates in the following:
FILE:
1. ABC, 12345, TEST1, BILLING, GV, 20/10/2012, C, 8, 100, AA, TT, 100
2. ABC, 12345, TEST1, BILLING, GV, 20/10/2012, C, 8, 100, AA, TT, (EMPTY)
3. CDC, 54321, TEST3,... (4 Replies)
Hi All,
I am storing the result in the variable result_text using the below code.
result_text=$(printf "$result_text\t\n$name") The result_text is having the below text. Which is having duplicate lines.
file and time for the interval 03:30 - 03:45
file and time for the interval 03:30 - 03:45 ... (4 Replies)
Discussion started by: nalu
4 Replies
LEARN ABOUT OSF1
uplcom
UPLCOM(4) BSD Kernel Interfaces Manual UPLCOM(4)NAME
uplcom -- USB support for Prolific PL-2303/2303X/2303HX serial adapters driver
SYNOPSIS
To compile this driver into the kernel, place the following lines in your kernel configuration file:
device uplcom
device ucom
Alternatively, to load the driver as a module at boot time, place the following line in loader.conf(5):
uplcom_load="YES"
DESCRIPTION
The uplcom driver provides support for various serial adapters based on the Prolific PL-2303, PL-2303X and PL-2303HX USB-to-RS232 Bridge
chips.
The device is accessed through the ucom(4) driver which makes it behave like a tty(4).
HARDWARE
The uplcom driver supports the following adapters:
o ATEN UC-232A
o BAFO BF-800
o BAFO BF-810
o Belkin F5U257
o ELECOM UC-SGT
o HAL Corporation Crossam2+USB IR commander
o Hama USB RS-232 Serial Adapter
o Hamlet exagerate XURS232
o IOGEAR UC-232A
o I/O DATA USB-RSAQ
o I/O DATA USB-RSAQ2
o I/O DATA USB-RSAQ3
o Mobile Action MA-620 Infrared Adapter
o PLANEX USB-RS232 URS-03
o RATOC REX-USB60
o Radio Shack USB Serial Cable
o Sandberg USB to Serial Link (model number 133-08)
o SOURCENEXT KeikaiDenwa 8 (with and without charger)
o Sony Ericsson USB Cable (Susteen USB Data Cable)
o Willcom W-SIM DD PHS terminal.(WS002IN)
SEE ALSO tty(4), ucom(4), usb(4)HISTORY
The uplcom driver appeared in NetBSD 1.6. This manual page was adopted from NetBSD by Tom Rhodes <trhodes@FreeBSD.org> in April 2002.
BSD November 22, 2006 BSD
05-03-2010
