07-06-2009
Grep in delimited file
Here is my file : (pipe delimited file)
abc|abc|11112|ffff|3333|oo
abc|abc|11112|ffff|3333|oo
abc|11112|ffff|2222|oo
abc|abc|11112|ffff|3333|oo
abc|22222|ffff|1111|oo
I need 2 things :
1. Need to grep for all rows where in 5th column is 3333. (i can do this using awk.. but my actual file has around 18 million rows... so awk takes more than an hour as 'awk' reads the file line by line).. so i am looking for a solution using grep.
2. Need to grep for alll the lines having the pattern 'abc' in column 1 and 'ffff' in column 4th.
please let me know whether this looks feasible .. thx a lot for helping me out !!!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
Can anyone let me know on how to convert a Tab delimited file to Comma delimited file in Unix
Thanks!! (22 Replies)
Discussion started by: charan81
22 Replies
2. Shell Programming and Scripting
hi,
How can I check for a field in a pipe-delimited file having a NULL value in Unix using a grep command or any other command.
Please reply (5 Replies)
Discussion started by: sureshg_sampat
5 Replies
3. UNIX for Dummies Questions & Answers
Hi all,
I have a file with single white space delimited values, I want to convert them to a tab delimited file.
I tried sed, tr ... but nothing is working.
Thanks,
Rajeevan D (16 Replies)
Discussion started by: jeevs81
16 Replies
4. Shell Programming and Scripting
i have a file whose data is like this::
osr_pe_assign|-120|wg000d@att.com|4|
osr_evt|-21|wg000d@att.com|4|
pe_avail|-21|wg000d@att.com|4|
osr_svt|-11|wg000d@att.com|4|
pe_mop|-13|wg000d@att.com|4|
instar_ready|-35|wg000d@att.com|4|
nsdnet_ready|-90|wg000d@att.com|4|... (6 Replies)
Discussion started by: priyanka3006
6 Replies
5. Shell Programming and Scripting
Hi All,
I have space delimited file similar to the one as shown below.. I need to convert it as a pipe delimited, the values inside the pipe delimited file should be as highlighted...
AA ATIU2345098809 009697 005374
BB ATIU2345097809 005445 006518
CC ATIU9685098809 003215 003571
DD... (7 Replies)
Discussion started by: nithins007
7 Replies
6. Shell Programming and Scripting
I have a file which was pipe delimited, I need to make it tab delimited. I tried with sed but no use
cat file | sed 's/|//t/g'
The above command substituted "/t" not tab in the place of pipe.
Sample file:
abc|123|2012-01-30|2012-04-28|xyz
have to convert to:
abc 123... (6 Replies)
Discussion started by: karumudi7
6 Replies
7. Shell Programming and Scripting
Hello folks, I have another doozy. I have two files. The first file has four fields in it. These four fields map to different locations in my second file. What I want to do is read the master file (file 2 - 23 fields) and compare each line against each record in file 1. If I get a match in all four... (4 Replies)
Discussion started by: dagamier
4 Replies
8. Shell Programming and Scripting
Hi How to make tab delimited file to space delimited?
in put file:
ABC kgy
jkh ghj
ash kjl
o/p file:
ABC kgy
jkh ghj
ash kjl
Use code tags, thanks. (1 Reply)
Discussion started by: jagdishrout
1 Replies
9. UNIX for Dummies Questions & Answers
Hi, I have a rquirement in unix as below .
I have a text file with me seperated by | symbol and i need to generate a excel file through unix commands/script so that each value will go to each column.
ex:
Input Text file:
1|A|apple
2|B|bottle
excel file to be generated as output as... (9 Replies)
Discussion started by: raja kakitapall
9 Replies
10. UNIX for Beginners Questions & Answers
Hello, I am trying to find a solution to problem that's proving to be beyond my newbie skills. The below files comes from a genetics study. File 1 describes a position on the genome and file 2 does the same but is formatted differently and has more information. I am trying to match all lines in... (5 Replies)
Discussion started by: andmal
5 Replies
LEARN ABOUT DEBIAN
fs_whereis
FS_WHEREIS(1) AFS Command Reference FS_WHEREIS(1)
NAME
fs_whereis - Reports each file server housing a file or directory
SYNOPSIS
fs whereis [-path <dir/file path>+] [-help]
fs whe [-p <dir/file path>+] [-h]
DESCRIPTION
The fs whereis command returns the name of each file server machine that houses the volume containing each directory or file named by the
-path argument.
OPTIONS
-path <dir/file path>+
Names each AFS file or directory for which to return the host file server machine. Partial pathnames are interpreted relative to the
current working directory, which is also the default value if this argument is omitted.
-help
Prints the online help for this command. All other valid options are ignored.
OUTPUT
The output includes a line for each specified directory or file. It names the file server machine on which the volume that houses the
specified directory or file resides. A list of multiple machines indicates that the directory or file is in a replicated volume.
Machine names usually have a suffix indicating their cell membership. If the cell is not clear, use the fs whichcell command to display the
cell in which the directory or file resides. To display the cell membership of the local machine, use the fs wscell command.
EXAMPLES
The following example indicates that volume housing the directory /afs/abc.com resides is replicated on both "fs1.abc.com" and
"fs3.abc.com":
% fs whereis -path /afs/abc.com
File /afs/abc.com is on hosts fs1.abc.com fs3.abc.com
PRIVILEGE REQUIRED
None
SEE ALSO
fs_whichcell(1), fs_wscell(1)
COPYRIGHT
IBM Corporation 2000. <http://www.ibm.com/> All Rights Reserved.
This documentation is covered by the IBM Public License Version 1.0. It was converted from HTML to POD by software written by Chas
Williams and Russ Allbery, based on work by Alf Wachsmann and Elizabeth Cassell.
OpenAFS 2012-03-26 FS_WHEREIS(1)