04-25-2010
Help in locating a word in huge files
hi
i receive about 5000 files per day in my system. Each of them are like:
cat ABC.april24.dat
ABH00001990 01993 409009092 0909 INI iop 9033
AAB0000237893784 8430900 898383 AUS 34349089008 849843 9474822
AAA00003849893498098394 84834 348348439 -438939 IN
AAA00004438493893849384 89809 978980980 -898988 IND
.
.
.
each of these files have millions of line like this, and Each line has fix format depending upon category (ABH, AAB,AAA), i want to find all AAA category in the file which have IN any where in location 54-60, as this is invalid value and IND is correct. So like this i want to identiy all AAA lines which has invalid value 'IN' instead of 'IND'.
finding it difficult due to huge size of these files
Thanks in advance !!!
10 More Discussions You Might Find Interesting
1. Filesystems, Disks and Memory
I'm trying to locate all files that do not contain the string /usr but do contain the string csh within the file called /etc/passwd. Then I would like to direct this output to a file called pout.
Does anyone one have suggestions on this one?
Thanks (2 Replies)
Discussion started by: klannon
2 Replies
2. UNIX for Advanced & Expert Users
Hi , i need a fast way to delete duplicates entrys from very huge files ( >2 Gbs ) , these files are in plain text.
I tried all the usual methods ( awk / sort /uniq / sed /grep .. ) but it always ended with the same result (memory core dump)
In using HP-UX large servers.
Any advice will... (8 Replies)
Discussion started by: Klashxx
8 Replies
3. Shell Programming and Scripting
Hi, all:
I've got two folders, say, "folder1" and "folder2".
Under each, there are thousands of files.
It's quite obvious that there are some files missing in each. I just would like to find them. I believe this can be done by "diff" command.
However, if I change the above question a... (1 Reply)
Discussion started by: jiapei100
1 Replies
4. UNIX for Dummies Questions & Answers
Hi, i am new to unix shell scripting and i need a script which would search for a particular word in all the files present in a directory. The output should have the word and file path name. For example: "word" "path name".
Thanks for the reply in adv,:) (3 Replies)
Discussion started by: virtual_45
3 Replies
5. Shell Programming and Scripting
Hi Everyone,
I am looking for a simple way for replacing all the files under a directory that use the server "xsgd1234dap" with "xsdr3423pap".
For Example:
In the Directory,
$pwd
/home/nick
$ grep -l "xsgd1234dap" *.sh | wc -l
119
I have "119" files that are still using... (5 Replies)
Discussion started by: filter
5 Replies
6. UNIX for Dummies Questions & Answers
I have a file that has the words I want to find in other files (but lets say I just want to find my words in a single file). Those words are IDs, so if my word is ZZZ4, outputs like aaZZZ4, ZZZ4bb, aaZZZ4bb, ZZ4, ZZZ, ZyZ4, ZZZ4.8 (or anything like that) WON'T BE USEFUL.
I need the whole word... (6 Replies)
Discussion started by: chicchan
6 Replies
7. Solaris
My question is :
-How do I locate files of specific user in specific folder.
In other words, How do I find files that belong only to "root" user, in /etc folder? (5 Replies)
Discussion started by: alexex666
5 Replies
8. UNIX for Dummies Questions & Answers
I've created a test script, which is located in $HOME/bin. The script runs as expected with no issues. However, upon echo'ing the $path variable the location of my script is not located in any of the directories listed in $path. So my question is, how does shell know where the script is located... (2 Replies)
Discussion started by: BrandonD
2 Replies
9. Shell Programming and Scripting
Hi All,
I am looking for a perl/awk/sed command to auto-increment the numbers line in file, P1.tcl:
run_build_model sparc_ifu_dec
run_drc
set_faults -model path_delay -atpg_effectiveness -fault_coverage
add_delay_paths P1
set_atpg -abort_limit 1000
run_atpg -ndetects 1000
I would like... (6 Replies)
Discussion started by: jypark22
6 Replies
10. UNIX for Beginners Questions & Answers
Guys i need an idea for one logic..in shell scripting am struggling with a logic...So the thing is... i need to search for a word in a huge log file and i need to continue to print few more lines from that line and the consecutive line has to end when it finds the line with date..because i know... (1 Reply)
Discussion started by: Prathi
1 Replies
LEARN ABOUT REDHAT
install-memo
install-memo(1) General Commands Manual install-memo(1)
NAME
install-memo - installs a new memo in a Palm Computing Device
SYNOPSIS
install-memo -p <port> [-c category ] filename [filename filename ...]
DESCRIPTION
install-memo allows the user to write one or more files as a new memo or memos, respectively, onto the Palm handheld device.
OPTIONS
-p --port <port>,
Use device file port to communicate with the Palm handheld device. If this is not specified, will look for the $PILOTPORT environ-
ment variable. If both are not found, will fall back to /dev/pilot.
-h --help
Display help synopsis for install-memo
-v --version
Display version of install-memo
-c category
Install memo(s) to category category by default. Normally install-memo uses Unfiled as the default category.
-q Causes install-memo to be quiet and not prompt you to press the HotSync button.
-r Replace all memos in the category specified by the -c category option.
-t Use the filename as the title for the memo. (The title is the first line of a memo.)
USAGE
The program will connect to the Palm handheld device, and write the file or files given on the command line into the MemoPad application on
the Palm.
KNOWN BUGS
The Palm Device may have a maximum length on memo sizes.
REPORTING BUGS
Report bugs at http://bugs.pilot-link.org/
AUTHOR
install-memo was written by Damien P. Neil <neild@rpi.edu>
Free Software Foundation Palm Computing Device Tools install-memo(1)