I have two files on both containing uk phone numbers
master is a file which has been collated over a few years ad currently contains around 4 million numbers
new is a file which also contains 4 million number i need to split new nto two separate files one which contains number that already exist in master and one which contains numbers that don't already exist in master. I can do this but it takes around 80 hours to complete !! can any one offer any suggestions on how to speed this up ?
Hello
I do want to write a script which will check any errors say "-error" in the log file then have to send email to the concern person . And the concern person will correct the error .
Next time if the script runs eventhough the error has been corrected it will ... (1 Reply)
Hi all,
I'm having some trouble with a shell script that I have put together to search our web pages for links to PDFs.
The first thing I did was:
ls -R | grep .pdf > /tmp/dave_pdfs.outWhich generates a list of all of the PDFs on the server. For the sake of arguement, say it looks like... (8 Replies)
I have a file that is 20 - 80+ MB in size that is a certain type of log file.
It logs one of our processes and this process is multi-threaded. Therefore the log file is kind of a mess. Here's an example:
The logfile looks like: "DATE TIME - THREAD ID - Details", and a new file is created... (4 Replies)
I need help in the following script. I want to grep the sql errors insert into the error table and exit the shell script if there is any error, otherwise keep running the scripts.
Here is my script
#!/bin/csh -f
source .orapass
set user = $USER
set pass = $PASS
cd /opt/data/scripts
echo... (2 Replies)
Hi guys - below is my script that is checking for current file, size and timestamp.
However I added a "grep" feature in it (line in red), but not getting the desired result.
I am trying to acheive in output:
1. Show me the file name, timestamp, size and grep'ed words
It would be a... (2 Replies)
Hi all,
I have problem with searching hundreds of CSV files, the problem is that search is lasting too long (over 5min).
Csv files are "," delimited, and have 30 fields each line, but I always grep same 4 fields - so is there a way to grep just those 4 fields to speed-up search.
Example:... (11 Replies)
Hello everybody,
I'm still slowly treading my way into bash scripting (without any prior programming experience) and hence my code is mostly what some might call "creative" if they meant well :D
I have created a script that serves its purpose but it does so very slowly, since it needs to work... (4 Replies)
This is my first experience writing unix script. I've created the following script. It does what I want it to do, but I need it to be a lot faster. Is there any way to speed it up?
cat 'Tax_Provision_Sample.dat' | sort | while read p; do fn=`echo $p|cut -d~ -f2,4,3,8,9`; echo $p >> "$fn.txt";... (20 Replies)
Hi,
I've written a ksh script that read a file and parse/filter/format each line. The script runs as expected but it runs for 24+ hours for a file that has 2million lines. And sometimes, the input file has 10million lines which means it can be running for more than 2 days and still not finish.... (9 Replies)
Hello experts,
we have input files with 700K lines each (one generated for every hour). and we need to convert them as below and move them to another directory once.
Sample INPUT:-
# cat test1
1559205600000,8474,NormalizedPortInfo,PctDiscards,0.0,Interface,BG-CTA-AX1.test.com,Vl111... (7 Replies)
Discussion started by: prvnrk
7 Replies
LEARN ABOUT ULTRIX
newinv
newinv(1) General Commands Manual newinv(1)Name
newinv - update distribution kit master inventory
Syntax
/usr/sys/dist/newinv mi-file input-path
Description
The command interactively maintains the master inventory files used for producing distributions in format. The program updates the master
inventory for a product when changes are made to the hierarchy of files which are to be packaged in the subsets which constitute the prod-
uct.
The product hierarchy is scanned to produce a list of component path names relative to input-path. The list of path names is processed
against the mi-file to produce a list of those files which have been removed from the product hierarchy and a list of those files which
have been added.
The user is then given an opportunity to intervene and direct the inventory maintenance by editing these lists. The user is placed in the
editor with each list available for editing. The editor used is the one specified by the EDITOR environment variable. If EDITOR is not
set, is used. When editing the list of files which have been removed from the product, the user is expected to verify that the removals
were intentional, and confirm the intent by removing the associated record from the file. When editing the list of files which have been
added to the product, the user is expected to provide flags and subset information for each new file, transforming the elements of the list
into master inventory records.
Both of these lists are merged with the records for the files which have not been changed to produce a new copy of the master inventory
file.
Arguments
mi-file The pathname of the master inventory file to be processed. If no master inventory file exists, you must create an empty one
before using the command.
input-path The name of the product hierarchy to be scanned for files belonging in the inventory. All files and directories found below
the input-path will be processed as belonging in the inventory.
Restrictions
The default text editor if not specified in $EDITOR is
Files in the product hierarchy cannot be excluded from the master inventory. Files can be blocked from being kitted in the final distribu-
tion kit by setting the subset field of the master inventory record to NOSHIP.
Examples
To update the master inventory file ULT400.mi from the hierarchy beginning at /var/kits/input, type:
newinv ULT400.mi /var/kits/input
Diagnostics
newinv: where is mi-file?
The mi-file specified on the command line cannot be found.
input-path: bad directory.
The input-path directory specified on the command line does not exist.
Files
Backup copy of master inventory
The list of files missing from the product.
The list of files new to the product.
Intermediate join file.
List of all files in the product.
See Alsokits(1), vi(1), stl_mi(5), environ(7), setld(8)
Guide to Preparing Software for Distribution on ULTRIX Systems
newinv(1)