Sponsored Content
Top Forums Shell Programming and Scripting Scripting the process to edit a large file Post 302277594 by makkar4u on Friday 16th of January 2009 07:54:35 PM
Old 01-16-2009
Quote:
Originally Posted by cfajohnson

Did you copy the script exactly as I posted it? It works for me, including incrementing the version.



Do you get any error messages?

That is the best way to do it: send the output to a temporary file and mv or cp it to the original file.


Thanks Johnson for your earlier replies, but stucked again at one point. Script is running fine. Problem is if my db file is like:



version: yyyymmddrr
aaa
bbb
ccc
Include city London
ddd
eee
fff
Include city Sydney
.
.
more lines
.
..


now in this kind of db file, script is putting comment on all lines. but I need to put comment only on lines with "Include" but at the same time uncomment line matching city variable...

One last thing, I need to use this script in kind of a failover process in live production environment on large db files with around 1000 entries.

Thanks a lot in advance.

Last edited by makkar4u; 01-16-2009 at 10:10 PM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how to edit large files using vi

How to edit large file using vi where you can't increase /usr/var/tmp anymore? (3 Replies)
Discussion started by: nazri
3 Replies

2. Shell Programming and Scripting

Help to edit a large file

I am trying to edit a file that has 33k+ records. In this file I need to edit each record that has a 'Y' in the 107th position and change the 10 fields before the 'Y' to blanks. Not all records have a 'Y' in the 107th field. ex: ... (8 Replies)
Discussion started by: jxh461
8 Replies

3. Shell Programming and Scripting

what is the most effective way to process a large logfile?

I am dealing with a very large firewall logfile (more than 10G), the logfile like this *snip* Nov 9 10:12:01 testfirewall root: Nov 9 10:12:01 testfirewall root: 0:00:11 accept testfw01-hme0 >hme0 proto: icmp; src: test001.example.net; dst: abc.dst.net; rule: 1; icmp-type: 8;... (8 Replies)
Discussion started by: fedora
8 Replies

4. Shell Programming and Scripting

how to edit large file in unix

hi All, Plz let me know how to edit a file with 2000000 records. each record contains with 40 field seperated by |. i want modify 455487 record, but i am uable to edit this large file using vi editor in unix. plz let me know how to modify this file. Thanks in advance. -Bali Reddy (3 Replies)
Discussion started by: balireddy_77
3 Replies

5. Shell Programming and Scripting

Edit a large file in place

:confused:Folks, I have a file with 50 million records having 2 columns. I have to do the below: 1. Generate some random numbers of a fixed length. 2. Replace the second column of randomly chosen rows with the random numbers. I tried using a little bit of perl to generate random numbers... (6 Replies)
Discussion started by: mvijayv
6 Replies

6. Red Hat

Fork wait in background process - large delay

hi all, We are trying to run a process in the background and in the process we call fork ;and wait for the child process to finish .We find that the died = wait(&status); happens after 10 seconds randomly and sometimes completes in time (within 1 sec) This behavior is seen only when the... (1 Reply)
Discussion started by: vishnu.priya
1 Replies

7. Shell Programming and Scripting

How to edit a large file

Whenever I am trying to edit a file in unix with vi editor, I am getting the following error: <data> :Tmp file too large Is there any way that I can edit the file other than vi. Any help is really appreciated. Thanks (10 Replies)
Discussion started by: bobby1015
10 Replies

8. Shell Programming and Scripting

Process multiple large files with awk

Hi there, I'm camor and I'm trying to process huge files with bash scripting and awk. I've got a dataset folder with 10 files (16 millions of row each one - 600MB), and I've got a sorted file with all keys inside. For example: a sample_1 200 a.b sample_2 10 a sample_3 10 a sample_1 10 a... (4 Replies)
Discussion started by: camor
4 Replies

9. Shell Programming and Scripting

TCL scripting: errorInfo=integer value too large to represent

The username is of the format : 123456789110000-1234@something.com With this below TCL procedure, I am trying add first and Sec Id and get third Id. I checked in online compiler and it seems to work and add. However, when I am running this in my lab, I get error as "integer value too large to... (1 Reply)
Discussion started by: Shaibal_bp
1 Replies

10. Shell Programming and Scripting

TCL scripting: errorInfo=integer value too large to represent

The username is of the format : 123456789110000-1234@something.com With this below TCL procedure, I am trying add first and Sec Id and get third Id. I checked in online compiler and it seems to work and add. However, when I am running this in my lab, I get error as "integer value too large to... (3 Replies)
Discussion started by: Shaibal_bp
3 Replies
atfsit(1)							    ShapeTools								 atfsit(1)

NAME
atfsit - A program to prepare files for version control SYNOPSIS
atfsit [ -cFhfsmM ] [ -qad ] [ -Iflags ] [ -Rflags ] [ -tdirectory ] file1 ... DESCRIPTION
Atfsit is a semi-intelligent program to prepare files for ShapeTools version control. This involves putting the correct type of headings at the top of the file so that retrv will update a header and log changes in the file. By default, atfsit will use default headers ``hard-wired'' into itself for each different file type that it ``knows'' about. (See below for list of known file types). If the -tdirectory option is specified, then atfsit will use ``.template.suffix'' files (where ``suffix'' is a suffix that atfsit ``knows'' about) found in directory. If a directory name is not specified on the command line, then the environment variable TEMPLATES is used. If $TEMPLATES is not set, then the environment variable, HOME is tried. The following template files are recognized: Template NameFile Type --------------------------------------- .template.c Standard C .template.h C Include .template.f Fortran .template.shShell Script .template.makeMakefile .template.manManual Atfsit is ``semi-intelligent'' in that it can guess the type of headers to put in the file by the type of file (C program, C include, make- file, shell script, or manual). It determines the file type by looking at the name of the file. If the name of the file is ``Makefile'' or ``makefile'', then the file type is taken to be for make(1). The suffix after the last ``.'' in the file name is then used. The fol- lowing table shows the suffixes that atfsit knows about: Suffix File Type --------------------------------------------- c C Program F C Program (with compile flags) h C Include f Fortran mk Make(1) file sh Shell Script csh Shell Script [1-9] Manual (digits 1 - 9) If the environment variable ``ATFSDIR'' is present, then atfsit will attempt to make a link from it to ``AtFS'' in the current directory if the -I option is used and there is no directory called ``AtFS'' already, in the current directory. If the -I option is used and ``ATFS- DIR'' is not specified in the environment, then a normal directory called ``AtFS'' will be created. This feature can be overrided with the -d option. OPTIONS
c Force file type to be ``Standard C''. F Force file type to be ``Standard C''. Add a special header-line for recording of compile-time options in addition to the default header. The inserted line has the form static char *ConfFlg = CFFLGS. CFFLGS must be a string value. As it is very inconve- nient, to define the proper value of CFFLGS from the command-line, this feature is more intended to be used from within Make- files. h Force file type to be ``C Include''. f Force file type to be ``Fortran''. M Force file type to be ``Manual''. Note: If you also specify the ``Iflags'' option, atfsit will run vadm(1) to tell ShapeTools what kind of comment string to use for the manual file. s Force file type to be ``Shell Script''. m Force file type to be ``Makefile''. Note that this does the same thing as the -s option does. It just prints a different mes- sage. t Do not use any Template files for the headers. q Be quiet. Don't print out what is going on. Only error messages are printed. d Do not attempt to make the directory ``AtFS''. See above for more info. a Turn off auto guessing of file type. Iflags Check In file. Run save(1) on the file with ``flags'' being passed onto save(1) as the command line arguments. Rflags Run vadm(1) with ``flags'' as the command line arguments. FILES
/tmp/atfsit* - temporary buffer ~/.template.* - template files to use as the header. AUTHOR
Michael Cooper (mcooper@usc-oberon.ARPA) Modified for use with ShapeTools by Axel.Mahler@cs.tu-berlin.de SEE ALSO
save(1), vadm(1), retrv(1). DIAGNOSTICS
Complains about the usual stuff. (i.e. - the specified file doesn't exist, or it can't read it...just things like that.) atfsit-1.15 Tue Jun 29 16:29:16 1993 atfsit(1)
All times are GMT -4. The time now is 03:32 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy