Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Scripting the process to edit a large file
Top Forums Shell Programming and Scripting Scripting the process to edit a large file Post 302271621 by cfajohnson on Friday 26th of December 2008 05:37:18 PM
Old 12-26-2008

Code:
city=$1
date=$( date +%Y%m%d )

awk -v date=$date -v city="$city" '
/^Version:/ {
  serial = substr( $2, 9 )
  olddate = substr( $2, 1, 8 )
  if ( date == olddate ) ++serial
  else serial = 1
  printf "Version: %d%02d\n", date, serial
  next
}
{ gsub(/^;/,"") }
index($0, city) { print; next }
{ print ";" $0 }
' "$FILE"

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how to edit large files using vi

How to edit large file using vi where you can't increase /usr/var/tmp anymore? (3 Replies)
Discussion started by: nazri
3 Replies

2. Shell Programming and Scripting

Help to edit a large file

I am trying to edit a file that has 33k+ records. In this file I need to edit each record that has a 'Y' in the 107th position and change the 10 fields before the 'Y' to blanks. Not all records have a 'Y' in the 107th field. ex: ... (8 Replies)
Discussion started by: jxh461
8 Replies

3. Shell Programming and Scripting

what is the most effective way to process a large logfile?

I am dealing with a very large firewall logfile (more than 10G), the logfile like this *snip* Nov 9 10:12:01 testfirewall root: Nov 9 10:12:01 testfirewall root: 0:00:11 accept testfw01-hme0 >hme0 proto: icmp; src: test001.example.net; dst: abc.dst.net; rule: 1; icmp-type: 8;... (8 Replies)
Discussion started by: fedora
8 Replies

4. Shell Programming and Scripting

how to edit large file in unix

hi All, Plz let me know how to edit a file with 2000000 records. each record contains with 40 field seperated by |. i want modify 455487 record, but i am uable to edit this large file using vi editor in unix. plz let me know how to modify this file. Thanks in advance. -Bali Reddy (3 Replies)
Discussion started by: balireddy_77
3 Replies

5. Shell Programming and Scripting

Edit a large file in place

:confused:Folks, I have a file with 50 million records having 2 columns. I have to do the below: 1. Generate some random numbers of a fixed length. 2. Replace the second column of randomly chosen rows with the random numbers. I tried using a little bit of perl to generate random numbers... (6 Replies)
Discussion started by: mvijayv
6 Replies

6. Red Hat

Fork wait in background process - large delay

hi all, We are trying to run a process in the background and in the process we call fork ;and wait for the child process to finish .We find that the died = wait(&status); happens after 10 seconds randomly and sometimes completes in time (within 1 sec) This behavior is seen only when the... (1 Reply)
Discussion started by: vishnu.priya
1 Replies

7. Shell Programming and Scripting

How to edit a large file

Whenever I am trying to edit a file in unix with vi editor, I am getting the following error: <data> :Tmp file too large Is there any way that I can edit the file other than vi. Any help is really appreciated. Thanks (10 Replies)
Discussion started by: bobby1015
10 Replies

8. Shell Programming and Scripting

Process multiple large files with awk

Hi there, I'm camor and I'm trying to process huge files with bash scripting and awk. I've got a dataset folder with 10 files (16 millions of row each one - 600MB), and I've got a sorted file with all keys inside. For example: a sample_1 200 a.b sample_2 10 a sample_3 10 a sample_1 10 a... (4 Replies)
Discussion started by: camor
4 Replies

9. Shell Programming and Scripting

TCL scripting: errorInfo=integer value too large to represent

The username is of the format : 123456789110000-1234@something.com With this below TCL procedure, I am trying add first and Sec Id and get third Id. I checked in online compiler and it seems to work and add. However, when I am running this in my lab, I get error as "integer value too large to... (1 Reply)
Discussion started by: Shaibal_bp
1 Replies

10. Shell Programming and Scripting

TCL scripting: errorInfo=integer value too large to represent

The username is of the format : 123456789110000-1234@something.com With this below TCL procedure, I am trying add first and Sec Id and get third Id. I checked in online compiler and it seems to work and add. However, when I am running this in my lab, I get error as "integer value too large to... (3 Replies)
Discussion started by: Shaibal_bp
3 Replies

LEARN ABOUT DEBIAN

blt_treenodeid

Blt_TreeNodeId(3)					      BLT Library Procedures						 Blt_TreeNodeId(3)

__________________________________________________________________________________________________________________________________________________

NAME

       Blt_TreeNodeId - Returns the node serial number.

SYNOPSIS

       #include <bltTree.h>

       unsigned int
       Blt_TreeNodeId(node)

ARGUMENTS

       Blt_TreeNode   node   (in)      Node whose ID is to be returned.
_________________________________________________________________

DESCRIPTION

       This  procedure	returns the node serial number.  The node serial number is useful for programs that export the tree data object to the Tcl
       programming level.  Since node labels (and therefore pathnames) are not unique, the ID can be used to uniquely identify a node.

       The arguments are as follows:

       node	 The node whose serial number is returned.  The serial number of the root node for example is always 0.

RETURNS

       The serial number of the node.  Nodes are given a unique serial number when they are created.  You can use the ID  to  later  retrieve  the
       node using Blt_TreeGetNode.

EXAMPLE

       The following example prints the ID of a node.

	      printf("root ID is %s
", Blt_TreeNodeId(node));

KEYWORDS

       Tcl_TreeCreateNode, Tcl_TreeDeleteNode

BLT
									2.4							 Blt_TreeNodeId(3)
All times are GMT -4. The time now is 10:57 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy