Sponsored Content
Top Forums Shell Programming and Scripting Scripting the process to edit a large file Post 302271621 by cfajohnson on Friday 26th of December 2008 05:37:18 PM
Old 12-26-2008

Code:
city=$1
date=$( date +%Y%m%d )

awk -v date=$date -v city="$city" '
/^Version:/ {
  serial = substr( $2, 9 )
  olddate = substr( $2, 1, 8 )
  if ( date == olddate ) ++serial
  else serial = 1
  printf "Version: %d%02d\n", date, serial
  next
}
{ gsub(/^;/,"") }
index($0, city) { print; next }
{ print ";" $0 }
' "$FILE"

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how to edit large files using vi

How to edit large file using vi where you can't increase /usr/var/tmp anymore? (3 Replies)
Discussion started by: nazri
3 Replies

2. Shell Programming and Scripting

Help to edit a large file

I am trying to edit a file that has 33k+ records. In this file I need to edit each record that has a 'Y' in the 107th position and change the 10 fields before the 'Y' to blanks. Not all records have a 'Y' in the 107th field. ex: ... (8 Replies)
Discussion started by: jxh461
8 Replies

3. Shell Programming and Scripting

what is the most effective way to process a large logfile?

I am dealing with a very large firewall logfile (more than 10G), the logfile like this *snip* Nov 9 10:12:01 testfirewall root: Nov 9 10:12:01 testfirewall root: 0:00:11 accept testfw01-hme0 >hme0 proto: icmp; src: test001.example.net; dst: abc.dst.net; rule: 1; icmp-type: 8;... (8 Replies)
Discussion started by: fedora
8 Replies

4. Shell Programming and Scripting

how to edit large file in unix

hi All, Plz let me know how to edit a file with 2000000 records. each record contains with 40 field seperated by |. i want modify 455487 record, but i am uable to edit this large file using vi editor in unix. plz let me know how to modify this file. Thanks in advance. -Bali Reddy (3 Replies)
Discussion started by: balireddy_77
3 Replies

5. Shell Programming and Scripting

Edit a large file in place

:confused:Folks, I have a file with 50 million records having 2 columns. I have to do the below: 1. Generate some random numbers of a fixed length. 2. Replace the second column of randomly chosen rows with the random numbers. I tried using a little bit of perl to generate random numbers... (6 Replies)
Discussion started by: mvijayv
6 Replies

6. Red Hat

Fork wait in background process - large delay

hi all, We are trying to run a process in the background and in the process we call fork ;and wait for the child process to finish .We find that the died = wait(&status); happens after 10 seconds randomly and sometimes completes in time (within 1 sec) This behavior is seen only when the... (1 Reply)
Discussion started by: vishnu.priya
1 Replies

7. Shell Programming and Scripting

How to edit a large file

Whenever I am trying to edit a file in unix with vi editor, I am getting the following error: <data> :Tmp file too large Is there any way that I can edit the file other than vi. Any help is really appreciated. Thanks (10 Replies)
Discussion started by: bobby1015
10 Replies

8. Shell Programming and Scripting

Process multiple large files with awk

Hi there, I'm camor and I'm trying to process huge files with bash scripting and awk. I've got a dataset folder with 10 files (16 millions of row each one - 600MB), and I've got a sorted file with all keys inside. For example: a sample_1 200 a.b sample_2 10 a sample_3 10 a sample_1 10 a... (4 Replies)
Discussion started by: camor
4 Replies

9. Shell Programming and Scripting

TCL scripting: errorInfo=integer value too large to represent

The username is of the format : 123456789110000-1234@something.com With this below TCL procedure, I am trying add first and Sec Id and get third Id. I checked in online compiler and it seems to work and add. However, when I am running this in my lab, I get error as "integer value too large to... (1 Reply)
Discussion started by: Shaibal_bp
1 Replies

10. Shell Programming and Scripting

TCL scripting: errorInfo=integer value too large to represent

The username is of the format : 123456789110000-1234@something.com With this below TCL procedure, I am trying add first and Sec Id and get third Id. I checked in online compiler and it seems to work and add. However, when I am running this in my lab, I get error as "integer value too large to... (3 Replies)
Discussion started by: Shaibal_bp
3 Replies
EFA(1p) 						User Contributed Perl Documentation						   EFA(1p)

NAME
efa - unofficial efa.vrr.de command line client SYNOPSIS
efa --from city stop --to city stop [ additional options ] efa [ options ] from-city from-stop [ via-city via-stop ] to-city to-stop VERSION
version 2.01 DESCRIPTION
efa is a command line client for the <http://efa.vrr.de> web interface. It sends the specified information to the online form and displays the results. It should be noted that efa, although using the web interface of a local transport association, is able to look up connections all over Germany. OPTIONS
--from city stop Departure place --to city stop Arrival place --via city stop Travel via this place In case you want stop to be an address or "point of interest", you can set it to 'addr:something' or 'poi:something'. -t|--time|--depart hh:mm Journey start time -a|--arrive hh:mm Journey end time (overrides --time/--depart) -d|--date dd.mm.[yyyy] Journey date -b|--bike Choose connections allowing to carry a bike -e|--exclude transports Exclude transports (comma separated list). Possible transports: zug, s-bahn, u-bahn, stadtbahn, tram, stadtbus, regionalbus, schnellbus, seilbahn, schiff, ast, sonstige -E|--extended-info Display duration, ticket class and price for each route (if available) -m|--max-change number Print connections with at most number interchanges -P|--prefer type Prefer connections of type: o speed (default) The faster, the better o nowait Prefer connections with less interchanges o nowalk Prefer connections with less walking (at interchanges) -p|--proximity Take stops close to the stop/start into account and possibly use them instead -i|--include type Include connections using trains of type type, where type may be: o local (default) only take local trains ("Verbund-/Nahverkehrslinien"). Slow, but the cheapest method if you're not travelling long distance o ic Local trains + IC o ice All trains (local + IC + ICE) -w|--walk-speed speed Set your walking speed to speed. Accepted values: normal (default), fast, slow -I|--ignore-info [ regex ] Ignore additional information matching regex (default: /Fahrradmitnahme/) If regex is not supplied, removes the default regex (-> nothing will be ignored) --timeout seconds Set timeout for HTTP requests. Default: 60 seconds. --post key=value Add key with value to the HTTP POST request sent to the EFA server. This can be used to use setting efa does not yet cover, like "--post lineRestriction=400" to also show IC and ICE trains. Note that --post will be overridden by the standard efa options, such as --time -v|--version Print version information EXIT STATUS
0 Everything went well 1 Invalid arguments, see error message 2 Network error, unable to send request 3 efa.vrr.de did not return any parsable data 4 efa.vrr.de error: ambiguous input 5 efa.vrr.de error: no connections found 10 Unknown Travel::Routing::DE::VRR error 255 Other internal error CONFIGURATION
None. DEPENDENCIES
This script requires perl 5.10 (or higher) with the following modules: o Class::Accessor o Exception::Class o LWP::UserAgent o XML::LibXML BUGS AND LIMITATIONS
efa cannot handle Unicode in its arguments, use plain ASCII. AUTHOR
Copyright (C) 2009,2010 by Daniel Friesel <derf@derf.homelinux.org> LICENSE
0. You just DO WHAT THE FUCK YOU WANT TO. perl v5.14.2 2012-01-28 EFA(1p)
All times are GMT -4. The time now is 07:49 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy