Sponsored Content
Top Forums Shell Programming and Scripting Remove the footer from a flat file by searching a pattern Post 302560929 by gani_85 on Sunday 2nd of October 2011 01:22:33 PM
Old 10-02-2011
MySQL Remove the footer from a flat file by searching a pattern

Hi,
I have more than 30,000 records in a flat file. I want to remove footer from the file by searching a string pattern for the footer.
Example.... let the flat file test.dat contains below records.

record1
record2
record3
..
..
..
record31000
Total records 31000

I want to remove the last line ("Total records 31000") from the file by searching for the string "Total records". I want to modify the input file by removing the line, i don't want to use a separate file as output file due to the large size of the input file. please suggest me.

Thanks in advance.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to remove page breaks from a flat file???

Hi All, I get a flat file with its last field data splitting onto a new line.I got this program from Vgersh which when run would cancatenate the split data back to the end of the previous records.But this program fails when it encounters a page break between the split data and the previous... (5 Replies)
Discussion started by: kumarsaravana_s
5 Replies

2. Shell Programming and Scripting

Adding a footer to a flat file

I wanted to know if there is a way to add a footer to a flat file that is being extracted by a sql query. so if the query extracts 1000 rows, in the flat file it appends the last line as 1000. Is there a way to do so? Thanks (1 Reply)
Discussion started by: rudoraj
1 Replies

3. UNIX for Dummies Questions & Answers

how to remove the first line from a flat file ?

Hi, I want to remove the first line from a flat file using unix command as simple as possible. Can anybody give me a hand ? Thanks in advance. xli (21 Replies)
Discussion started by: xli
21 Replies

4. Shell Programming and Scripting

Searching a pattern in file and deleting th ewhole line containing the pattern

Hi All, Please can someone assist in the script I have made that searches a pattern in a file and delete the whole line containing the pattern. #!bin/sh # The pattern that user want to add to the files echo "Enter the pattern of the redirect" read value # check if the user has... (1 Reply)
Discussion started by: Shazin
1 Replies

5. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as... (3 Replies)
Discussion started by: mlpathir
3 Replies

6. Shell Programming and Scripting

Remove somewhat Duplicate records from a flat file

I have a flat file that contains records similar to the following two lines; 1984/11/08 7 700000 123456789 2 1984/11/08 1941/05/19 7 700000 123456789 2 The 123456789 2 represents an account number, this is how I identify the duplicate record. The ### signs represent... (4 Replies)
Discussion started by: jolney
4 Replies

7. UNIX for Dummies Questions & Answers

How to remove numeric characters in the flat file

HI, can any one help me please .. i have flat file like qwer123rt ass3242ccf jjk654 kjh838ppp nhdg453ok hdkk34 i want remove numeric characters in the flat file i want output like this qwerrt assccf jjk kjhppp nhdgok hdkk help me... (4 Replies)
Discussion started by: rafimd1985
4 Replies

8. Shell Programming and Scripting

Searching for pattern and remove the lines

Hi , I want to remove the specific pattern and remove those lines from file using shell script. i want to remove these lines <?xml version='1.0' encoding='UTF-8'?> <row_set> </row_set> my input file has content like this. file name: sample.xml <?xml version='1.0'... (4 Replies)
Discussion started by: nukala_2
4 Replies

9. UNIX for Advanced & Expert Users

Remove duplicates in flat file

Hi all, I have a issues while loading a flat file to the DB. It is taking much time. When analyzed i found out that there are duplicates entry in the flat file. There are 2 type of Duplicate entry. 1) is entire row is duplicate. ( i can use sort | uniq) to remove the duplicated entry. 2) the... (4 Replies)
Discussion started by: samjoshuab
4 Replies

10. Shell Programming and Scripting

Remove first NULL Character in Flat File

We have a flat file with below data : ^@^@^@^@00000305^@^@^@^@^@^@430^@430^@^@^@^@^@^@^@^@^@09079989530As we can see ^@ is Null character in this file I want to remove only the first few null characters before string 00000305 How can we do that, any idea. I want a new file without first few... (5 Replies)
Discussion started by: simpltyansh
5 Replies
acctprc(8)						      System Manager's Manual							acctprc(8)

NAME
acctprc1, acctprc2, accton - Perform process-accounting procedures SYNOPSIS
acctprc1 [InFile] acctprc2 accton [OutFile] DESCRIPTION
The three acctprc commands, acctprc1, acctprc2, and accton, are used in the runacct shell procedure to produce process-accounting reports. acctprc1 [InFile] The acctprc1 command is used to read records from standard input that are in a format defined by the acct structure in the /usr/include/sys/acct.h header file. This process adds the login names that correspond to user IDs, and then writes corresponding ASCII records to standard output. For each process, the record format includes the following seven unheaded columns: The user ID column includes both traditional and assigned user identification numbers listed in the /etc/passwd file. The login name is the one used for the user ID in the /etc/passwd file. The number of seconds the process consumed when executed during prime-time hours. Prime-time and nonprime-time hours are defined in the /usr/sbin/acct/holidays file. The number of seconds the process consumed when executed during nonprime-time hours. Total number of characters transferred. Total number of blocks read and written. Mean memory size (in kilobyte units). When specified, InFile contains a list of login sessions in a format defined by the utmp structure in the /usr/include/utmp.h header file. The login session records are sorted according to user ID and login name. When InFile is not specified, acctprc1 gets login names from the password file /etc/passwd. The information in InFile is used to distinguish different login names that share the same user ID. acctprc2 The acctprc2 command reads, from standard input, the records written by acctprc1, summarizes them according to user ID and name, and writes sorted summaries to standard output as total accounting records in the tacct format (see the acctmerg command). accton [OutFile] When no parameters are specified with the accton command, account processing is turned off. When you specify an existing OutFile file, process accounting is turned on, and the kernel adds records to that file. You must specify an Outfile to start process accounting. Many shell script procedures expect the file name /var/adm/pacct, the standard process-accounting file. EXAMPLES
To add a user name to each process-accounting record in a binary file and then write these modified binary-file records to an ASCII file named out.file, enter the following line to an accounting shell script: /usr/sbin/acct/acctprc1 < /var/adm/pacct >out.file A user name is added to each record. The raw data in the pacct file is converted to ASCII and added to file out.file. To produce a total binary accounting record of the ASCII output file out.file produced in example 1, enter the following line to an accounting shell script: /usr/sbin/acct/acctprc2 < out.file > /var/adm/acct/nite/daytacct The resulting binary total accounting file, written in the acct format, contains records sorted by user ID. This sorted user ID file, is usually merged with other total accounting records when an acctmerg command is processed to produce a daily summary accounting record called /var/adm/acct/sum/daytacct. To turn on process accounting, enter: /usr/sbin/acct/accton /var/adm/pacct To turn off process accounting, enter: /usr/sbin/acct/accton FILES
Specifies the command path. Specifies the command path. Specifies the command path. RELATED INFORMATION
Commands: acct(8), acctcms(8), acctmerg(8), runacct(8) Functions: acct(2) delim off acctprc(8)
All times are GMT -4. The time now is 04:38 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy