Splitting large file into multiple files in unix based on pattern
I need to write a shell script for below scenario
My input file has data in format:
the records are tab separated.
I want to read the input file, based on the last three characters of the first field
qwerty0101TWE i.e. TWE I want to put this record in file TWE.txt
thennext record mxz in MXZ.txt.
Like wise all TWE records in 1 file all MXZ records in one file.
Kindly help to write shell script for same. As i'm new to unix
Last edited by Franklin52; 07-02-2011 at 11:27 AM..
Reason: Please use code tags, thank you
Hello gurus,
I am new to "awk" and trying to break a large file having 4 million records into several output files each having half million but at the same time I want to keep the similar key records in the same output file, not to exist accross the files.
e.g. my data is like:
Row_Num,... (6 Replies)
Hi Experts,
I have to split huge file based on the pattern to create smaller files. The pattern which is expected in the file is:
Master.....
First...
second....
second...
third..
third...
Master...
First..
second...
third...
Master...
First...
second..
second..
second..... (2 Replies)
I am trying to update an older program on a small cluster. It uses individual files to send jobs to each node. However the newer database comes as one large file, containing over 10,000 records. I therefore need to split this file. It looks like this:
HMMER3/b
NAME 1-cysPrx_C
ACC ... (2 Replies)
I have a file in unix with sample data as follows :
--------------------------------------------------------------
--------------------------------------------------------------
{30001002|XXparameter|Layout|$
I want this file to be splitted into different files and corresponding to the sample... (54 Replies)
Help needed urgently please.
I have a large file - a few hundred thousand lines.
Sample
CP START ACCOUNT
1234556
name 1
CP END ACCOUNT
CP START ACCOUNT
2224444
name 1
CP END ACCOUNT
CP START ACCOUNT
333344444
name 1
CP END ACCOUNT
I need to split this file each time "CP START... (7 Replies)
I will simplify the explaination a bit, I need to parse through a 87m file -
I have a single text file in the form of :
<NAME>house........
SOMETEXT
SOMETEXT
SOMETEXT
.
.
.
.
</script>
MORETEXT
MORETEXT
.
.
. (6 Replies)
Hi there, I am pretty new to those things, so I couldn't figure out how to solve this, and if it is actually that easy. just found that awk could help:(.
so i have a textfile with strings and numbers (originally copy pasted from word, therefore some empty cells) in the following structure:
SC... (9 Replies)
Hi All,
This is my first post here. Hoping to share and gain knowledge from this great forum !!!!
I've scanned this forum before posting my problem here, but I'm afraid I couldn't find any thread that addresses this exact problem.
I'm trying to split a large XML file (with multiple tag... (7 Replies)
Hi,
I have the following reports that get generated every 1 hour and this is my requirement:
1. 5 reports get generated every hour with the names "Report.Dddmmyy.Thhmiss.CTLR"
"Report.Dddmmyy.Thhmiss.ACCD"
"Report.Dddmmyy.Thhmiss.BCCD"
"Report.Dddmmyy.Thhmiss.CCCD"... (1 Reply)
Hi All-I am new to Unix , I need to write a script. Can someone help me with a requirement where I have list of files in a directory, I want to Merge the files if a pattern of string matches in filenames?
AAAL_555A_ORANGE1_F190404.TXT
AAAL_555A_ORANGE2_F190404.TXT
AAAL_555A_ORANGE3_F190404.TXT... (6 Replies)
Discussion started by: Shankar455
6 Replies
LEARN ABOUT HPUX
acctdisk
acct(1M)acct(1M)NAME
acct: acctdisk, acctdusg, accton, acctwtmp, closewtmp, utmp2wtmp - overview of accounting and miscellaneous accounting commands
SYNOPSIS
file] file]
[file]
reason
DESCRIPTION
Accounting software is structured as a set of tools (consisting of both C programs and shell procedures) that can be used to build account-
ing systems. The shell procedures, described in acctsh(1M), are built on top of the C programs.
Connect time accounting is handled by various programs that write records into the The programs described in acctcon(1M) convert this file
into session and charging records which are then summarized by (see acctmerg(1M)).
Process accounting is performed by the HP-UX system kernel. Upon termination of a process, one record per process is written to a file
(normally The programs in acctprc(1M) summarize this data for charging purposes; is used to summarize command usage (see acctcms(1M)).
Current process data can be examined using (see acctcom(1M)).
Process accounting and connect time accounting (or any accounting records in the format described in acct(4)) can be merged and summarized
into total accounting records by (see the format in acct(4)). is used to format any or all accounting records (see acctsh(1M)).
reads lines that contain user ID, login name, and number of disk blocks, and converts them to total accounting records that can be merged
with other accounting records.
reads its standard input (usually from and computes disk resource consumption (including indirect blocks) by login. Only files found under
login directories (as determined from the password file) are accounted for. All files under a login directory are assumed to belong to
that user regardless of actual owner. If is given, records consisting of those file names for which charges no one are placed in file (a
potential source for finding users trying to avoid disk charges). If is given, file is the name of the password file. This option is not
needed if the password file is (See diskusg(1M) for more details.)
turns process accounting off if the optional file argument is omitted. If file is given, it must be the name of an existing file, to which
the kernel appends process accounting records (see acct(2) and acct(4)).
writes a utmp record to its standard output if the option is not used. If the option is used, writes a record to The record contains the
current time and a string of characters that describe the reason for writing the record. A record type of is assigned (see utmp(4) and
utmps(4)). The string argument reason must be 11 or fewer characters, numbers, or spaces if option is not used. Otherwise, it must be 63
or fewer characters, numbers, or spaces. For example, the following are suggestions for use in reboot and shutdown procedures, respec-
tively:
writes a record, for each user currently logged in, to the file This program is invoked by runacct to close the existing file before creat-
ing a new one.
writes a record, for each user currently logged in, to the file This program is invoked by runacct to initialize the newly created file.
FILES
Holds all accounting commands listed in section(1M) of this manual.
Current process accounting file.
Used for converting login name to user ID
Login/logoff history file.
New login/logoff history database.
SEE ALSO acctcms(1M), acctcom(1M), acctcon(1M), acctmerg(1M), acctprc(1M), acctsh(1M), diskusg(1M), fwtmp(1M), runacct(1M), acct(2), acct(4),
utmp(4). utmps(4), wtmps(4).
STANDARDS CONFORMANCE acct(1M)