Splitting large file into multiple files in unix based on pattern
I need to write a shell script for below scenario
My input file has data in format:
the records are tab separated.
I want to read the input file, based on the last three characters of the first field
qwerty0101TWE i.e. TWE I want to put this record in file TWE.txt
thennext record mxz in MXZ.txt.
Like wise all TWE records in 1 file all MXZ records in one file.
Kindly help to write shell script for same. As i'm new to unix
Last edited by Franklin52; 07-02-2011 at 11:27 AM..
Reason: Please use code tags, thank you
Hello gurus,
I am new to "awk" and trying to break a large file having 4 million records into several output files each having half million but at the same time I want to keep the similar key records in the same output file, not to exist accross the files.
e.g. my data is like:
Row_Num,... (6 Replies)
Hi Experts,
I have to split huge file based on the pattern to create smaller files. The pattern which is expected in the file is:
Master.....
First...
second....
second...
third..
third...
Master...
First..
second...
third...
Master...
First...
second..
second..
second..... (2 Replies)
I am trying to update an older program on a small cluster. It uses individual files to send jobs to each node. However the newer database comes as one large file, containing over 10,000 records. I therefore need to split this file. It looks like this:
HMMER3/b
NAME 1-cysPrx_C
ACC ... (2 Replies)
I have a file in unix with sample data as follows :
--------------------------------------------------------------
--------------------------------------------------------------
{30001002|XXparameter|Layout|$
I want this file to be splitted into different files and corresponding to the sample... (54 Replies)
Help needed urgently please.
I have a large file - a few hundred thousand lines.
Sample
CP START ACCOUNT
1234556
name 1
CP END ACCOUNT
CP START ACCOUNT
2224444
name 1
CP END ACCOUNT
CP START ACCOUNT
333344444
name 1
CP END ACCOUNT
I need to split this file each time "CP START... (7 Replies)
I will simplify the explaination a bit, I need to parse through a 87m file -
I have a single text file in the form of :
<NAME>house........
SOMETEXT
SOMETEXT
SOMETEXT
.
.
.
.
</script>
MORETEXT
MORETEXT
.
.
. (6 Replies)
Hi there, I am pretty new to those things, so I couldn't figure out how to solve this, and if it is actually that easy. just found that awk could help:(.
so i have a textfile with strings and numbers (originally copy pasted from word, therefore some empty cells) in the following structure:
SC... (9 Replies)
Hi All,
This is my first post here. Hoping to share and gain knowledge from this great forum !!!!
I've scanned this forum before posting my problem here, but I'm afraid I couldn't find any thread that addresses this exact problem.
I'm trying to split a large XML file (with multiple tag... (7 Replies)
Hi,
I have the following reports that get generated every 1 hour and this is my requirement:
1. 5 reports get generated every hour with the names "Report.Dddmmyy.Thhmiss.CTLR"
"Report.Dddmmyy.Thhmiss.ACCD"
"Report.Dddmmyy.Thhmiss.BCCD"
"Report.Dddmmyy.Thhmiss.CCCD"... (1 Reply)
Hi All-I am new to Unix , I need to write a script. Can someone help me with a requirement where I have list of files in a directory, I want to Merge the files if a pattern of string matches in filenames?
AAAL_555A_ORANGE1_F190404.TXT
AAAL_555A_ORANGE2_F190404.TXT
AAAL_555A_ORANGE3_F190404.TXT... (6 Replies)
Discussion started by: Shankar455
6 Replies
LEARN ABOUT DEBIAN
shelr
SHELR(1)SHELR(1)NAME
shelr - screencasting for shell ninjas
DESCRIPTION
Shelr records terminal output and can replay it.
Also you can shere Your records at http://shelr.tv/ or other services.
SYNOPSIS
shelr command [id]
COMMANDS
record Will record your terminal unless you type exit or Ctrl+D and store it to $HOME/.local/share/shelr/
list lists all your shellcasts.
play plays local or remote shellcast.
push publish your shellcast
dump dump shellcast as json to current directory.
EXAMPLES
Record your shellcast:
$ shelr record
$ # do something ...
$ exit
List recorded shellcasts:
$ shelr list
Play local shellcast:
$ shelr play 1293702847 # play your own local record
$ shelr play record.json # created with shelr dump
$ shelr play last # will play most recent local record
Play remote shellcast:
$ shelr play http://shelr.tv/records/4d1f7c3890820d6144000002.json
Publish your shellcast:
$ shelr push 1293702847
$ shelr push last # will push most recent local record
Setup recording backend:
$ shelr backend script
$ shelr backend ttyrec
BUGS
Windows heh.
COPYRIGHT
(C) 2010, 2011, 2012 Antono Vasiljev self@antono.info
Licensed under GPLv3+
SEE ALSO script(1), scriptreplay(1), ttyrec(1), ttyplay(1)
April 2012 SHELR(1)