awk : split file and rename and save in path according to content
Hello,
I'm using Windows 7 ; sed, awk and gnuwin32 are installed.
I have a big text file I need to manipulate.
In short, I will have to split it in thousands of short files, then rename and save in a folder which name is based upon filename.
Here is a snippet of my big input.txt file (this pattern is repeated 70k times) :
Code:
ctime=1041379201
version=text text
name=Bob.2111
targets=text text
title=text text
description=long text ending with[[#source_]]
As of now, I know how to split it with awk :
Code:
awk "/ctime/{x="F"++i;}{print > x;}" input.txt
Yet I dont know how to drive awk in renaming files.
In every splitted file, there is a line (line number 3 of the splitted file) which says the name of the expected file. In showed snippet, it is : name=Bob.2111.
I expect to have about 70k files named like Bob.[0-9]+ (no extension).
My question number one is : is awk able to do that ? is awk able to catch a value in current file according to some pattern for renaming the splitted files ? I did not find anwser yet. Most examples order awk to use a name which doesnt come from the manipulated file.
My question number two is : is awk also able to save the splitted files in a constructed path, according to content ?
I want all splitted files containing Bob.1[0-9]+ to be saved in folder 1/ ; all Bob.2[0-9]+ to be saved in folder 2/, etc., for limiting the quantity of files per folder (using first number of numerical id).
I guess I need to catch every Bob.[0-9]+ in a variable $1.
Thus I may use this variable for (1) renaming files and (2) for moving files
If Bob.2111 is $1, I would like to save file like that {substring $1,4,20}/$1 which would give 2/Bob.2111.
As you can guess, I'm not expert
Thank you.
Last edited by sellig; 03-07-2015 at 01:18 PM..
Reason: typo
Hi,
I have a file which contains records of data.
I need to split the file into multiple files depending upon the value of last field.
How do i read the last field of each record in the file???
Regards,
Chaitrali (4 Replies)
Hi All,
I have a requirement .I want to split a file and the split files should have certain names.
Currently when i use the split command
split -1000 testdata testdata_
Then the output is
testdata_aa
testdata_bb
testdata_cc
and so on.
But i want the output as
testdata1.snd... (3 Replies)
I have a file test1.html like below:
<dctm_topnav_en_US>
<html>
.....
</html>
<dctm_topnav_en_CA>
<html>
.....
</html>
<dctm_topnav_en_FR>
<html>
.....
</html>
I need to use awk to split this into three file names like en_US.html ,
en_CA.html, en_FR.html each having content between... (4 Replies)
Hi All;
I have input file like below
name char(3)
number number(3)
inputfile
namenumber
xyz123abc509kai330
aca203
ald390afa000als303
I wanted to split like below:-
output like this:-
xyz123
abc509
kai330
aca203
ald390 (6 Replies)
Arun kumar something somehting Enterting in to the line
.
.
.
.
Some text text Finshing the sentence
Some other text
.
.
.
.
Again something somehting Enterting in to the line
.
.
.
.
.
.
Again text text Finshing the sentence (6 Replies)
Hi
I have a large text file and I want to split its content into multiple flies.
this large file contains several blocks of codes separated by a comment line for each block.
this comment line represents a directory path
So, when separate these blocks each into a separate file, This output... (7 Replies)
Hi All,
When i use sort Test, here is the output:
$ sort Test
a
b
b
c
d
e
f
g
h
i
But the contents in the file remain unsorted, how to do that?
]$ cat Test
g
i (6 Replies)
Hi,
Right now there is a file called 'qm.ini' which is owned by mqm:mqm and I am trying to replace a line from this file with something else and save.
I am using the below perl command to replace and save within a shell script with a different user called 'mqadm' which is also part of mqm... (1 Reply)
Discussion started by: bdpl
1 Replies
LEARN ABOUT DEBIAN
rmm
RMM(1) [nmh-1.5] RMM(1)NAME
rmm - remove messages
SYNOPSIS
rmm [+folder] [msgs] [-unlink | -nounlink] [-version] [-help]
DESCRIPTION
By default, rmm will remove the specified messages by renaming each of the message files with a site-dependent prefix (usually a comma).
Such files will then need to be removed in some manner after a certain amount of time. Many sites arrange for cron to remove these files
once a day, so check with your system administrator.
Alternately, if you wish for rmm to really remove the files representing these messages, you can use the -unlink switch. But messages
removed by this method cannot be later recovered.
If you prefer a more sophisticated method of `removing' messages, you can define the rmmproc profile component. For example, you can add a
profile component such as
rmmproc: /home/foouser/bin/rmm_msgs
then instead of simply renaming the message file, rmm will call the named program or script to handle the files that represent the messages
to be deleted.
Some users of csh prefer the following:
alias rmm 'refile +d'
where folder `+d' is a folder for deleted messages, and
alias mexp 'rm `mhpath +d all`'
is used to "expunge" deleted messages.
The current message is not changed by rmm, so a next
will advance to the next message in the folder as expected.
FILES
$HOME/.mh_profile The user profile
PROFILE COMPONENTS
Path: To determine the user's nmh directory
Current-Folder: To find the default current folder
rmmproc: Program to delete the message
SEE ALSO refile(1), rmf(1)DEFAULTS
`+folder' defaults to the current folder
`msgs' defaults to cur
`-nounlink'
CONTEXT
If a folder is given, it will become the current folder.
BUGS
Since refile uses your rmmproc to delete the message, the rmmproc must NOT call refile without specifying -normmproc, or you will create an
infinte loop.
MH.6.8 11 June 2012 RMM(1)
03-07-2015
