Sponsored Content
Top Forums UNIX for Beginners Questions & Answers awk solution for Splitting a file. Post 303036753 by Scrutinizer on Wednesday 10th of July 2019 12:11:17 PM
Old 07-10-2019
Slight correction to Ravinder's suggestion:
Code:
awk '/^sdg-catalog/{close(file);file=$0;next} {print > file}'  Input_file

These 2 Users Gave Thanks to Scrutinizer For This Post:
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Help with splitting lines in a file using awk

I have a file which is one big long line of text about 10Kb long. Can someone provide a way using awk to introduce carriage returns every 40 chars in this file. Any other solutions would also be welcome. Thank you in advance. (5 Replies)
Discussion started by: martinbarretto
5 Replies

2. Shell Programming and Scripting

splitting tab-delimited file with awk

Hi all, I need help to split a tab-delimited list into separate files by the filename-field. The list is already sorted ascendingly by filename, an example list would look like this; filename001 word1 word2 filename001 word3 word4 filename002 word1 word2 filename002 word3 word4... (4 Replies)
Discussion started by: perkele
4 Replies

3. Shell Programming and Scripting

Looking for AWK Solution for column comparison in a single file

- I am looking for different kind of awk solution which I don't think is mentioned before in these forums. Number of rows in the file are fixed Their are two columns in file1.txt 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 10 I am looking for 3... (1 Reply)
Discussion started by: softwarekids23
1 Replies

4. Shell Programming and Scripting

Splitting a complex file using awk

I have a file that contains the following format delete from table1; delete from table2; insert into table1 (col1, col2) values (value1, value2)@ insert into table1 (col1, col2) values(value3, value4)@ insert into table2(col1, col2,col3) values(value1, value2, value3)@ etc etc This is... (9 Replies)
Discussion started by: hukcjv
9 Replies

5. Shell Programming and Scripting

Adding header to sub files after splitting the main file using AWK

Hi Folks, I have a file like: mainfile.txt: ------------- file1 abc def xyz file1 aaa pqr xyz file2 lmn ghi xyz file2 bbb tuv xyz I need output having two files file1 and file2. file1: ------ Name State Country abc def xyz aaa pqr xyz file2: (3 Replies)
Discussion started by: tanmay.gemini
3 Replies

6. Shell Programming and Scripting

awk for splitting file in constant chunks

Hi gurus, I wanted to split main file in 20 files with 2500 lines in each file. My main file conatins total 2500*20 lines. Following awk I made, but it is breaking with error. awk '{ for (i = 1; i <= 20; i++) { starts=2500*$i-1; ends=2500*$i; NR>=starts && NR<=ends {f=My$i".txt"; print >> f;... (10 Replies)
Discussion started by: mukesh.lalwani
10 Replies

7. Shell Programming and Scripting

Splitting file using awk

I have file with below content FG1620000|20000 FG1623000|23000 FG1625000|25000 FG1643894|43894 FG1643895|43895 FG1643896|43896 FG1643897|43897 FG1643898|43898 My aim is to split the above file into two files based on the value in the second field. If the value in second field is... (2 Replies)
Discussion started by: anijan
2 Replies

8. Shell Programming and Scripting

Splitting the file using awk

Hi, I have a requirement in which I am going to receive one file and should be splitted to 9 different files based on one distinguisher called TYPE. I heard that this can be done using awk or sed. Can any one advise regardint the logic and simpler way other than using awk or sed is also... (15 Replies)
Discussion started by: sagar.cumar
15 Replies

9. Shell Programming and Scripting

Splitting fixed length file using awk

Hi, I need to split a fixed length file of 160 characters based on value of a column. Example: ABC 456780001 DGDG SDFSF BCD 444440002 SSSS TTTTT ABC 777750003 HHHH UUUUU THH 888880001 FFFF LLLLLL HHH 999990002 GGGG OOOOO I need to split this file on basis of column from... (7 Replies)
Discussion started by: Neelkanth
7 Replies

10. Shell Programming and Scripting

Splitting a text file into smaller files with awk, how to create a different name for each new file

Hello, I have some large text files that look like, putrescine Mrv1583 01041713302D 6 5 0 0 0 0 999 V2000 2.0928 -0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 5.6650 0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 3.5217 ... (3 Replies)
Discussion started by: LMHmedchem
3 Replies
BTREPLAY(8)															       BTREPLAY(8)

NAME
btreplay - recreate IO loads recorded by blktrace SYNOPSIS
btreplay [ options ] <dev...> DESCRIPTION
The btrecord and btreplay tools provide the ability to record and replay IOs captured by the blktrace utility. Attempts are made to main- tain ordering, CPU mappings and time-separation of IOs. The blktrace utility provides the ability to collect detailed traces from the kernel for each IO processed by the block IO layer. The traces provide a complete timeline for each IO processed, including detailed information concerning when an IO was first received by the block IO layer -- indicating the device, CPU number, time stamp, IO direction, sector number and IO size (number of sectors). Using this information, one is able to replay the IO again on the same machine or another set up entirely. The basic operating work-flow to replay IOs would be something like: - Run blktrace to collect traces. Here you specify the device or devices that you wish to trace and later replay IOs upon. Note: the only traces you are interested in are QUEUE requests -- thus, to save system resources (including storage for traces), one could specify the -a queue command line option to blktrace. - While blktrace is running, you run the workload that you are interested in. - When the work load has completed, you stop the blktrace utility (thus saving all traces over the complete workload). - You extract the pertinent IO information from the traces saved by blktrace using the btrecord utility. This will parse each trace file created by blktrace, and crafty IO descriptions to be used in the next phase of the workload processing. - Once btrecord has successfully created a series of data files to be processed, you can run the btreplay utility which attempts to generate the same IOs seen during the sample workload phase. OPTIONS
-c <num> --cpus=<num> Set number of CPUs to use. -d <dir> --input-directory=<dir> Set input directory. This option requires a single parameter providing the directory name for where input files are to be found. The default directory is the current directory (.). -F --find-records Find record files automatically This option instructs btreplay to go find all the record files in the directory specified (either via the -d option, or in the default directory (.). -h --help Show help and exit. -i <basename> --input-base=<basename> Set base name for input files. Each input file has 3 fields: 1. Device identifier (taken directly from the device name of the blktrace output file). 2. btrecord base name -- by default ``replay''. 3. The CPU number (again, taken directly from the blktrace output file name). This option requires a single parameter that will override the default name (replay), and replace it with the specified value. -I <num> --iterations=<num> Set number of iterations to run. This option requires a single parameter which specifies the number of times to run through the input files. The default value is 1 -M <filename> --map-devs=<filename> Specify device mappings. This option requires a single parameter which specifies the name of a file contain device mappings. The file must be very simply managed, with just two pieces of data per line: - The device name on the recorded system (with the '/dev/' removed). Example: /dev/sda would just be sda. - The device name on the replay system to use (again, without the '/dev/' path prepended). An example file for when one would map devices /dev/sda and /dev/sdb on the recorded system to dev/sdg and sdh on the replay system would be: sda sdg sdb sdh The only entries in the file that are allowed are these two element lines -- we do not (yet?) support the notion of blank lines, or comment lines, or the like. The utility allows for multiple -M options to be supplied on the command line. -N --no-stalls Disable pre-bunch stalls. When specified on the command line, all pre-bunch stall indicators will be ignored. IOs will be replayed without inter-bunch delays. -x <factor> --acc-factor=<factor> Specify acceleration factor. Default value is 1 (no acceleration). -v --verbose Enable verbose output. When specified on the command line, this option instructs btreplay to store information concerning each stall and IO operation performed by btreplay. The name of each file so created will be the input file name used with an extension of .rep appended onto it. Thus, an input file of the name sdab.replay.3 would generate a verbose output file with the name sdab.replay.3.rep in the directory specified for input files. In addition, btreplay will also output to stderr the names of the input files being processed. -V --version Show version number and exit. -W --write-enable Enable writing during replay. As a precautionary measure, by default btreplay will not process write requests. In order to enable btreplay to actually write to devices one must explicitly specify the -W option. AUTHORS
btreplay was written by Alan D. Brunelle. This man page was created from the btreplay documentation by Bas Zoetekouw. REPORTING BUGS
Report bugs to <linux-btrace@vger.kernel.org> COPYRIGHT
Copyright (C) 2007 Alan D. Brunelle, Alan D. Brunelle and Nathan Scott. This is free software. You may redistribute copies of it under the terms of the GNU General Public License <http://www.gnu.org/licenses/gpl.html>. There is NO WARRANTY, to the extent permitted by law. This manual page was created for Debian by Bas Zoetekouw. It was derived from the documentation provided by the authors and it may be used, distributed and modified under the terms of the GNU General Public License, version 2. On Debian systems, the text of the GNU General Public License can be found in /usr/share/common-licenses/GPL-2. SEE ALSO
The full documentation for btreplay can be found in /usr/share/doc/blktrace on Debian systems. blktrace (8), blkparse (1), btrecord (8) blktrace git-20071207142532 December 8, 2007 BTREPLAY(8)
All times are GMT -4. The time now is 06:53 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy