02-13-2017
For scenario wherein the file has around 20 million records and size is around 3 GB, the split kept on running for more than 10 minutes and hence I had to close the session as this benchmark was unacceptable.
And I am reading and writing to the same disk. For the disk speed part, I am a bit novice in unix so have to do a little search for that.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a directory of files that I need to rename by splitting the first and second halves of the filenames using the delimiter "-O" and then renaming with the second half first, followed by two underscores and then the first half. For example, natfinal1995annvol1_14.pdf -O filenum-20639 will be... (2 Replies)
Discussion started by: swimulator
2 Replies
2. Shell Programming and Scripting
Hi,
can some one please help me to split the file based on groups.
like in the below scenario x indicates the begining of the group and the file should be split each with 2 groups below there are 10 groups it should create 5 files. could you please help? (4 Replies)
Discussion started by: hitmansilentass
4 Replies
3. Shell Programming and Scripting
Here is my source, i have million lines like this on a file.
disp0201.php?poc=4060&roc=1&ps=R&ooc=13&mjv=6&mov=5&rel=5&bod=155&oxi=2&omj=5&ozn=1&dav=20&cd=&daz=& drc=&mo=&sid=&lang=EN&loc=JPN
I want to split this into columns in order to load in database, anything starts with"&mjv=6" as first... (13 Replies)
Discussion started by: elamurugu
13 Replies
4. Shell Programming and Scripting
Hi,
My inputfile contains field separaer is ^.
12^inms^
13^fakdks^ssk^s3
23^avsd^
13^fakdks^ssk^a4
I wanted to print only 2 delimiter occurence i.e
12^inms^
23^avsd^ (4 Replies)
Discussion started by: Jairaj
4 Replies
5. Shell Programming and Scripting
KSH
HP-SOL-Lin
Cannot use xAWK
I have several strings that are quite long and i want to break them down into smaller substrings.
What I have
String = "word1 word2 word3 word4 .....wordx"
What I want
String1="word1 word2"
String2="word 3 word4"
String3="word4 word5"
Stringx="wordx... (5 Replies)
Discussion started by: nitrobass24
5 Replies
6. Shell Programming and Scripting
Hi all.
I've tried searching the web but could not find similar problem to mine.
I have one large file to be splitted into several files based on the matching pattern found in each row.
For example, let's say the file content:
... (13 Replies)
Discussion started by: aimy
13 Replies
7. Shell Programming and Scripting
i have below code to count number of rows in file1.txt, if the row count is more than one then i have sending an email along with file1.txt attached and fail the process(do nothing if count is <=1),
if I test individually count part works good but when i include the email part its not working,... (1 Reply)
Discussion started by: srini_106
1 Replies
8. Shell Programming and Scripting
Hi
I want to check delimiter in file. Delimiter in my file is ~|*
sample of file :
ABC~|*edgf~|*T1J333~|*20121130
ABC~|*sdaf~|*T1J333~|*20121130
ABC~|*fsdg~|*T1J333~|*20121130
ABC~|*dfsg~|*T1J333~|*20121130
in this i want to count number delimiter occur is 4 in each row if count is... (21 Replies)
Discussion started by: MOHANP12
21 Replies
9. Shell Programming and Scripting
Greetings Experts,
I am generating a validation query through awk and facing an issue, which I need to overcome by splitting the data based on the pattern matching count in the value of an array.
File1 --
Table11@column1@date@Table21@column1@varchar(10)@d;... (4 Replies)
Discussion started by: chill3chee
4 Replies
10. Shell Programming and Scripting
The input file is a .dat file which is delimited by null (^@ in Linux). On a windows PC it looks something like this (numbers are masked with 1).
https://i.imgur.com/nta2Gqp.jpg
The entire file is in one row but it has multiple records - each record contains 80 fields i.e. there are 81 counts... (9 Replies)
Discussion started by: digitalnirvana
9 Replies
LEARN ABOUT DEBIAN
gri_merge
GRI_MERGE(1) General Commands Manual GRI_MERGE(1)
NAME
gri_merge - merge multiple Gri output files into a single PostScript file.
USAGE (style 1):
gri_merge [OPTIONS] CxR a.ps b.ps ... > merged_file.ps
Merges the files onto one page, in 'C' columns and 'R' rows. The CxR files are given in the order of words on a page. The page is pre-
sumed to be 8.5x11in in size, as are all the input files, and the input files are sized to fit, and kept in natural scale.
USAGE (style 2):
gri_merge [OPTIONS] xcm ycm enlarge a.ps [b.ps ...] > merged_file.ps
Where `enlarge' is a scale factor applied after offsetting `xcm' to the right and `ycm' upward.
EXAMPLE (style 2):
The following
gri_merge 2 12 .5 a.ps
12 12 .5 b.ps
2 2 .5 c.ps
12 2 .5 d.ps > all.ps
produces 4 panels from gri plots done using margins and sizes as specified in the following lines in a gri commandfile
set x margin 2
set x size 15
set y margin 2
set y size 15
The OPTIONS, available if your 'perl' has 'getopts' library, are:
-u graylevel -- set graylevel for underlay beneath panels, by default 0.75.
Values range from 0 (black) to 1 (white), although a value of precisely 1 means do NOT draw underlay.
-b graylevel -- Set value for background under individual panels, again 0
for black to 1 for white, with 1 meaning no drawing.
-h -- Print this help message and quit.
SEE ALSO
gri(1), gri_unpage(1)
gri_merge 2009 GRI_MERGE(1)