02-13-2017
Thanks. The command works fine. Just one thing.It takes really huge time to split a file say for size 3 GB. Is there a workaround for this? And just a small correction - Changed n=20000000 to n=2000000 as need files in chunks of 2 million rows and not 20 million.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a directory of files that I need to rename by splitting the first and second halves of the filenames using the delimiter "-O" and then renaming with the second half first, followed by two underscores and then the first half. For example, natfinal1995annvol1_14.pdf -O filenum-20639 will be... (2 Replies)
Discussion started by: swimulator
2 Replies
2. Shell Programming and Scripting
Hi,
can some one please help me to split the file based on groups.
like in the below scenario x indicates the begining of the group and the file should be split each with 2 groups below there are 10 groups it should create 5 files. could you please help? (4 Replies)
Discussion started by: hitmansilentass
4 Replies
3. Shell Programming and Scripting
Here is my source, i have million lines like this on a file.
disp0201.php?poc=4060&roc=1&ps=R&ooc=13&mjv=6&mov=5&rel=5&bod=155&oxi=2&omj=5&ozn=1&dav=20&cd=&daz=& drc=&mo=&sid=&lang=EN&loc=JPN
I want to split this into columns in order to load in database, anything starts with"&mjv=6" as first... (13 Replies)
Discussion started by: elamurugu
13 Replies
4. Shell Programming and Scripting
Hi,
My inputfile contains field separaer is ^.
12^inms^
13^fakdks^ssk^s3
23^avsd^
13^fakdks^ssk^a4
I wanted to print only 2 delimiter occurence i.e
12^inms^
23^avsd^ (4 Replies)
Discussion started by: Jairaj
4 Replies
5. Shell Programming and Scripting
KSH
HP-SOL-Lin
Cannot use xAWK
I have several strings that are quite long and i want to break them down into smaller substrings.
What I have
String = "word1 word2 word3 word4 .....wordx"
What I want
String1="word1 word2"
String2="word 3 word4"
String3="word4 word5"
Stringx="wordx... (5 Replies)
Discussion started by: nitrobass24
5 Replies
6. Shell Programming and Scripting
Hi all.
I've tried searching the web but could not find similar problem to mine.
I have one large file to be splitted into several files based on the matching pattern found in each row.
For example, let's say the file content:
... (13 Replies)
Discussion started by: aimy
13 Replies
7. Shell Programming and Scripting
i have below code to count number of rows in file1.txt, if the row count is more than one then i have sending an email along with file1.txt attached and fail the process(do nothing if count is <=1),
if I test individually count part works good but when i include the email part its not working,... (1 Reply)
Discussion started by: srini_106
1 Replies
8. Shell Programming and Scripting
Hi
I want to check delimiter in file. Delimiter in my file is ~|*
sample of file :
ABC~|*edgf~|*T1J333~|*20121130
ABC~|*sdaf~|*T1J333~|*20121130
ABC~|*fsdg~|*T1J333~|*20121130
ABC~|*dfsg~|*T1J333~|*20121130
in this i want to count number delimiter occur is 4 in each row if count is... (21 Replies)
Discussion started by: MOHANP12
21 Replies
9. Shell Programming and Scripting
Greetings Experts,
I am generating a validation query through awk and facing an issue, which I need to overcome by splitting the data based on the pattern matching count in the value of an array.
File1 --
Table11@column1@date@Table21@column1@varchar(10)@d;... (4 Replies)
Discussion started by: chill3chee
4 Replies
10. Shell Programming and Scripting
The input file is a .dat file which is delimited by null (^@ in Linux). On a windows PC it looks something like this (numbers are masked with 1).
https://i.imgur.com/nta2Gqp.jpg
The entire file is in one row but it has multiple records - each record contains 80 fields i.e. there are 81 counts... (9 Replies)
Discussion started by: digitalnirvana
9 Replies
FOX(1) General Commands Manual FOX(1)
NAME
fox - ab-initio structure determination from diffraction data
SYNOPSIS
fox [options] [file.xml]
DESCRIPTION
The fox (Free Objects for Crystallography) program was made for the ab initio crystal structure solution from diffraction data. Its most
interesting features for ab initio structure determination are:
* versatile description of the crystal contents;
* automatic correction for special positions and shared atoms between polyhedra;
* the ability to use simultaneously multiple powder patterns;
* smart global optimization algorithms;
* a graphical interface with a 3D crystal structure view and live updates during the optimization process.
OPTIONS
This program my be executed with or without command line options or input file (file.xml). It follows the usual GNU command line syntax,
with long options starting with two dashes (`-'). A summary of options is included below. For a complete description, see the fox wiki
http://objcryst.sourceforge.net/Fox/Manual
--help Show summary of options.
--loadfouriergrd map.grd
Load and display 'map.grd' fourier map with (first) crystal structure
--loadfourierdsn6 map.DN6
Load and display a DSN6 fourier map with (first) crystal structure
--nogui
Run without GUI, automatically launches optimization --nogui may be accompanied by the following options:
-n 10000
Run for 10000 trials at most (default: 1000000)
--nbrun 5
Do 5 runs, randomizing before each run (default: 1), use -1 to run indefinitely
-o out.xml
Output in 'out.xml'
--randomize
Randomize initial configuration
--silent
Produce (almost) no text output
--finalcost 0.15
Run optimization until cost < 0.15
--cif2pattern 1.5406 170 5000 .1
Simulate pattern for input crystal, wavelength=1.5406 up to 170o with 500 points anda peak width of 0.1o
EXAMPLES
Fox silicon.xml
Load file 'silicon.xml' and launch GUI.
Fox Cimetidine-powder.xml --nogui --randomize -n 1000000 -o best.xml
Load file 'ktartrate.xml', randomize, then make 1 optimization of 1 million trials, and save the best structure in 'best.xml'.
Fox Cimetidine-powder.xml --nogui --randomize -n 10000000 --nbrun 10 -o best.xml
Load file 'Cimetidine-powder.xml', then make 10 runs (starting from a random structure) of 10 million trials (each run saves one xml
file), and save the best structure in 'best.xml'.
Fox Cimetidine-powder.xml --nogui --silent --randomize -n 10000000 --nbrun 10 --finalcost 200000 -o best.xml
Load file 'Cimetidine-powder.xml', then make 10 silent runs of 10 million trials (each run saves one xml file), and save the best
structure in 'best.xml'. For each run, the optimization stops if the cost goes below 200000.
AUTHOR
fox was written by Vincent Favre-Nicolin <Vincent.Favre-Nicolin@cea.fr>.
This manual page was written by Carlo Segre <segre@debian.org>, for the Debian project (but may be used by others).
July 24, 2008 FOX(1)