07-14-2008
script to splite large file to number of small files
Dear All,
Could you please help me to split a file contain around 240,000,000 line to 4 files all equally likely , note that we need to maintain that the end of each file should started by start flage (MSISDN) and ended by end flag (End), also the number of the line between the start flag (MSISDN) and end flag (End) are variable.
Kindly find below sample of the lines in the file
//////////////////////////////////////////////////////
MSISDN
line1
line2
line3
line4
line5
.
.
Line36
End
MSISDN
line1
line2
line3
line4
line5
.
.
line37
End
MSISDN
.
.
//////////////////////////////////////////
Thank you in advance,
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I need to split a large file into small files based on a string.
At different palces in the large I have the string ^Job.
I need to split the file into different files starting from ^Job to the last character before the next ^Job.
Also all the small files should be automatically named.... (4 Replies)
Discussion started by: dncs
4 Replies
2. Shell Programming and Scripting
I have a task to move more than 35000 files every two hours, from the same directory to another directory based on a file that has the list of filenames
I tried the following logics
(1)
find . -name \*.dat > list
for i in `cat list` do mv $i test/ done
(2)
cat list|xargs -i mv "{}"... (7 Replies)
Discussion started by: bryan
7 Replies
3. Shell Programming and Scripting
I have one large file, after every 200 line i have to split the file and the add header and footer to each small file?
It is possible to add different header and footer to each file? (7 Replies)
Discussion started by: ashish4422
7 Replies
4. Shell Programming and Scripting
I have a large Filesystem on an AIX server and another one on a Red Hat box. I have syncd the two filesystems using rsysnc.
What Im looking for is a script that would compare to the two filesystems to make sure the bits match up and the number of files match up.
its around 2.8 million... (5 Replies)
Discussion started by: zippdawg2001
5 Replies
5. Shell Programming and Scripting
Hellow i have a large number of files that i want to concatenate to one. these files start with the word 'VOICE_' for example
VOICE_0000000000
VOICE_1223o23u0
VOICE_934934927349
I use the following code:
cat /ODS/prepaid/CDR_FLOW/MEDIATION/VOICE_* >> /ODS/prepaid/CDR_FLOW/WORK/VOICE
... (10 Replies)
Discussion started by: chriss_58
10 Replies
6. UNIX for Dummies Questions & Answers
Hi. I need to delete a large number of files listed in a txt file. There are over 90000 files in the list. Some of the directory names and some of the file names do have spaces in them.
In the file, each line is a full path to a file:
/path/to/the files/file1
/path/to/some other/files/file 2... (4 Replies)
Discussion started by: inakajin
4 Replies
7. Shell Programming and Scripting
Want to sftp large number of files ... approx 150 files will come to server every minute. (AIX box)
Also need make sure file has been sftped successfully...
Please let me know :
1. What is the best / faster way to transfer files?
2. should I use batch option -b so that connectivity will be... (3 Replies)
Discussion started by: vegasluxor
3 Replies
8. Shell Programming and Scripting
Dear all,
I have huge txt file with the input files for some setup_code. However for running my setup_code, I require txt files with maximum of 1000 input files
Please help me in suggesting way to break down this big txt file to small txt file of 1000 entries only.
thanks and Greetings,
Emily (12 Replies)
Discussion started by: emily
12 Replies
9. Shell Programming and Scripting
Hi All,
I am having a situation now to delete a huge number of temp files created during run times approx. 16700+ files. We have never imagined that we will get this this much big list of files during run time. It worked fine for lesser no of files in the list. But when list is huge we are... (7 Replies)
Discussion started by: mad man
7 Replies
10. UNIX for Beginners Questions & Answers
I Have a large file with 24hrs log in the below format.i need to split the large file in to 24 small files on one hour based.i.e ex:from 09:55 to 10:55,10:55-11:55
can any one help me on this.!
... (20 Replies)
Discussion started by: Raghuram717
20 Replies
cam(1) General Commands Manual cam(1)
NAME
cam - CPU'S AUDIO MIXER for Linux
SYNOPSIS
cam [-v x,y] [--volume x,y] [-b x,y] [--bass x,y] [-t x,y] [--treble x,y] [-s x,y] [--synth x,y] [-p x,y] [--pcm x,y] [-S x,y]
[--speaker x,y] [-l x,y] [--line x,y] [-m x,y] [--mic x,y] [-c x,y] [--cd x,y] [-M x,y] [--mixer x,y] [-a x,y] [--altpcm x,y] [-r
x,y] [--reclev x,y] [-i x,y] [--igain x,y] [-o x,y] [--ogain x,y] [-l1 x,y] [--line1 x,y] [-l2 x,y] [--line2 x,y] [-l3 x,y] [--line3
x,y] [-3d 1|0] [--3dse 1|0] [-agc 1|0] [--agc 1|0] [-h] [-?] [--help] [-get] [-save] [-getfile filename] [-savefile filename]
xcam
DESCRIPTION
This is an audio mixer for Linux. You have the choice to use it with an interface or at the command line.
OPTIONS
When using the interface you can use the following keys :
LEFT ARROW
decrease the volume of the current device.
RIGHT ARROW
increase the volume of the current device.
UP ARROW
go to previous device.
DOWN ARROW
go to next device.
L locks or unlocks :
unlocked : you can control the left and right channel
separately.
lock : left and right channel are controlled together.
R turn on/off recording mode :
red lamp : recording turned on
green lamp : recording turned off
3 turn on/off 3D Stereo Enhancement (3DSE) device :
when turned on green indicator 3D will be lit at the left side of main volume handle.
A turn on/off microphone Automatic Gain Control :
when turned on green indicator AGC will be lit at the left side of microphone volume handle.
S save the settings of ALL devices in a file ($HOME/.camrc)
G loads the saved settings and restores them.
H shows the help screen.
Q/ESC exits the program and returns to shell.
NOTE: you can use upper or lower case.
When using the command line options the interface is not shown.
The following options are available :
-v, --volume x,y
Set 'volume' to x (left) and y (right)
-b, --bass x,y
Set 'bass' to x (left) and y (right)
-t, --trebble x,y
Set 'treble' to x (left) and y (right)
-s, --synth x,y
Set 'synth' to x (left) and y (right)
-p, --pcm x,y
Set 'pcm' to x (left) and y (right)
-S, --speaker x,y
Set 'speaker' to x (left) and y (right)
-l, --line x,y
Set 'line in' to x (left) and y (right)
-m, --mic x,y
Set 'microphone' to x (left) and y (right)
-c, --cd x,y
Set 'CD in' to x (left) and y (right)
-I, --imix x,y
Set 'mixer' to x (left) and y (right)
-a, --altpcm x,y
Set 'altpcm' to x (left) and y (right)
-r, --reclev x,y
Set 'record level' to x (left) and y (right)
-i, --igain x,y
Set 'input gain' to x (left) and y (right)
-o, --ogain x,y
Set 'output gain' to x (left) and y (right)
-l1, --line1 x,y
Set 'line 1' to x (left) and y (right)
-l2, --line2 x,y
Set 'line 2' to x (left) and y (right)
-l3, --line3 x,y
Set 'line 3' to x (left) and y (right)
-3d, --3dse 1|0
Set 3D Stereo Enhancement to 1 (on) or 0 (off)
-agc, --agc 1|0
Set Automatic Gain Control for microphone to 1 (on) or 0 (off)
-get restore the saved values from $HOME/.camrc
-save save the values to $HOME/.camrc
-getfile filename
restore the saved values from file 'filename'
-savefile filename
save the values to file 'filename'
-h, -?, --help
displays help
NOTE: x and y are in range from 1 to 100. Higher or lower numbers are
ignored.
BUGS
None known as yet. If you find one, please let me know.
AUTHOR
Jan 'TWP' VANDENBERGHE <jvdbergh@uia.ua.ac.be>
cam(1)