Sponsored Content
Top Forums Shell Programming and Scripting Split a huge data into few different files?! Post 302367192 by patrick87 on Sunday 1st of November 2009 10:20:12 PM
Old 11-01-2009
Hi Scrutinizer, do you have any idea to get my desired output result?
I try to replace the space of header with "_" and try your suggested code.
Unfortunately, it still can't work Smilie
Thanks a lot for your advise.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Perl script error to split huge data one by one.

Below is my perl script: #!/usr/bin/perl open(FILE,"$ARGV") or die "$!"; @DATA = <FILE>; close FILE; $join = join("",@DATA); @array = split( ">",$join); for($i=0;$i<=scalar(@array);$i++){ system ("/home/bin/./program_name_count_length MULTI_sequence_DATA_FILE -d... (5 Replies)
Discussion started by: patrick87
5 Replies

2. Shell Programming and Scripting

Problem running Perl Script with huge data files

Hello Everyone, I have a perl script that reads two types of data files (txt and XML). These data files are huge and large in number. I am using something like this : foreach my $t (@text) { open TEXT, $t or die "Cannot open $t for reading: $!\n"; while(my $line=<TEXT>){ ... (4 Replies)
Discussion started by: ad23
4 Replies

3. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

I’m new to Linux script and not sure how to filter out bad records from huge flat files (over 1.3GB each). The delimiter is a semi colon “;” Here is the sample of 5 lines in the file: Name1;phone1;address1;city1;state1;zipcode1 Name2;phone2;address2;city2;state2;zipcode2;comment... (7 Replies)
Discussion started by: lv99
7 Replies

4. Shell Programming and Scripting

how to split a huge file by every 100 lines

into small files. i need to add a head.txt and tail.txt into small files at the begin and end, and give a name as q1.xml q2.xml q3.xml .... thank you very much. (2 Replies)
Discussion started by: dtdt
2 Replies

5. Shell Programming and Scripting

Split a file into several files using a data

Hi All, I have file(File1) with data like below: 102100|LName|Gender|Company|Branch|Bday|Salary|Age 102100|bbbb|male|cccc|dddd|19900814|15000|20| 102101|asdg|male|gggg|ksgu|19911216||| 102102|bdbm|male|kkkk|acke|19931018||23| 102102|kfjg|male|kkkc|gkgg|19921213|14000|24|... (2 Replies)
Discussion started by: sarav.shan
2 Replies

6. UNIX for Dummies Questions & Answers

Split a huge 7 GB File Based on Pattern into 4 files

Hi, I have a Huge 7 GB file which has around 1 million records, i want to split this file into 4 files to contain around 250k messages each. Please help me as Split command cannot work here as it might miss tags.. Format of the file is as below <!--###### ###### START-->... (6 Replies)
Discussion started by: KishM
6 Replies

7. Shell Programming and Scripting

Split a folder with huge number of files in n folders

We have a folder XYZ with large number of files (>350,000). how can i split the folder and create say 10 of them XYZ1 to XYZ10 with 35,000 files each. (doesnt matter which files go where). (12 Replies)
Discussion started by: AlokKumbhare
12 Replies

8. Shell Programming and Scripting

Split JSON to different data files

Hi Gurus, I have below JSON file, now I want to rewrite this file into a new file. I will appreciate if anyone can help me to provide the solution...I can't use jq. { "_id": "3ad893cb4cf1560add7b4caffd4b6126", "_rev": "1-1f0ce165e1d210319cf6e9f9c6ff654f", "name":... (4 Replies)
Discussion started by: manas_ranjan
4 Replies

9. UNIX for Advanced & Expert Users

File comaprsons for the Huge data files ( around 60G) - Need optimized and teh best way to do this

I have 2 large file (.dat) around 70 g, 12 columns but the data not sorted in both the files.. need your inputs in giving the best optimized method/command to achieve this and redirect the not macthing lines to the thrid file ( diff.dat) File 1 - 15 columns File 2 - 15 columns Data is... (9 Replies)
Discussion started by: kartikirans
9 Replies

10. Solaris

Split huge File System

Gents I have huge NAS File System as /sys with size 10 TB and I want to Split each 1TB in spirit File System to be mounted in the server. How to can I do that without changing anything in the source. Please your support. (1 Reply)
Discussion started by: AbuAliiiiiiiiii
1 Replies
SDP(1)							    BSD General Commands Manual 						    SDP(1)

NAME
sdp -- scripting definition (sdef) processor SYNOPSIS
sdp -f {ahst} [-o directory | file | -] [options...] [file] DESCRIPTION
sdp transforms a scripting definition (``sdef'') file, or standard input if none is specified, into a variety of other formats for use with a scriptable application. The options are as follows: -f format Specify the output format. The format may be one or more of the following. Use these when you want to create a scriptable applica- tion: a Rez(1) input describing an 'aete' resource. s Cocoa Scripting ``.scriptSuite'' file. t Cocoa Scripting ``.scriptTerminology'' file. These formats are only necessary when creating a scriptable application that will run on Mac OS X 10.4 (Tiger) or earlier; as of 10.5 (Leopard), an application may use only an sdef. Use these when you want to control a scriptable application: h Scripting Bridge Objective-C header. You do not need to create a corresponding implementation file; Scripting Bridge will create the class implementations at runtime. -i includefile Include the type and class definitions from the specified sdef. It may be repeated to specify multiple files. This option is obso- lete; you should use an XInclude element in the sdef instead. -o directory | file | - Specify where to write the output. There are three styles: directory Write the output to automatically named files in that directory. Depending on the input and formats, sdp may generate several files. file Write all the output to that file. - Write all the output to standard output. The default is '-o .'; i.e., generate files in the current directory. Because Cocoa Scripting requires each suite to be in a separate file, using -o file with -f s or -f t is usually not a good idea. Some output formats have additional options relevant only to that format. For scriptSuite and scriptTerminology files (-f s and -f t): -V version Specify the minimum system version to be compatible with, for example, ``-V -10.4''. The default is to assume the current system ver- sion. Specifying anything before 10.3 will use NSString for 'file' type attributes, and will warn about non-object direct parameters. For Scripting Bridge Objective-C header files (-f h): --basename name, -N name Specify the ``base'' name. This name becomes the base name of the generated header and the prefix attached to all the generated classes. For example, saying --basename iTunes would result in a header file ``iTunes.h'' defining a iTunesApplication class. --hidden, -A Output definitions even for items the scripting definition marks as hidden. All such definitions will be flagged as deprecated, since hidden items are usually hidden for a reason. SEE ALSO
sdef(5) BUGS
sdp's error reporting leaves much to be desired. It does not provide line numbers for errors, though it will describe the element. It will not warn you of certain types of mistakes, such as using two different names with the same code (or vice versa), and will return a zero sta- tus even for erroneous input. Mac OS X July 12, 2007 Mac OS X
All times are GMT -4. The time now is 10:50 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy