Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Splitting a file in to multiple files and passing each individual file to a command
Top Forums Shell Programming and Scripting Splitting a file in to multiple files and passing each individual file to a command Post 302574275 by rkrish on Thursday 17th of November 2011 03:38:01 AM
Old 11-17-2011
Quote:
Originally Posted by zaxxon
Each line to a single file? What file names to be used besides the extension? What 10 processes ".. each process"? I do not really understand what you want, sorry. Maybe describe a bit more so that others that do not know what you want to do get a chance to understand to minimize guessing, thanks.
Btw: What have you tried so far?

The file is 0f about 6000 lines I want to split the file into 10 files so that each file may be having around 600 lines.

The divided files need to be passed as a argument to a tool which takes the input as filename and process it.
RemoveUsage <fileName>

as there are 10 such files I need 10 processess to run parallely with each processing a file.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

scripting: multiple values from file passing to command

one of my colleagues has this question. he has a command, C_CMD which accepts 4 variables, $1 $2 $3 $4 he wants to load up a file with multiple rows, one row per set of variables and then iteratively execute the command based on the content of the file. example: at the command line you'd... (5 Replies)
Discussion started by: LisaS
5 Replies

2. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50... (3 Replies)
Discussion started by: arund_01
3 Replies

3. Shell Programming and Scripting

help splitting a file into multiple files in bash

I have a file that logs multiple sessions. What I would like to do is split this file inclusive of the lines that include "starting session" and "shutting down" and ignore the data before and after the beginning of the first session and the end of the last session. The output files can be called... (2 Replies)
Discussion started by: elinenbe
2 Replies

4. Shell Programming and Scripting

splitting a file (xml) into multiple files

To split the files Hi, I'm having a xml file with multiple xml header. so i want to split the file into multiple files. Test.xml --------- <?xml version="UTF_8"> <emp: ....> <name>a</name> <age>10</age> </emp> <?xml version="UTF_8"> <emp: ....> <name>b</name> <age>10</age>... (11 Replies)
Discussion started by: sasi_u
11 Replies

5. Shell Programming and Scripting

Splitting large file into multiple files in unix based on pattern

I need to write a shell script for below scenario My input file has data in format: qwerty0101TWE 12345 01022005 01022005 datainala alanfernanded 26 qwerty0101mXZ 12349 01022005 06022008 datainalb johngalilo 28 qwerty0101TWE 12342 01022005 07022009 datainalc hitalbert 43 qwerty0101CFG 12345... (19 Replies)
Discussion started by: jimmy12
19 Replies

6. UNIX for Dummies Questions & Answers

Splitting up a text file into multiple files by columns

Hi, I have a space delimited text file with multiple columns 102 columns. I want to break it up into 100 files labelled 1.txt through 100.txt (n.txt). Each text file will contain the first two columns and in addition the nth column (that corresponds to n.txt). The third file will contain the... (1 Reply)
Discussion started by: evelibertine
1 Replies

7. Shell Programming and Scripting

Using a single "find" cmd to search for multiple file types and output individual files

Hi All, I am new here but I have a scripting question that I can't seem to figure out with the "find" cmd. What I am trying to do is to only have to run a single find cmd parsing the directories and output the different file types to induvidual files and I have been running into problems.... (3 Replies)
Discussion started by: swaters
3 Replies

8. Shell Programming and Scripting

Splitting a single file to multiple files

Hi Friends , Please guide me with the code to extract multiple files from one file . The File Looks like ( Suppose a file has 2 tables list ,column length may vary ) H..- > File Header.... H....- >Table 1 Header.... D....- > Table 1 Data.... T....- >Table 1 Trailer.... H..-> Table 2... (1 Reply)
Discussion started by: AspiringD
1 Replies

9. Shell Programming and Scripting

Splitting file into multiple files and renaming them

Hi all, Newbie here. First of all, sorry if I made any mistakes while posting this question in terms of rules. Correct me if I am wrong. :b: I have a .dat file whose name is in the format of 20170311_abc_xyz.dat. The file consists of records whose first column consists of multiple dates in... (2 Replies)
Discussion started by: chanduris
2 Replies

10. Shell Programming and Scripting

Script for splitting file of records into multiple files

Hello I have a file of following format HDR 1234 abc qwerty abc def ghi jkl HDR 4567 xyz qwerty abc def ghi jkl HDR 890 mno qwerty abc def ghi jkl HDR 1234 abc qwerty abc def ghi jkl HDR 1234 abc qwerty abc def ghi jkl -Need to split this into multiple files based on tag... (8 Replies)
Discussion started by: wincrazy
8 Replies

LEARN ABOUT OPENSOLARIS

split

split(1)							   User Commands							  split(1)

NAME

       split - split a file into pieces

SYNOPSIS

       split [-linecount | -l linecount] [-a suffixlength]
	    [file [name]]

       split [-b n | nk | nm] [-a suffixlength] [file [name]]

DESCRIPTION

       The  split  utility reads file and writes it in linecount-line pieces into a set of output-files. The name of the first output-file is name
       with aa appended, and so on lexicographically, up to zz (a maximum of 676 files). The maximum length of name is 2 characters less than  the
       maximum	filename length allowed by the filesystem. See statvfs(2). If no output name is given, x is used as the default (output-files will
       be called xaa, xab, and so forth).

OPTIONS

       The following options are supported:

       -linecount | -l linecount

	   Number of lines in each piece. Defaults to 1000 lines.

       -a suffixlength

	   Uses suffixlength letters to form the suffix portion of the filenames of the split file. If -a is not  specified,  the  default  suffix
	   length  is  2. If the sum of the name operand and the suffixlength option-argument would create a filename exceeding NAME_MAX bytes, an
	   error will result; split will exit with a diagnostic message and no files will be created.

       -b n

	   Splits a file into pieces n bytes in size.

       -b nk

	   Splits a file into pieces n*1024 bytes in size.

       -b nm

	   Splits a file into pieces n*1048576 bytes in size.

OPERANDS

       The following operands are supported:

       file    The path name of the ordinary file to be split. If no input file is given or file is -, the standard input will be used.

       name    The prefix to be used for each of the files resulting from the split operation. If no name argument is given, x will be used as the
	       prefix  of  the	output	files.	The  combined  length of the basename of prefix and suffixlength cannot exceed NAME_MAX bytes. See
	       OPTIONS.

USAGE

       See largefile(5) for the description of the behavior of split when encountering files greater than or equal to 2 Gbyte ( 2^31 bytes).

ENVIRONMENT VARIABLES

       See environ(5) for descriptions of the following environment variables that affect the execution of split: LANG, LC_ALL, LC_CTYPE,  LC_MES-
       SAGES, and NLSPATH.

EXIT STATUS

       The following exit values are returned:

       0     Successful completion.

       >0    An error occurred.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWesu			   |
       +-----------------------------+-----------------------------+
       |CSI			     |Enabled			   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Committed 		   |
       +-----------------------------+-----------------------------+
       |Standard		     |See  standards(5).	   |
       +-----------------------------+-----------------------------+

SEE ALSO

       csplit(1), statvfs(2), attributes(5), environ(5), largefile(5), standards(5)

SunOS 5.11							    16 Apr 1999 							  split(1)
All times are GMT -4. The time now is 06:35 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy