Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Script to break up file (write new files) in bash
Top Forums UNIX for Dummies Questions & Answers Script to break up file (write new files) in bash Post 302898471 by rbatte1 on Tuesday 22nd of April 2014 10:55:19 AM
Old 04-22-2014
You could do something very descriptive like this:-
Code:
#!/bin/ksh
count=1
while read line
do
   if [ "$line" != "" ]
   then
      echo "$line" >> file_new$count.txt
   else
      ((count=$count+1))
   fi
done < input_file

.... which is messy and might have a logic error in it, and it is certainly expensive as it will be open/appending to the output files many many times.


A better alternative may be to look at the command csplit We do a similar thing with this:-
Code:
csplit -f output_prefix -n 5 -s input_file "/^$/" {*}

It will create output files based on your prefix, e.g -f robin will produces files robin00000, robin00001, robin00002, etc. The -n 5 sets the length of the counter.


I hope that this helps,
Robin
Liverpool/Blackburn
UK
This User Gave Thanks to rbatte1 For This Post:
torchij
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Break a file into separate files

Hello I am facing a scenario where I have a file with XML content and I am running shell script over it. But the problem is the XML is getting updated with new services. In the below scenario, my script takes values from the xml file from one service name say ABCD. Since there are multiple, it is... (8 Replies)
Discussion started by: chiru_h
8 Replies

2. Shell Programming and Scripting

shell script to remove old files and write to a log file

Hi, I have a script that works on a unix box but am trying to get it working on a linux box that uses shell. I am not a programmer so this is proving harder than I imagined. I made some changes and ended up with the script below but when I run it I get the following messages. Any help would be... (4 Replies)
Discussion started by: yabai
4 Replies

3. Shell Programming and Scripting

Can anybody write this bash script ?

hi, first congratulations on the nice forum! Can anybody write script, which can make copy of some or all files of the current directory in new directory (called "backups", which must be made in the current directory, if it's not already exist). And bring out a massage (report) with the count... (7 Replies)
Discussion started by: Cecko
7 Replies

4. Shell Programming and Scripting

How to write bash script to explode multiple zip files

I have a directory full of zip files. How would I write a bash script to enumerate all the zip files, remove the ".zip" from the file name, create a directory by that name and unzip each zip file into its corresponding directory? Thanks! Siegfried (3 Replies)
Discussion started by: siegfried
3 Replies

5. Shell Programming and Scripting

Write a new file from 2 files as input to the script

Hi- I am hoping someone can give me some pointers to get me started. I have a file which contains some dn's .e.g file 1 cn=bob,cn=user,dc=com cn=kev,cn=user,dc=com cn=john,cn=user,dc=com I have a second file e.g. file.template which looks something like :- dn: <dn> objectclass:... (5 Replies)
Discussion started by: sniper57
5 Replies

6. Homework & Coursework Questions

How to write script in bash.

I am very new to Linux/Unix. Kindly assist the following: I wish to write a bash shell script called how_many_to_go that calculates and prints the number of days, hours, minutes and/or seconds until the end of the current month (based on the output of the date command). Do ... (2 Replies)
Discussion started by: alobi
2 Replies

7. Shell Programming and Scripting

how to write bash script that will automatically extract zip file

i'm trying to write a bash script that that will automatically extract zip files after the download. i writed this script #!/bin/bash wget -c https://github.com/RonGokhle/kernel-downloader/zipball/master CURRENDIR=/home/kernel-downloader cd $CURRENDIR rm $CURRENDIR/zipfiles 2>/dev/null ... (2 Replies)
Discussion started by: ron gokhle
2 Replies

8. UNIX for Dummies Questions & Answers

Write pid and command name to a txt file while executing a bash script

Hi All, Just have a requirement, I am executing a bash shell script, my requirement is to catch the pid and job name to a txt file in the same directory, is there anyway to do it? please help me out. Regards Rahul ---------- Post updated at 08:42 AM ---------- Previous update was at... (2 Replies)
Discussion started by: rahulkalra9
2 Replies

9. Shell Programming and Scripting

Break output file into three files

Help! :) I am getting an output file that looks similar to below. EMAIL_ADDR ----------------------------------------------------------------------------------- user@gmail.com DATABASENAME ----------------------------------------------------------------------------------- db1 db2 db3... (6 Replies)
Discussion started by: cpolikowsky
6 Replies

10. UNIX for Beginners Questions & Answers

How To Write my Bash Script To Automate it?

Hello guys, I need some help. I am new in bash and I don't know how to automate the following script. head -2 out1 > 1.fasta sed ‘1,2 d' out1 > out2 rm out1 head -2 out2 > 2.fasta sed ‘1,2 d' out2 > out1 rm out2 head -2 out2 > 3.fasta sed '1,2 d' out2 > out1 rm out2 .......... (3 Replies)
Discussion started by: dellia222
3 Replies

LEARN ABOUT OSX

csplit

CSPLIT(1)						    BSD General Commands Manual 						 CSPLIT(1)

NAME

     csplit -- split files based on context

SYNOPSIS

     csplit [-ks] [-f prefix] [-n number] file args ...

DESCRIPTION

     The csplit utility splits file into pieces using the patterns args.  If file is a dash ('-'), csplit reads from standard input.

     The options are as follows:

     -f prefix
	     Give created files names beginning with prefix.  The default is ``xx''.

     -k      Do not remove output files if an error occurs or a HUP, INT or TERM signal is received.

     -n number
	     Use number of decimal digits after the prefix to form the file name.  The default is 2.

     -s      Do not write the size of each output file to standard output as it is created.

     The args operands may be a combination of the following patterns:

     /regexp/[[+|-]offset]
	     Create a file containing the input from the current line to (but not including) the next line matching the given basic regular
	     expression.  An optional offset from the line that matched may be specified.

     %regexp%[[+|-]offset]
	     Same as above but a file is not created for the output.

     line_no
	     Create containing the input from the current line to (but not including) the specified line number.

     {num}   Repeat the previous pattern the specified number of times.  If it follows a line number pattern, a new file will be created for each
	     line_no lines, num times.	The first line of the file is line number 1 for historic reasons.

     After all the patterns have been processed, the remaining input data (if there is any) will be written to a new file.

     Requesting to split at a line before the current line number or past the end of the file will result in an error.

ENVIRONMENT

     The LANG, LC_ALL, LC_COLLATE and LC_CTYPE environment variables affect the execution of csplit as described in environ(7).

EXIT STATUS

     The csplit utility exits 0 on success, and >0 if an error occurs.

EXAMPLES

     Split the mdoc(7) file foo.1 into one file for each section (up to 20):

	   csplit -k foo.1 '%^.Sh%' '/^.Sh/' '{20}'

     Split standard input after the first 99 lines and every 100 lines thereafter:

	   csplit -k - 100 '{19}'

SEE ALSO

     sed(1), split(1), re_format(7)

STANDARDS

     The csplit utility conforms to IEEE Std 1003.1-2001 (``POSIX.1'').

HISTORY

     A csplit command appeared in PWB UNIX.

BUGS

     Input lines are limited to LINE_MAX (2048) bytes in length.

BSD
								 January 26, 2005							       BSD
All times are GMT -4. The time now is 07:13 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy