Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Another scripting help please, splitting files by range, maybe I don't need a script :( Post 303044575 by newbie_01 on Wednesday 26th of February 2020 09:13:44 PM
Old 02-26-2020
Another scripting help please, splitting files by range, maybe I don't need a script :(

Hi,


I requested the Windows SysAdmin to give me all available config files from a server.



Instead of sending it into several files, he combine all of them into one single file leaving it for me to split them up myself.


I was able to do so via a script below:



Code:
$ cat ./split_file.ksh
#!/bin/ksh
#

myPID=$$
grep -in "C:" file_to_split.txt > $myPID.tmp.00
cat $myPID.tmp.00

last_number=`tail -1 $myPID.tmp.00 | awk -F":" '{ print $1 }'`
switch=0
count=0

echo
echo "myPID = $myPID"
echo "last_number = $last_number"
echo

while read num
do
   if [[ $switch = 0 ]] ; then
      end=1
      switch=1
      continue
   else
      let count=$count+1
      start=$end
      end=`echo $num | awk -F":" '{ print $1-1 }'`
      echo "- Printing ${start} to ${end} ..."
      sed -n "${start},${end}p" file_to_split.txt > file_to_split.file.${count}.txt
      let end=$end+1

      if [[ $end = $last_number ]] ; then
         let count=$count+1
         start=$end
         echo "- Printing ${start} to the end ... "
         sed -n "${start},\$p" file_to_split.txt > file_to_split.file.${count}.txt
      fi
   fi
done < $myPID.tmp.00

rm $myPID.tmp*
echo
ls -l file_to_split.file.*txt
echo

wc -l file_to_split.txt
echo
wc -l file_to_split.file.*txt

exit 0

Sample output running the script is as below:


Code:
$ ./split_file.ksh
1:C:\Oracle\product\12.1.0\client_1_32Full\NETWORK\ADMIN\tnsnames.ora
6673:C:\Oracle\product\12.1.0\client_1_32Full\NETWORK\ADMIN\SAMPLE\tnsnames.oRA
13345:C:\Oracle\product\12.1.0\client_1_64Full\network\admin\tnsnames.ora
20017:C:\Oracle\product\12.1.0\client_1_64Full\network\admin\sample\tnsnames.oRA
26689:C:\Oracle\product\12.1.0\TNSNAMES\tnsnames.ora
33361:C:\Support\tnsnames.ora
39897:C:\Support\CHG0082341\tnsnames.ora

myPID = 26172
last_number = 39897

- Printing 1 to 6672 ...
- Printing 6673 to 13344 ...
- Printing 13345 to 20016 ...
- Printing 20017 to 26688 ...
- Printing 26689 to 33360 ...
- Printing 33361 to 39896 ...
- Printing 39897 to the end ...

-rw-r--r-- 1 oracle oinstall 363739 Feb 27 14:28 file_to_split.file.1.txt
-rw-r--r-- 1 oracle oinstall 363746 Feb 27 14:28 file_to_split.file.2.txt
-rw-r--r-- 1 oracle oinstall 363739 Feb 27 14:28 file_to_split.file.3.txt
-rw-r--r-- 1 oracle oinstall 363746 Feb 27 14:28 file_to_split.file.4.txt
-rw-r--r-- 1 oracle oinstall 363718 Feb 27 14:28 file_to_split.file.5.txt
-rw-r--r-- 1 oracle oinstall 352223 Feb 27 14:28 file_to_split.file.6.txt
-rw-r--r-- 1 oracle oinstall 363706 Feb 27 14:28 file_to_split.file.7.txt

46568 file_to_split.txt

   6672 file_to_split.file.1.txt
   6672 file_to_split.file.2.txt
   6672 file_to_split.file.3.txt
   6672 file_to_split.file.4.txt
   6672 file_to_split.file.5.txt
   6536 file_to_split.file.6.txt
   6672 file_to_split.file.7.txt
  46568 total

Is there an awk one-liner way of achieving the same result? Smilie
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

automated ftp script from unix -date range of files

Hi , I need some help to finish my ftp script and i need to find the last one weeks of fles updated in the sepecific directory and see those end with Z and ftp them to my backup server. Any help is appreciated. Thanks, Ravi :) (1 Reply)
Discussion started by: koduri0475
1 Replies

2. Programming

automated ftp script from unix -date range of files

Hi , I need some help to finish my ftp script and i need to find the last one weeks of fles updated in the sepecific directory and see those end with Z and ftp them to my backup server. Any help is appreciated. Thanks, Ravi :) (1 Reply)
Discussion started by: koduri0475
1 Replies

3. UNIX for Advanced & Expert Users

automated ftp script from unix -date range of files

Hi , I need some help to finish my ftp script and i need to find the last one weeks of fles updated in the sepecific directory and see those end with Z and ftp them to my backup server. Any help is appreciated. Thanks, Ravi :) (1 Reply)
Discussion started by: koduri0475
1 Replies

4. Shell Programming and Scripting

Script that can Copy a Range of files from Tape to Hard disk

Hi: I am a trying to write a script using a loop i guess. What I need to do is write a script that can allow my users to load a tape and copy a range of files from a tape to the hard disk. By range I mean, I would like the users to pick a range of numbers like files 3 - 8 and the script will... (0 Replies)
Discussion started by: msjazzie
0 Replies

5. Shell Programming and Scripting

Script to move files based on Pattern don't work

Hi people, i need you help on this if you can. I have a script that does the move command when it searches for a that doesn't match the pattern. This Pattern is on a list. When it run's and doesn´t found no files but it haves 2 more folders it moves the folders too. Ex:... (1 Reply)
Discussion started by: osramos
1 Replies

6. Shell Programming and Scripting

Need script to select multiple files from archive directory based on the date range

hi all, here is the description to my problem. input parameters: $date1 & $date2 based on the range i need to select the archived files from the archived directory and moved them in to working directory. can u please help me in writing the code to select the multiple files based on the... (3 Replies)
Discussion started by: bbc17484
3 Replies

7. Shell Programming and Scripting

Splitting the files via shell script

Hi all, We have 102 flat files created by Informatica from 102 tables. These 102 files contain pharmcy details. There are a total of 450 pharmcyids.The naming convention for the flat file is ODS_<TABLE NAME>_yyyymmdd_timestamp.dat. Each flat file may contain data for 450 pharmacies which is... (2 Replies)
Discussion started by: Maya_Pillai
2 Replies

8. UNIX for Advanced & Expert Users

Help with ksh script to list, then cp files from a user input date range

Hi, I'm quite new to ksh scripting, can someone help me with this. Requirements: I need to create a script that list the files from a user input date range. e. g. format of file: *c1*log.2012-12-22-14-00* *c1*log.2012-12-22-14-00* *c1*log.2012-12-22-14-00*... (1 Reply)
Discussion started by: chococrunch6
1 Replies

9. Shell Programming and Scripting

Splitting a file and creating new files using Perl script

Hi All, I am new to Scripting language. I want to split a file and create several subfiles using Perl script. Example : File format : Sourcename ID Date Nbr SU IMYFDJ 9/17/2012 5552159976555 SU BWZMIG 9/14/2012 1952257857887 AR PEHQDF 11/26/2012 ... (13 Replies)
Discussion started by: Deepak9870
13 Replies

10. Shell Programming and Scripting

Script for splitting file of records into multiple files

Hello I have a file of following format HDR 1234 abc qwerty abc def ghi jkl HDR 4567 xyz qwerty abc def ghi jkl HDR 890 mno qwerty abc def ghi jkl HDR 1234 abc qwerty abc def ghi jkl HDR 1234 abc qwerty abc def ghi jkl -Need to split this into multiple files based on tag... (8 Replies)
Discussion started by: wincrazy
8 Replies
split(1)							   User Commands							  split(1)

NAME
split - split a file into pieces SYNOPSIS
split [-linecount | -l linecount] [-a suffixlength] [ file [name]] split [ -b n | nk | nm] [-a suffixlength] [ file [name]] DESCRIPTION
The split utility reads file and writes it in linecount-line pieces into a set of output-files. The name of the first output-file is name with aa appended, and so on lexicographically, up to zz (a maximum of 676 files). The maximum length of name is 2 characters less than the maximum filename length allowed by the filesystem. See statvfs(2). If no output name is given, x is used as the default (output-files will be called xaa, xab, and so forth). OPTIONS
The following options are supported: -linecount | -l linecounNumber of lines in each piece. Defaults to 1000 lines. -a suffixlength Uses suffixlength letters to form the suffix portion of the filenames of the split file. If -a is not specified, the default suffix length is 2. If the sum of the name operand and the suffixlength option-argument would create a filename exceeding NAME_MAX bytes, an error will result; split will exit with a diagnostic message and no files will be created. -b n Splits a file into pieces n bytes in size. -b nk Splits a file into pieces n*1024 bytes in size. -b nm Splits a file into pieces n*1048576 bytes in size. OPERANDS
The following operands are supported: file The path name of the ordinary file to be split. If no input file is given or file is -, the standard input will be used. name The prefix to be used for each of the files resulting from the split operation. If no name argument is given, x will be used as the prefix of the output files. The combined length of the basename of prefix and suffixlength cannot exceed NAME_MAX bytes. See OPTIONS. USAGE
See largefile(5) for the description of the behavior of split when encountering files greater than or equal to 2 Gbyte ( 2**31 bytes). ENVIRONMENT VARIABLES
See environ(5) for descriptions of the following environment variables that affect the execution of split: LANG, LC_ALL, LC_CTYPE, LC_MES- SAGES, and NLSPATH. EXIT STATUS
The following exit values are returned: 0 Successful completion. >0 An error occurred. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWesu | +-----------------------------+-----------------------------+ |CSI |enabled | +-----------------------------+-----------------------------+ |Interface Stability |Standard | +-----------------------------+-----------------------------+ SEE ALSO
csplit(1), statvfs(2), attributes(5), environ(5), largefile(5), standards(5) SunOS 5.10 16 Apr 1999 split(1)
All times are GMT -4. The time now is 11:26 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy