Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: split input data file and put into same output file
Top Forums Shell Programming and Scripting split input data file and put into same output file Post 302514340 by rasmith on Friday 15th of April 2011 12:22:33 PM
Old 04-15-2011
split input data file and put into same output file
Hi All,
I have two input file and need to generate a CSV file. The existing report just "GREP" the records with the Header and Tailer records with the count of records.
Now i need to split the data into 25 records each in the same CSV file.

id_file (Input file )
Code:
227050994
232510151

report_data (Input file)
Code:
13,227050994,LALN3819959,2089851292,2085254977,20110224
.
.
.
13,227050994,LFLN3449126,2082113563,2082113396,20110224
283,232510151,LALC3914497,152469347,152466752,20110224
283,232510151,LFSD3449916,1329836600,1329836311,20110224
.
.
.
.
283,232510151,LFSL3455668,1142303778,1142301334,20110224
283,232510151,LFST3462358,1425672593,1425672226,20110224

Existing Report (output file)
Code:
Start of Report 20110224~ 
227050994 20110224 
13 227050994 LALN3819959 2089851292 2085254977 20110224
.
.
.
13 227050994 LFLN3449126 2082113563 2082113396 20110224
~End of Report 227050994 19
Start of Report 20110224~ 
232510151 20110224 
283 232510151 LALC3914497 152469347 152466752 20110224
283 232510151 LZNI0568201 2891873461 2891871770 20110224
.
.
.
.
283 232510151 LFSL3455668 1142303778 1142301334 20110224
283 232510151 LFST3462358 1425672593 1425672226 20110224
~End of Report 232510151 79

Script to process the files
Code:
OUT_FILE="report.csv"
for line in `cat id_file.dat`
do
  echo "Report,`date +%Y%m%d`~" >>$OUT_FILE
  echo "$line,`date +%Y%m%d`" >>$OUT_FILE
  grep ",$line," report_data.dat >>$OUT_FILE
  echo "~End of Report,$line,`grep -c ",$line," report_data.dat`" >>$OUT_FILE
done

Thank You,
Rasmith
Last edited by Scott; 04-15-2011 at 02:14 PM.. Reason: Removed formatting, added code tags, indentation
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Replacing data of output file with input

Hi, I have a ksh which peocess and get me data from 3 days... ie if i process it on jan 28.. it gets data for 25, 26 and 27.... the process run every day and get previous 3 days data...all this data is appened to a file lets call time.out Now time.out cannot have deplicate data so what i want... (10 Replies)
Discussion started by: bhagya2340
10 Replies

2. UNIX for Dummies Questions & Answers

I want some selected data from first file and put into other file in specified format

I have a file with follwing content ---------------------------------- SCHEDULE XXXXXXXXX#JOBCOUNT ON EVERYDAY AT 0000 PRIORITY 50 SCHEDULE XXXXXXXXX#ABCDEFGH ON EVERYDAY AT 0001 PRIORITY 29 SCHEDULE... (5 Replies)
Discussion started by: shreyas
5 Replies

3. Shell Programming and Scripting

Need script to take input from file, match on it in file 2 and input data

All, I am trying to figure out a script to run in windows that will allow me to match on First column in file1 to 8th Column in File2 then Insert file1 column2 to file2 column4 then create a new file. File1: 12345 Sam 12346 Bob 12347 Bill File2:... (1 Reply)
Discussion started by: darkoth
1 Replies

4. Shell Programming and Scripting

Dynamic output file generation using a input text file with predefined output format

Hi, I have two files , one file with data file with attributes that need to be sent to another file to generate a predefined format. Example: File.txt AP|{SSHA}VEEg42CNCghUnGhCVg== APVG3|{SSHA}XK|"password" AP3|{SSHA}XK|"This is test" .... etc --------- test.sh has... (1 Reply)
Discussion started by: hudson03051nh
1 Replies

5. Shell Programming and Scripting

How to add data from 2 input files and save it in 1 output file

Hi, i have 2 input files which are file1.txt and file2.txt. I need to extract data from file1.txt and file2.txt and save it in file3.txt like example below:- File1.txt ID scrap1 Name scrap1 start 1 end 10 ID scrap2 Name scrap2 start 11 end ... (4 Replies)
Discussion started by: redse171
4 Replies

6. Shell Programming and Scripting

adding data in input file if 2nd script output SUCCESS

Hi All, how can i edit my original data and add more data if my 2nd script outputs SUCESS? ex. input file: 1.txt nik,is,the 1script.sh if 2ndscript.sh output SUCCESS then i'm going to edit my input file and add data best,pogi.. sample outputdata. nik,is,the,best,pogi 2ndscript.sh... (3 Replies)
Discussion started by: nikki1200
3 Replies

7. Shell Programming and Scripting

Get Data From CSV File and put into a txt file

Hi Guys, File A I have File A as CSV Format.... No R SS MK Par value S AL A1 PKL123 Lo12 1 S AL A2 PKl123 Lo34 22 S AL A3 PkLK234 Lo67 -34 S AL A4 PkLK235 Lo09 120 S AL A5 PkLK236 Lo76 19 S AL A6 PkLK237 Lo44 -17 S AL A7 PkLK238 Lo90 2 S AL A8 PkLK239 Lo34 -9 I want file B like... (4 Replies)
Discussion started by: asavaliya
4 Replies

8. Shell Programming and Scripting

Split: File into multiple and keeping the same 3 lines from input into all output files

The following code will split the infile into multiple files. However, I need it to insert the same first 3 lines from the original input file into each splitted file. How do I modify my script below to do so: print -n "Enter file name to split? " ; read infile if then echo "Invalid file... (4 Replies)
Discussion started by: mrn6430
4 Replies

9. Shell Programming and Scripting

awk to reformat output if input file is empty, but not if file has data in it

The below awk improved bu @MadeInGermany, works great as long as the input file has data in it in the below format: input chrX 25031028 25031925 chrX:25031028-25031925 ARX 631 18 chrX 25031028 25031925 chrX:25031028-25031925 ARX 632 14... (3 Replies)
Discussion started by: cmccabe
3 Replies

10. Shell Programming and Scripting

Extract data from a log file and put it in a file

Hi, I would like to seek your help for a script that will extract data from log file and put it in a file. Sample log file 2018-10-23 12:33:21 AI ERROR -- tpid: SAMPLE_TH account: 123456789 aiSessionNumber: 660640464 mapName: xxx to yyy errorDesc: Translation Error:ErrorNumber : 993 ... (2 Replies)
Discussion started by: neverwinter112
2 Replies

LEARN ABOUT HPUX

df_hfs

df_hfs(1M)																df_hfs(1M)

NAME

       df_hfs: df - report number of free CDFS, HFS, or NFS file system disk blocks

SYNOPSIS

       FStype] specific_options] [special|directory]...

DESCRIPTION

       The  command  displays  the  number  of free 512-byte blocks and free inodes available for file systems by examining the counts kept in the
       superblock or superblocks.  If a special or a directory is not specified, the free space on all mounted file systems is displayed.  If  the
       arguments  to are path names, reports on the file systems containing the named files.  If the argument to is a special of an unmounted file
       system, the free space in the unmounted file system is displayed.

   Options
       recognizes the following options:

	      Report only the number of kilobytes (KB) free.

	      Report the total number of blocks allocated for swapping to the file system
			     as well as the number of blocks free for swapping to the file system.  This option is supported on HFS  file  systems
			     only.

	      Report the number of files free.

	      Report only the actual count of the blocks in the free list
			     (free inodes are not reported).  When this option is specified, reports on raw devices.

	      Report only on the
			     FStype  file  system  type  (see fstyp(1M)).  For the purposes of this manual entry, FStype can be one of and for the
			     CDFS, HFS, and NFS file systems, respectively.

	      Report the entire structure described in
			     statvfs(2).

	      Report the total number of inodes,
			     the number of free inodes, number of used inodes, and the percentage of inodes in use.

	      Report the allocation in kilobytes (KB).

	      Report on local file systems only.

	      Report the file system name.
			     If used with no other options, display a list of mounted file system types.

	      Specify options specific to the HFS file system type.
			     specific_options is a comma-separated list of suboptions.

			     The available suboption is:

				  Report the number of used and free inodes.

	      Report the total allocated block figures and the number of free blocks.

	      Report the percentage of blocks used,
			     the number of blocks used, and the number of blocks free.	This option cannot be used with other options.

	      Echo the completed command line, but perform no other action.
			     The command line is generated by incorporating the user-specified options and other  information  derived	from  This
			     option allows the user to verify the command line.

       When  is used on an HFS file system, the file space reported is the space available to the ordinary user, and does not include the reserved
       file space specified by

       Unreported reserved blocks are available only to users who have appropriate privileges.	See tunefs(1M) for information about

       When is used on NFS file systems, the number of inodes is displayed as -1 .  This is due to superuser access restrictions over NFS.

EXAMPLES

       Report the number of free disk blocks for all mounted file systems:

       Report the number of free disk blocks for all mounted HFS file systems:

       Report the number of free files for all mounted NFS file systems:

       Report the total allocated block figures and the number of free blocks, for all mounted file systems:

       Report the total allocated block figures and the number of free blocks, for the file system mounted as /usr:

WARNINGS

       does not account for:

	      o  Disk space reserved for swap space,
	      o  Space used for the HFS boot block (8K bytes, 1 per file system),
	      o  HFS superblocks (8K bytes each, 1 per disk cylinder),
	      o  HFS cylinder group blocks (1K-8K bytes each, 1 per cylinder group),
	      o  Inodes (currently 128 bytes reserved for each inode).

       Non-HFS file systems may have other items that this command does not account for.

       The option, from prior releases, has been replaced by the option.

FILES

       File system devices.
       Static information about the file systems
       Mounted file system table

SEE ALSO

       du(1), df(1M), fsck(1M), fstab(4), fstyp(1M), statvfs(2), mnttab(4).

STANDARDS CONFORMANCE

																	df_hfs(1M)
All times are GMT -4. The time now is 10:38 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy