Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Splitting a file and sending results to another file
Top Forums UNIX for Dummies Questions & Answers Splitting a file and sending results to another file Post 302455227 by ladyAnne on Tuesday 21st of September 2010 07:43:15 AM
Old 09-21-2010
Thanks, but I really need it to have this format .. simply because I have to build on it this way ..
Code:
#!/bin/bash
set -x
dir="/var/local/dsx/csv"
gawk -F, '
 $1 == last1 && $2 == last2 {
  printf $0"\n" > $dir/$2
 }
 $1 != last1 || $2 != last2 {
  printf $0"\n" >> $dir/$2
 }
 {
  last1=$1
  last2=$2 
 } 
 '  $1

I basically need to know how to pass the results to a directory and filename, but these have to be variables since I will be running the script on many different files, and the esults get stored in a seperate directory

---------- Post updated at 05:33 AM ---------- Previous update was at 05:11 AM ----------

Okay.. I see that the path is not recognized by gawk.. so I have kind of seperated it.
Code:
#!/bin/bash
set -x
dir="/var/local/dsx/csv"


gawk -F, '
	$1 == last1 && $2 == last2 { 
		printf $0"\n" '>> $dir/'$2
	}
	$1 != last1 || $2 != last2 {
		printf $0"\n" '>> $dir/'$2
	}
	{
		last1=$1
		last2=$2 
	}	
	'  $1

How do I redirect this output to a filname .. the filename comes from the data in the csv file

---------- Post updated at 05:34 AM ---------- Previous update was at 05:33 AM ----------

sorry, it should come from the filename of the sourcefile passed to it

---------- Post updated at 06:43 AM ---------- Previous update was at 05:34 AM ----------

Perhaps we can put it in a seperate awk script
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Splitting a file based on record sin another file

All, We receive a file with a large no of records (records can vary) and we have to split it into two files based on another file. e.g. File1: UHDR 2008112 "25187","00000022","00",21-APR-1991,"" ,"D",-000000519,+0000000000,"C", ,+000000000,+000000000,000000000,"2","" ,21-APR-1991... (7 Replies)
Discussion started by: er_ashu
7 Replies

2. Shell Programming and Scripting

File splitting, naming file according to internal field

Hi All, I have a rather stange set of requirements that I'm hoping someone here could help me with. We receive a file that is actually a concatenation of 4 files (don't believe this would change, but ideally the solution would handle n files). The super-file looks like:... (7 Replies)
Discussion started by: Leedor
7 Replies

3. Shell Programming and Scripting

Splitting a file in to multiple files and passing each individual file to a command

I have an input file with contents like: MainFile.dat: 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 ... (4 Replies)
Discussion started by: rkrish
4 Replies

4. UNIX for Dummies Questions & Answers

Pipe binary file matches grep results to file

I am using grep to match a pattern, but the output is strange. $ grep -r -o "pattern" * Gives me: Binary file foo1 matches Binary file foo2 matches Binary file foo3 matches To find the lines before/after, I then have to use the following on each file: $ strings foo1 | grep -A1 -B1... (0 Replies)
Discussion started by: chipperuga
0 Replies

5. UNIX for Dummies Questions & Answers

Extracting data from one file, based on another file (splitting)

Dear All, I have two files but want to extract data from one based on another... can you please help me file 1 David Tom Ellen and file 2 David|0010|testnamez|resultsz David|0004|testnamex|resultsx Tom|0010|testnamez|resultsz Tom|0004|testnamex|resultsx Ellen|0010|testnamez|resultsz... (12 Replies)
Discussion started by: A-V
12 Replies

6. Shell Programming and Scripting

Splitting XML file on basis of line number into multiple file

Hi All, I have more than half million lines of XML file , wanted to split in four files in a such a way that top 7 lines should be present in each file on top and bottom line of should be present in each file at bottom. from the 8th line actual record starts and each record contains 15 lines... (14 Replies)
Discussion started by: ajju
14 Replies

7. Shell Programming and Scripting

Execution of loop :Splitting a single file into multiple .dat file

hdr=$(cut -c1 $path$file|head -1)#extract header”H” trl=$(cut -c|path$file|tail -1)#extract trailer “T” SplitFile=$(cut -c 50-250 $path 1$newfile |sed'$/ *$//' head -1')# to trim white space and extract table name If; then # start loop if it is a header While read I #read file Do... (4 Replies)
Discussion started by: SwagatikaP1
4 Replies

8. Shell Programming and Scripting

Splitting a text file into smaller files with awk, how to create a different name for each new file

Hello, I have some large text files that look like, putrescine Mrv1583 01041713302D 6 5 0 0 0 0 999 V2000 2.0928 -0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 5.6650 0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 3.5217 ... (3 Replies)
Discussion started by: LMHmedchem
3 Replies

9. UNIX for Beginners Questions & Answers

Splitting the file based on two fields - Fixed length file

Hi , I am having a scenario where I need to split the file based on two field values. The file is a fixed length file. ex: AA0998703000000000000190510095350019500010005101980301 K 0998703000000000000190510095351019500020005101480 ... (4 Replies)
Discussion started by: saj
4 Replies

10. Shell Programming and Scripting

Create a text file and a pdf file from Linux command results.

Hello. The task : Using multiple commands like : gdisk -l $SOME_DISK >> $SOME_FILEI generate some text file. For readiness I must insert page break. When the program is finished I want to convert the final text file to a pdf file. When finished, I got two files : One text file and One pdf... (1 Reply)
Discussion started by: jcdole
1 Replies

LEARN ABOUT LINUX

update-fonts-dir

update-fonts-dir(8)                                           System Manager's Manual                                          update-fonts-dir(8)

NAME

       update-fonts-dir - compile fonts.dir files

SYNOPSIS

       update-fonts-dir [OPTION] directory ...

DESCRIPTION

       update-fonts-dir creates a fonts.dir file in an X font directory by invoking mkfontdir(1x) with the appropriate arguments.  It is typically
       invoked only from the post-installation and post-removal scripts of a package containing fonts for the X Window System, but may be  invoked
       at  any  time  to  reconstruct  fonts.dir  files.   For  each directory, which is simply the last component of its path (such as '75dpi' or
       'misc'), update-fonts-dir will generate either /usr/lib/X11/fonts/directory/fonts.dir or /usr/share/fonts/X11/directory/fonts.dir from  the
       fonts.scale and font files found within it.

       This  enables  multiple packages to provide names for fonts in the same directory.  No font package actually provides the fonts.dir file in
       the X font directory itself, so there is no danger of overwriting one package's font names with those of another.

       For instance, the two packages  'xfonts-base'  (real)  and  'xfonts-nifty'  (hypothetical)  may  both  install  fonts  into  the  directory
       /usr/lib/X11/fonts/misc,  and  update-fonts-dir  will  ensure that the fonts.dir file in that directory contains information about the font
       files provided by both packages.

       The format of fonts.dir files is described in the mkfontdir(1x) manual page.

       An example of how to use update-fonts-dir in package maintainer scripts is provided in the Debian Policy Manual.

OPTIONS

       -h, --help displays a brief usage message and exits.

       -7, --x11r7-layout switches the font layout to the one introduced in X11R7: fonts in /usr/share/fonts/X11/directory (default is:  fonts  in
       /usr/lib/X11/fonts/directory)

OPERANDS

       update-fonts-dir  takes  one or more X font directory names to operate on as operands.  Only the final path component of the directory name
       should be specified; e.g.,
              update-fonts-dir 75dpi
       is correct, while 'update-fonts-dir /usr/X11R6/lib/X11/fonts/75dpi' and 'update-fonts-dir /usr/lib/X11/fonts/75dpi' are not.

ENVIRONMENT

       COLUMNS
              indicates the width of the terminal device in character cells.  This value is used for formatting diagnostic messages.  If not  set,
              the terminal is queried using stty(1) to determine its width.  If that fails, a value of '80' is assumed.

DIAGNOSTICS

   Errors
       usage error: one or more font directories must be provided
              update-fonts-dir was invoked without operands.  Supply one or more X font directory names to operate on.

       usage error: unrecognized option
              update-fonts-dir was invoked with an unrecognized option argument.  Use only the options documented in "OPTIONS", above.

       fatal error: path to X font directory must be used
              A directory name was supplied that was not an X font directory name.  Supply X font directory names only.

   Warnings
       warning: absolute path directory was provided
              Usage of absolute paths is deprecated.  Use only the final component of the X font directory name for directory.

       warning: directory does not exist or is not a directory
              The supplied directory was invalid.  update-fonts-dir skipped it.

EXIT STATUS

       0      update-fonts-dir ran successfully.

       1      update-fonts-dir experienced a fatal error; see the section on diagnostic messages above.

       2      update-fonts-dir was invoked with invalid arguments.

BUGS

       See  the  Debian  Bug  Tracking  System <http://bugs.debian.org/xfonts-utils>.  If you wish to report a bug in update-fonts-dir, please see
       /usr/share/doc/debian/bug-reporting.txt or the reportbug(1) command.

AUTHOR

       update-fonts-dir was written by Branden Robinson.

SEE ALSO

       mkfontdir(1x)

Debian Project                                                      2004-11-11                                                 update-fonts-dir(8)
All times are GMT -4. The time now is 06:18 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy