Multi File processing


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Multi File processing
# 1  
Old 01-08-2008
Multi File processing

Hello,

I have 2 csv files:
File1:
Code:
Name,year,organization
Jim,2007,Org1
Bob,1999,Org3
Chris,2001,Org2

File2:
Code:
DocumentName,DocumentTitle,organization,year
Test1,Test1,Org1,2007
Test2,Test2,Org2,2008
Test3,Test3,Org3,2009


Using the ksh, I'm reading by line and grabbing the value in the 2nd column ($2). I want to use this value and search the second file to find a line with a match. If it is found I want to grab the value of column 1 ($1) of the second file during that read


Code:
while readline
 do
    if test $i -ge 1;
    then
        echo "$line" awk '{print $1","$2}' >> File3 

        now use $2 to search File2 for a match
        if found print the value of $1 in File2 to File3    fi
 done < $File1


Result
Code:
Jim,2007,Test1

Can anyone give me some insight as to how this can be done?


thanks
# 2  
Old 01-08-2008
Code:
awk 'BEGIN{FS=OFS=","}
FNR==NR{arr[$2]=$1;next}
$4 in arr{print $4,arr[$4],$1}
' file1 file2

Regards
# 3  
Old 01-10-2008
thanks for the feedback...I will try to incorporate this into my script
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help with reformat single-line multi-fasta into multi-line multi-fasta

Input File: >Seq1 ASDADAFASFASFADGSDGFSDFSDFSDFSDFSDFSDFSDFSDFSDFSDFSD >Seq2 SDASDAQEQWEQeqAdfaasd >Seq3 ASDSALGHIUDFJANCAGPATHLACJHPAUTYNJKG ...... Desired Output File >Seq1 ASDADAFASF ASFADGSDGF SDFSDFSDFS DFSDFSDFSD FSDFSDFSDF SD >Seq2 (4 Replies)
Discussion started by: patrick87
4 Replies

2. Programming

Multi head/multi window hello world

I am trying to write a large X app. I have successfully modified my xorg.conf to setup 4 monitors on an NVIDIA Quatro5200. I am trying to modify a simple hello world application to open a window on three of the four monitors. depending on the changes to loop the window creation section and event... (2 Replies)
Discussion started by: advorak
2 Replies

3. Programming

awk processing / Shell Script Processing to remove columns text file

Hello, I extracted a list of files in a directory with the command ls . However this is not my computer, so the ls functionality has been revamped so that it gives the filesizes in front like this : This is the output of ls command : I stored the output in a file filelist 1.1M... (5 Replies)
Discussion started by: ajayram
5 Replies

4. Shell Programming and Scripting

How to substract selective values in multi row, multi column file (using awk or sed?)

Hi, I have a problem where I need to make this input: nameRow1a,text1a,text2a,floatValue1a,FloatValue2a,...,floatValue140a nameRow1b,text1b,text2b,floatValue1b,FloatValue2b,...,floatValue140b look like this output: nameRow1a,text1b,text2a,(floatValue1a - floatValue1b),(floatValue2a -... (4 Replies)
Discussion started by: nricardo
4 Replies

5. Shell Programming and Scripting

Multi-line filtering based on multi-line pattern in a file

I have a file with data records separated by multiple equals signs, as below. ========== RECORD 1 ========== RECORD 2 DATA LINE ========== RECORD 3 ========== RECORD 4 DATA LINE ========== RECORD 5 DATA LINE ========== I need to filter out all data from this file where the... (2 Replies)
Discussion started by: Finja
2 Replies

6. Shell Programming and Scripting

Multi-copying a file

Hello there, I am writting a scrip with in shell (#!/bin/sh) and I need to copy 5 times the same file into different names: cp xsec.1.11 xsec.1.12 cp xsec.1.11 xsec.1.13 cp xsec.1.11 xsec.1.14 cp xsec.1.11 xsec.1.15 cp xsec.1.11 xsec.1.16 and I have to do that for several file.... (6 Replies)
Discussion started by: jolecanard
6 Replies

7. Shell Programming and Scripting

AWK Multi-Line Records Processing

I am an Awk newbie and cannot wrap my brain around my problem: Given multi-line records of varying lengths separated by a blank line I need to skip the first two lines of every record and extract every-other line in each record unless the first line of the record has the word "(CONT)" in the... (10 Replies)
Discussion started by: RacerX
10 Replies

8. Shell Programming and Scripting

multi file editing in vi

Hi all Some yeras ago (1994) I had a utility that bundled up multiple files into a big file with a seperator lines. Automatically loaded this temp file into vi - which allowed you to edit all the files. then when you :wq or ZZ vi it saved all the files bak to their appropriate file names and got... (0 Replies)
Discussion started by: ricl999
0 Replies

9. UNIX for Dummies Questions & Answers

Multi User Multi Task

Dear Experts Why we always hear that unix operating system is Multi User and Multi task. What does these two means. I have looked at some books and documents but couldn't find aclear explenation. Can we say Windows operating system is also multi user and multi task?? Thanks for your help in... (6 Replies)
Discussion started by: Reza Nazarian
6 Replies

10. UNIX for Dummies Questions & Answers

multi-file multi-edit

Good day! I am trying to learn how to use the "sed" editor, to perform multiple edits on multiple files in multiple directories. I have one script that tries to call up each file and process it according to the edits listed in a second script. I am using a small input text to test these, at... (12 Replies)
Discussion started by: kielitaide
12 Replies
Login or Register to Ask a Question