Visit Our UNIX and Linux User Community


Match list of strings in File A and compare with File B, C and write to a output file in CSV format


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Match list of strings in File A and compare with File B, C and write to a output file in CSV format
# 1  
Old 10-10-2012
Match list of strings in File A and compare with File B, C and write to a output file in CSV format

Hi Friends,

I'm a great fan of this forum... it has helped me tone my skills in shell scripting. I have a challenge here, which I'm sure you guys would help me in achieving...

File A has a list of job ids and I need to compare this with the File B (*.log) and File C (extend *.log) and copy the valid string/lines to a output .CSV file based on the given search criteria.

I have attched the joblist and log file for your reference. Any early help would be greatly appreciated.

Thanks,
NK
# 2  
Old 10-10-2012
You have mentioned three input files but only included two, and not clearly mentioned which is A, which is B, and which is C(missing).

If they are short, it would be just as easy to paste them into your post using code tags: {code}stuff{/code} except with [] instead of {}.
# 3  
Old 10-11-2012
File A is joblist.txt
File B is job.log
File C would be an extended log of job.log, which is quite huge for me to upload here.

I have tried the below script and only the list from joblist gets stored in the output file.
Code:
awk '
FILENAME=="joblist.txt" {
for(i=1;i<=NF;i++ ) {Keys[$i]++}
}
FILENAME=="job.log" {
found=0
for(i=1;i<=NF;i++)
{ if(Keys[$i]>0) {found++; }}
if (found != 2 ) {
print $0; found = 0; break;
}
}
' joblist.txt job.log >>diff.csv

---------- Post updated 10-11-12 at 11:12 AM ---------- Previous update was 10-10-12 at 01:05 PM ----------

hello Friends, Can you someone respond to this request.

Last edited by Franklin52; 10-11-2012 at 05:18 AM.. Reason: Please use code tags for data and code samples
# 4  
Old 10-11-2012
Moderator's Comments:
Mod Comment Bumping up posts or double posting is not permitted in these forums.

Please read the rules, which you agreed to when you registered, if you have not already done so.

You may receive an infraction for this. If so, don't worry, just try to follow the rules more carefully. The infraction will expire in the near future

Thank You.

The UNIX and Linux Forums.


What output would you expect from the above files? Without seeing that, we're just guessing.
# 5  
Old 10-11-2012
Hi Corona,

Expected output would be the list of lines that match with the job_ids that are present in the joblist.txt file.

Bascially, compare the list of job_ids present in the joblist.txt, with the job.log file and write only the lines that are matching with the job_ids >>to the output file

Thanks,
NK
# 6  
Old 10-11-2012
Note of the job_ids on the joblsit file are on the log file. Some jobs are listed in over 60 lines on the log file. Are those lines to be put on CSV file? Are all lines that match (if there was a match) to be put on a CSV file?
# 7  
Old 10-11-2012
All the lines in the job log that match to the job_ids requires to be put on a csv file

Thanks,
NK

Previous Thread | Next Thread
Test Your Knowledge in Computers #445
Difficulty: Easy
Scientific Linux has been loaded onto systems at the International Space Station.
True or False?

10 More Discussions You Might Find Interesting

1. Programming

Python or Shell script to Grep strings from input file and output in csv format

Hi Experts, I am writing a python script to grep string from file and display output in csv file as in attached screenshot https://drive.google.com/file/d/1gfUUdfmQma33tz65NskThYDhkZUGQO0H/view Input file(result_EPFT_config_device) Below is the python script i have prepared as of... (1 Reply)
Discussion started by: as7951
1 Replies

2. UNIX for Beginners Questions & Answers

Use strings from nth field from one file to match strings in entire line in another file, awk

I cannot seem to get what should be a simple awk one-liner to work correctly and cannot figure out why. I would like to use patterns from a specific field in one file as regex to search for matching strings in the entire line ($0) of another file. I would like to output the lines of File2 which... (1 Reply)
Discussion started by: jvoot
1 Replies

3. Shell Programming and Scripting

How to parse this file using awk and output in CSV format?

My source file looks like this: Cust-Number = "101" Cust-Name="Joe" Cust-Town="London" Cust-hobby="tennis" Cust-purchase="200" Cust-Number = "102" Cust-Name="Mary" Cust-Town="Newyork" Cust-hobby="reading" Cust-purchase="125" Now I want to parse this file (leaving out hobby) and... (10 Replies)
Discussion started by: Balav
10 Replies

4. Shell Programming and Scripting

Compare two and write updated output in third file

Hi Linux Experts. I have a requirement where i need to update the thousands of table definitions to extend the column length and character set therefore i am looking for some sort of linux script which i can use to update the length and chacterset. I have two files In first file i have 7... (1 Reply)
Discussion started by: Black-Linux
1 Replies

5. Shell Programming and Scripting

Compare 2 files of csv file and match column data and create a new csv file of them

Hi, I am newbie in shell script. I need your help to solve my problem. Firstly, I have 2 files of csv and i want to compare of the contents then the output will be written in a new csv file. File1: SourceFile,DateTimeOriginal /home/intannf/foto/IMG_0713.JPG,2015:02:17 11:14:07... (8 Replies)
Discussion started by: refrain
8 Replies

6. Shell Programming and Scripting

Compare 2 text file with 1 column in each file and write mismatch data to 3rd file

Hi, I need to compare 2 text files with around 60000 rows and 1 column. I need to compare these and write the mismatch data to 3rd file. File1 - file2 = file3 wc -l file1.txt 58112 wc -l file2.txt 55260 head -5 file1.txt 101214200123 101214700300 101250030067 101214100500... (10 Replies)
Discussion started by: Divya Nochiyil
10 Replies

7. Shell Programming and Scripting

Csv format output file using scirpt

Hi All, I get the test result file daily after running the main test script. from the resultfile, need to fetch only server info and status and put them in tabular format in a file and as well in CSV format output file. I tried using awk command but am not able to put them in tabluar... (6 Replies)
Discussion started by: Optimus81
6 Replies

8. Shell Programming and Scripting

extract strings from file and display in csv format

Hello All, I have a file whose data looks something like this I want to extract just the id, name and city fields in a csv format and sort them by id. Output should look like this. 1,psi,zzz 2,beta,pqr 3,theta,xyz 4,alpha,abc 5,gamma,jkl (12 Replies)
Discussion started by: grajp002
12 Replies

9. Shell Programming and Scripting

format output in csv file

I am sending the output of a file to .csv file. The output should look like this: Total Customers Processed:,8 Total Customers Skipped:,0 Total Customers Added:,8 Total Customers Changed:,0 Total Policies Deleted:,0 Total Policies Failed:,0 total:,8 Now i want this output in... (1 Reply)
Discussion started by: Prashant Jain
1 Replies

10. Shell Programming and Scripting

Need to compare two csv files values and write into another csv file

Hi all, Am new to scripting. So i just need your ideas to help me out. Here goes my requirement. I have two csv files 1.csv 2.csv abc,1.24 abc,1 def,2.13 def,1 I need to compare the first column of 1.csv with 2.csv and if matches then need to compare... (2 Replies)
Discussion started by: chinnahyd
2 Replies

Featured Tech Videos