Visit Our UNIX and Linux User Community


comparing csv files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting comparing csv files
# 1  
Old 12-13-2011
comparing csv files

Hi!
I'm just new to shell scripting n simple tasks looks so tough in initial stage. i need to write a script which will read a property file, property file will be containing count of the csv files, and in a folder(same folder) there will be respective csv files.
like Property file
data1=100
data2=50
data3=45
data4=40
and in a directory corresponding csv files will be there.

I need to make a script that can first read property file and search for the keyword like data1 csv files in folder and match the count, if they are equal proceed proceed further if not send an error mail. i totally confused with this, its like climbing mountain like a newbie for me....plz help me out with thisSmilie
Thanks a lot..
# 2  
Old 12-13-2011
To climb mountains, you need good shoes for a start...Are you equiped? Smilie

I always use to make mountains out of things till I went I see a psychiatrist...
First thing to learn is to analyse correctly the task ( describe!!) then strip down to the maximum all that is involved (to elementary tasks...) leaving aside what you don't know yet and try to express the result into pseudocode, if that is done then it is just a question of translating...
We will be glad to help you once we have seen a start (even pseudocode...)

Courage!
# 3  
Old 12-15-2011
Hi vbe thanks for advising me the right way to learn...
as per my little knowledge i tried to make pseudo code...

1.Find *data1* in prop file
2. Count value against *data1*
3. Store in var1
4. Search and count *data1*.csv
5. Store the count in var2
6. if var1=var2
return 0
7. else
trigger mail
8.done

hope i m on right way ....guide me further @vbe also tell me some good links n books to learn shell scripting....
thanks
# 4  
Old 12-21-2011
Hi as per my experience in scripting.. i tried i'm posting here... i know its need a lot of corrections as well as making all the commands together...

Code:
   #!/bin/bash
  #while loop to read line by line
  N=0
  While read LINE ; do
  N=$((N+1))
  echo “Line $N = $LINE
  done
  
  
    # cut command to extract columns
  cut -f 1,3,4 -d ‘|' Jewson.csv
  
  
    #if else clause to check the columns if they contain something or empty
  if ($1==[a-zA-Z][0-9] && $2==[a-zA-Z][0-9] && $3==$1==[a-zA-Z][0-9])
  then
  return 0
  else
  #send mail to admin {code for sendmail server}
  fi

Now anyone can please help me out to make a working script for my need.
thanks...

Previous Thread | Next Thread
Test Your Knowledge in Computers #248
Difficulty: Easy
ARPANET was designed to reliably transmit 911 messages, and to inform the host computer when it loses a message.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

awk assistance - Comparing 2 csv files

Hello all, I have searched high and low for a solution to this, many have come really close but not quite what I'm after. I have 2 files. One contains GUID's, for example: 8121E002-96FE-4C9C-BC5A-6AFF20DACECD 84468F30-F3B7-418B-81F0-0908E80792BF A second file, contains a path to the... (8 Replies)
Discussion started by: tirmUK
8 Replies

2. Shell Programming and Scripting

Comparing two CSV files

I have two csv files and im trying to compare them. e.g. SAMPLE DATA: file one: ZipCode Name 20878 Washington 10023 Missouri 20304 Maryland file two: ID Name City ZipCode 11654 ... (11 Replies)
Discussion started by: dan139
11 Replies

3. Shell Programming and Scripting

Comparing Select Columns from two CSV files in UNIX and create a third file based on comparision

Hi , I want to compare first 3 columns of File A and File B and create a new file File C which will have all rows from File B and will include rows that are present in File A and not in File B based on First 3 column comparison. Thanks in advance for your help. File A A,B,C,45,46... (2 Replies)
Discussion started by: ady_koolz
2 Replies

4. Shell Programming and Scripting

Comparing two large unsorted csv files

Hi All, My requirement is to write a shell script to compare two large csv files. I've created sample files for explaining my problem i.e., a.csv and b.csv contents of files: ----------------- a.csv ------ Type,Memory (Kb),Location HD,Size (Mb),Serial # XT,640,D402,0,MG0010... (2 Replies)
Discussion started by: vasavi
2 Replies

5. Shell Programming and Scripting

Comparing 2 CSV files and sending the difference to a new csv file

(say) I have 2 csv files - file1.csv & file2.csv as mentioned below: file1.csv ID,version,cost 1000,1,30 2000,2,40 3000,3,50 4000,4,60 file2.csv ID,version,cost 1000,1,30 2000,2,45 3000,4,55 6000,5,70 ... (1 Reply)
Discussion started by: Naresh101
1 Replies

6. Shell Programming and Scripting

Comparing 2 difference csv files

Hello, I have about 10 csv files which range from csv1 - csv10. Each csv file has same type/set of tabs and we have around 5-6 tabs for each of the csv file which have slightly different content(data). A sample of CSV1 is shown below: Joins: Data related to Joins, it can be any number of... (2 Replies)
Discussion started by: bobby1015
2 Replies

7. Shell Programming and Scripting

removing duplicate records comparing 2 csv files

Hi All, I want to remove the rows from File1.csv by comparing a column/field in the File2.csv. If both columns matches then I want that row to be deleted from File1 using shell script(awk). Here is an example on what I need. File1.csv: RAJAK,ACTIVE,1 VIJAY,ACTIVE,2 TAHA,ACTIVE,3... (6 Replies)
Discussion started by: rajak.net
6 Replies

8. Shell Programming and Scripting

Comparing Strings in 2 .csv/txt files?

EDIT: My problems have been solved thanks to the help of bartus11 and pravin27 This code is just to help me learn. It serves no purpose other than that. Here's a sample csv that I'm working with - #listofpeeps.csv Jackie Chan,1954,M Chuck Norris,1930,M Bruce Lee,1940,M This code is... (13 Replies)
Discussion started by: chickeneaterguy
13 Replies

9. Shell Programming and Scripting

Comparing 2 csv files and matching content

Hello, I have the following problem: There are two csv files csv-file #1: aaa1, aaa2, ... aaan aaa1, bbb2, ... bbbn aaa1, ccc2, ... cccn bbb1, bbb2, ... bbbn ... zzz1, zzz2, ... zzzn csv-file #2: aaa1, matchvalue1 ccc1, matchvalue2 (7 Replies)
Discussion started by: ghl10000
7 Replies

10. Shell Programming and Scripting

Last field problem while comparing two csv files

Hi All, I've two .csv files as below file1.csv abc, tdf, 223, tpx jgsd, tex, 342, rpy a, jdjdsd, 423, djfkld Where as file2.csv is the new version of file1.csv with some added fields in the end of each line and some additional lines. lfj, eru, 98, jkldj, 39, jdkj9 abc, tdf, 223, tpx,... (3 Replies)
Discussion started by: ganapati
3 Replies

Featured Tech Videos