Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Shell script to filter records in a zip file that contains matching columns from another file
Top Forums Shell Programming and Scripting Shell script to filter records in a zip file that contains matching columns from another file Post 302962581 by RudiC on Wednesday 16th of December 2015 05:45:16 AM
Old 12-16-2015
With file1 unzipped, try
Code:
awk '    
FNR == NR       {T[$1]
                 next
                }
FNR == 1        {print
                 next
                }
                {n = split ($3, X, ":")
                 S = DL = ""
                 for (i=6; i<=n; i++)   {TMP = sprintf ("%d", "0X" X[i])
                                         S = S sprintf ("%s%02x:%02x", DL, TMP/256, TMP%256)
                                         DL = ":"
                                        }
                }
S in T          {$3 = S
                 print
                }
' FS="," OFS="," file2 file1
col1,    col2 ,   col3
a ,      b ,c4:36:93:46:d4:0b
x,       y,08:80:39:f9:c9:a7

Last edited by RudiC; 12-16-2015 at 08:16 AM.. Reason: typos
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Count records in a zip file

Hello, I searched the forums on the keywords in the title I used above, but I did not find the answer: Is it possible to count records in a .zip file on an AIX machine if i don't have pkunzip installed? From all the research I'm reading in google and the reading of pkunzip in Unix.com,... (3 Replies)
Discussion started by: tekster757
3 Replies

2. Shell Programming and Scripting

Filter records in a file using AWK

I want to filter records in one of my file using AWK command (or anyother command). I am using the below code awk -F@ '$1=="0003"&&"$2==20100402" print {$0}' $INPUT > $OUTPUT I want to pass the 0003 and 20100402 values through a variable. How can I do this? Any help is much... (1 Reply)
Discussion started by: gpaulose
1 Replies

3. Shell Programming and Scripting

Shell script matching similar records

hello all, I have requirement to identify similar records matching about 80% to 90%.I have to black list customers with multiple accounts. The data is in the Oracle Database, but is there any way I can get the data into flat file and compare the strings and fetch similar matching records? ... (2 Replies)
Discussion started by: kashik786
2 Replies

4. Shell Programming and Scripting

Filter records based on 2nd file

Hello, I want to filter records of a file if they fall in range associated with a second file. First the chr number (2nd col of 1st file and 1st col of 2nd file) needs to be matched. Then if the 3rd col of the first file falls within any of the ranges specified by the 2nd and 3rd cols , then... (4 Replies)
Discussion started by: ritakadm
4 Replies

5. UNIX for Dummies Questions & Answers

Shell script to read lines in a text file and filter user data Shell Programming and Scripting

sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies

6. UNIX for Dummies Questions & Answers

Filter records in a huge text file from a filter text file

Hi Folks, I have a text file with lots of rows with duplicates in the first column, i want to filter out records based on filter columns in a different filter text file. bash scripting is what i need. Data.txt Name OrderID Quantity Sam 123 300 Jay 342 498 Kev 78 2500 Sam 420 50 Vic 10... (3 Replies)
Discussion started by: tech_frk
3 Replies

7. Shell Programming and Scripting

Script to find blank records in a file except for few columns

I have a file with the following format: X|High|2|GIC|DM||XHM|||6 Months X|Moderate|2|GIC|DM||XHM|||6 Months X|High|2|GCM|DM||XSF|||6 Months X|Med|2|GCM|DM||XSF|||6 Here there are ten columns but I need to print rows having blank records in any of the rows (except for 6th,8th and 9th... (10 Replies)
Discussion started by: chatwithsaurav
10 Replies

8. Shell Programming and Scripting

Shell script not able to zip the file using gzip

Hi all, I am calling Temp.sh and it is has simple line $gpath=`which gzip` $gpath $FilePath/My_temp.log if I run this script, logging to server then its works fine. But when I send this script over the SSH it does not work at it. gzip is command is not execute. I am using gzip 1.6... (2 Replies)
Discussion started by: girijajoshi
2 Replies

9. Shell Programming and Scripting

Help with Shell Scrip in Masking particular columns in .csv file or .txt file using shell script

Hello Unix Shell Script Experts, I have a script that would mask the columns in .csv file or .txt file. First the script will untar the .zip files from Archive folder and processes into work folder and finally pushes the masked .csv files into Feed folder. Two parameters are passed ... (5 Replies)
Discussion started by: Mahesh G
5 Replies

10. UNIX for Beginners Questions & Answers

Shell script to filter certain lines from a file

hi~ i need script on AIX. and have a text file following : create aa 1 2 3 from a@a; create bb from b; create cc 3 4 5 6 6 7 from c@c; (7 Replies)
Discussion started by: tomato00
7 Replies

LEARN ABOUT MOJAVE

zipsplit

zipnote(1)						      General Commands Manual							zipnote(1)

NAME

       zipsplit - split a zipfile into smaller zipfiles

SYNOPSIS

       zipsplit [-t] [-i] [-p] [-s] [-n size] [-r room] [-b path] [-h] [-v] [-L] zipfile

ARGUMENTS

       zipfile	Zipfile to split.

OPTIONS

       -t     Report how many files it will take, but don't make them.

       -i     Make index (zipsplit.idx) and count its size against first zip file.

       -n size
	      Make zip files no larger than "size" (default = 36000).

       -r room
	      Leave room for "room" bytes on the first disk (default = 0).

       -b path
	      Use path for the output zip files.

       -p     Pause between output zip files.

       -s     Do a sequential split even if it takes more zip files.

       -h     Show a short help.

       -v     Show version information.

       -L     Show software license.

DESCRIPTION

       zipsplit reads a zipfile and splits it into smaller zipfiles.

EXAMPLES

       To be filled in.

BUGS

       Does not yet support large (> 2 GB) or split archives.

SEE ALSO

       zip(1), unzip(1)

AUTHOR

       Info-ZIP

								v3.0 of 8 May 2008							zipnote(1)
All times are GMT -4. The time now is 01:47 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy