Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: CSV Split field to check multiple codes
Top Forums Shell Programming and Scripting CSV Split field to check multiple codes Post 302963623 by Skrynesaver on Monday 4th of January 2016 11:25:12 AM
Old 01-04-2016
HUGE ASSUMPTION WARNING
I am assuming that the EAN code is unique across both files for any one product...

ALSO UNTESTED CODE WARNING, but the germ of an idea
Code:
perl -ne '
BEGIN{
  open (my $our_file,"<","/path/to/file1/with/just/ean/and/sku");
  while (<$our_file>){
    my@r=split/;/,$_;
    for my $ean (split/,/,$r[0]){
      $rec1{$ean}=$_;
    }
  }
}
@r=split/;/,$_;
@ean=split/,/,$r[0];
for $ean (@ean){
  if ($rec1{$ean}){
    @p=split/;/,$rec1{$ean};
    @our_eans=split/,/,$p[0];
    my %eans;
    for (@ean,@our_ean){
      $eans{$_}++;
    }
    print join(";",join(",",keys %eans),$p[1],@r[1,2,3]),"\n";
  }
}' path/to/file2 >merged_file.csv

 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Matching lines across multiple csv files and merging a particular field

I have about 20 CSV's that all look like this: "","","","","","","","","","","","","","","",""What I've been told I need to produce is the exact same thing, but with each file now containing the start_code from every other file where the email matches. It doesn't matter if any of the other... (1 Reply)
Discussion started by: Demosthenes
1 Replies

2. Shell Programming and Scripting

Field validations in multiple files CSV

Hi, I am regular reader of this forum. My advanced thanks to everyone. Below given are the sample files INDATA (Main data) Fild1Çfld2Çfld3….. Fild1Çfld2Çfld3….. Fild1Çfld2Çfld3….. Fild1Çfld2Çfld3….. Fild1Çfld2Çfld3….. . . N records (140000) eg GRPDATA (Reference file) (2 Replies)
Discussion started by: hyperion.krish
2 Replies

3. Shell Programming and Scripting

awk to split one field and print the last two fields within the split part.

Hello; I have a file consists of 4 columns separated by tab. The problem is the third fields. Some of the them are very long but can be split by the vertical bar "|". Also some of them do not contain the string "UniProt", but I could ignore it at this moment, and sort the file afterwards. Here is... (5 Replies)
Discussion started by: yifangt
5 Replies

4. Shell Programming and Scripting

Split a file into multiple files based on field value

Hi, I've one requirement. I have to split one comma delimited file into multiple files based on one of the column values. How can I achieve this Unix Here is the sample data. In this case I have split the files based on date column(c4) Input file c1,c2,c3,c4,c5... (1 Reply)
Discussion started by: manasvi24
1 Replies

5. Shell Programming and Scripting

How to split file into multiple files using awk based on 1 field in the file?

Good day all I need some helps, say that I have data like below, each field separated by a tab DATE NAME ADDRESS 15/7/2012 LX a.b.c 15/7/2012 LX1 a.b.c 16/7/2012 AB a.b.c 16/7/2012 AB2 a.b.c 15/7/2012 LX2 a.b.c... (2 Replies)
Discussion started by: alexyyw
2 Replies

6. Linux

How do I format a Date field of a .CSV file with multiple commas in a string field?

I have a .CSV file (file.csv) whose data are all enclosed in double quotes. Sample format of the file is as below: column1,column2,column3,column4,column5,column6, column7, Column8, Column9, Column10 "12","B000QRIGJ4","4432","string with quotes, and with a comma, and colon: in... (3 Replies)
Discussion started by: dhruuv369
3 Replies

7. Shell Programming and Scripting

Split a .csv File into Multiple Files

Hi guys, I have a requirement where i need to split a .csv file into multiple files. Say for example i have data.csv file and i have splitted that into multiple files based on some conditions i.e first file should have 100, last file 50 and other files 1000 each. Am passing the values in... (2 Replies)
Discussion started by: azherkn3
2 Replies

8. Shell Programming and Scripting

Match columns from two csv files and update field in one of the csv file

Hi, I have a file of csv data, which looks like this: file1: 1AA,LGV_PONCEY_LES_ATHEE,1,\N,1,00020460E1,0,\N,\N,\N,\N,2,00.22335321,0.00466628 2BB,LES_POUGES_ASF,\N,200,200,00006298G1,0,\N,\N,\N,\N,1,00.30887539,0.00050312... (10 Replies)
Discussion started by: djoseph
10 Replies

9. Shell Programming and Scripting

awk - CSV file - field with single or multiple spaces

Hi, In a csv file, I want to select records where first column has zero or multiple spaces. Eg: abc.csv ,123,a ,22,b ,11,c a,11,d So output should be: ,123,a ,22,b ,11,c Please advise (5 Replies)
Discussion started by: vegasluxor
5 Replies

LEARN ABOUT DEBIAN

flow-split

flow-split(1)						      General Commands Manual						     flow-split(1)

NAME

       flow-split -- Split flow files into smaller files.

SYNOPSIS

       flow-split [-gGhn]  [-b big|little]  [-C comment]  [-d debug_level]  [-N nflows]  [-o outfile_basename]	[-T nseconds]  [-z z_level]

DESCRIPTION

       The flow-split utility will split a flow file into smaller files based on the the number of flows or the ammount of time that has passed.

OPTIONS

       -b big|little
		 Byte order of output.

       -C Comment
		 Add a comment.

       -d debug_level
		 Enable debugging.

       -g	 Split on source tag.

       -G	 Split on destination tag.

       -h	 Display help.

       -n	 Use symbols for tag field in filename.

       -N nflows Split after processing nflows.

       -o outfile_basename
		 The basename of the resulting files.

       -T nsecond
		 Split after processing an interval of nseconds flows.

       -z z_level
		 Configure compression level to  z_level.  0 is disabled (no compression), 9 is highest compression.

EXAMPLES

       Create 1 minute flow files from the flow archive in /flows/krc4.  Store the results in /flows/krc4.split

	 flow-cat /flows/krc4 | flow-split -T60 -o /flows/krc4.split/1min.

BUGS

       None known.

AUTHOR

       Mark Fullmer maf@splintered.net

SEE ALSO

       flow-tools(1)

																     flow-split(1)
All times are GMT -4. The time now is 04:15 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy