Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Awk - join multiple files
Top Forums Shell Programming and Scripting Awk - join multiple files Post 302664997 by elixir_sinari on Monday 2nd of July 2012 12:22:44 AM
Old 07-02-2012
Code:
$ cat join.awk
{
 totalcnt[$1]++
 if(FILENAME != prevfilename)
  filesc++
 filecnt[filesc,$1]++
 fname[filesc]=prevfilename=FILENAME
}

END {
 for(i in totalcnt)
 {
  printf("%s\t%s",i,totalcnt[i])
  for(j=1;j<=filesc;j++)
  {
   printf("\t%s[%d]",fname[j],filecnt[j,i])
  }
  printf("%s","\n");
 }
}

Last edited by elixir_sinari; 07-02-2012 at 01:32 AM..
This User Gave Thanks to elixir_sinari For This Post:
quincyjones
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Awk Join multiple lines

Hi, I have data with broken lines: Sample data: "12"|"25"|"a"|"b"|"c"|"d"|"e"|"f"|"2453748"|"08:10:50" "16"|"25"|"a"|"b"|"c"|"d"|"e"|"f"|" 2453748"|"08:15:50" "16"|"25"|"a"|"b"|" c"|"d"|"e"|"f"|"2453748"|"08:19:50" "16"|"25"|"a"|"b"|"c"|"d"|"e"|"f"|"2453748"|"08:19:50" In the... (5 Replies)
Discussion started by: hitmansilentass
5 Replies

2. UNIX for Dummies Questions & Answers

Join 2 files with multiple columns: awk/grep/join?

Hello, My apologies if this has been posted elsewhere, I have had a look at several threads but I am still confused how to use these functions. I have two files, each with 5 columns: File A: (tab-delimited) PDB CHAIN Start End Fragment 1avq A 171 176 awyfan 1avq A 172 177 wyfany 1c7k A 2 7... (3 Replies)
Discussion started by: InfoSeeker
3 Replies

3. Shell Programming and Scripting

How to join multiple files?

I am trying to join a few hundred files using join. Is there a way to use while read or something else to automate this. My problem is the following. Day 1 City Temp ABC 20 DEF 30 HIJ 15 Day 2 City Temp ABC 22 DEF 29 KLM 5 Day 3 (3 Replies)
Discussion started by: theFinn
3 Replies

4. Shell Programming and Scripting

Join multiple files by column with awk

Hi all, I searched through the forum but i can't manage to find a solution. I need to join a set of files placed in a directory (~1600) by column, and obtain an output with first and second column common to each file, but following columns are taken from the file in the list (precisely the fourth... (10 Replies)
Discussion started by: macsx82
10 Replies

5. UNIX for Dummies Questions & Answers

How to use the the join command to join multiple files by a common column

Hi, I have 20 tab delimited text files that have a common column (column 1). The files are named GSM1.txt through GSM20.txt. Each file has 3 columns (2 other columns in addition to the first common column). I want to write a script to join the files by the first common column so that in the... (5 Replies)
Discussion started by: evelibertine
5 Replies

6. Shell Programming and Scripting

Sort and join multiple columns using awk

Is it possible to join all the values after sorting them based on 1st column key and replace empty rows with 0 like below ? input a1 0 a1 1 a1 1 a3 1 b2 1 a2 1 a4 1 a2 1 a4 1 c4 1 a3 1 d1 1 a3 1 b1 1 d1 1 a4 1 c4 1 b2 1 b1 1 b2 1 c4 1 d1 1 output... (8 Replies)
Discussion started by: quincyjones
8 Replies

7. Shell Programming and Scripting

Join multiple files

Hi there, I am trying to join 24 files (i showed example of 3 files below). They all have 2 columns. The first columns is common to all. The files are tab delimited eg file 1 rs0001 100e-34 rs0003 2.8e-01 rs008 1.9e-90 file 2 rs0001 1.98e-22 rs0004 3.77e-10... (4 Replies)
Discussion started by: fat
4 Replies

8. Shell Programming and Scripting

Join multiple files with filename

Please help, I want to join multiple files based on column 1, and put the missing values as 0. Also the colname in the output should say which file the values came from. FILE1 1 11 2 12 3 13 FILE2 2 22 3 23 4 24 FILE3 1 31 3 33 4 34 FILE1 FILE2 FILE3 1 11 0 31 (1 Reply)
Discussion started by: newbie83
1 Replies

9. Shell Programming and Scripting

Join files on multiple fields

Hello all, I want to join 2 tabbed files on the first 2 fields, and filling the missing values with 0. The 3rd column in each file is constant for the entire file. file1 12658699 ST5 XX2720 0 1 0 1 53039541 ST5 XX2720 1 0 1.5 1 file2 ... (6 Replies)
Discussion started by: sheetalk
6 Replies

10. Shell Programming and Scripting

Join, merge, fill NULL the void columns of multiples files like sql "LEFT JOIN" by using awk

Hello, This post is already here but want to do this with another way Merge multiples files with multiples duplicates keys by filling "NULL" the void columns for anothers joinning files file1.csv: 1|abc 1|def 2|ghi 2|jkl 3|mno 3|pqr file2.csv: 1|123|jojo 1|NULL|bibi... (2 Replies)
Discussion started by: yjacknewton
2 Replies

LEARN ABOUT DEBIAN

gcstar

GCSTAR(1)							Linux User's Manual							 GCSTAR(1)

NAME

       GCstar - Personal collection manager

SYNOPSIS

       gcstar [-u UPDATE-OPTIONS] [-x EXECUTE-OPTIONS] [FILENAME]

DESCRIPTION

       GCstar is a Gtk2 program used to manage personal collections.

OPTIONS

       Without any option, it will open FILENAME if specified or the previously opened file. There are also two groups of options.

   UPDATE-OPTIONS
       -u, --update
	      Tell GCstar to look for available updates

       -a, --all
	      Update all components

       -c, --collection
	      Update collection models

       -w, --website
	      Update plugins to download information

       -i, --import
	      Update plugins to import data

       -e, --export
	      Update plugins to export data

       -l, --lang
	      Update translations

       -n, --noproxy
	      Don't ask for a proxy

   EXECUTE-OPTIONS
       -x, --execute
	      Enter non-interactive mode

       -c, --collection MODEL
	      Specify the collection type

       -w, --website PLUGIN
	      Specify the plugin to use to download information

       -i, --import PLUGIN
	      Specify the plugin to use to import a collection

       -e, --export PLUGIN
	      Specify the plugin to use to export the collection

       -f, --fields FILENAME
	      File containing fields list to use for import/export

       -o, --output FILENAME
	      Write output in FILENAME instead of standard output

       --download TITLE
	      Search for the item with TITLE as name

       --importprefs PREFERENCES
	      Preferences for the import plugin

       --exportprefs PREFERENCES
	      Preferences for the export plugin

       Preferences for import/export plugins are specified using this schema
	      Key1=>Value1,Key2=>Value2

ENVIRONMENT

       HOME   Used to define following variables if needed

       XDG_CONFIG_HOME
	      Where configuration files should be stored. If not defined: $HOME/.config

       XDG_DATA_HOME
	      Where some data will be stored. If not defined: $HOME/.local/share

BUGS REPORTING

       To report bugs, please use this forum:

       http://forums.gcstar.org/viewforum.php?id=4

AUTHORS

       Tian <tian@c-sait.net>

       http://www.gcstar.org/

GCstar								  17 August 2006							 GCSTAR(1)
All times are GMT -4. The time now is 03:38 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy