Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Combine columns from multiple files
Top Forums Shell Programming and Scripting Combine columns from multiple files Post 302634585 by hfreyer on Thursday 3rd of May 2012 02:16:07 PM
Old 05-03-2012
Here is a try in perl (works for more than two input files, too):
Save code as comb.pl and call with: perl comb.pl input1 input2 ...
Code:
#!/usr/bin/perl
exit if $#ARGV < 0;
for ($i=0; $i<=$#ARGV; $i++) {
  push @init, "";
}
$n=0;
push @header, "nr";
while ($ARG = shift) {
  push @header, $ARG;
  open(IN, $ARG) || die "cannot open $ARG";
  while (<IN>) {
    chomp;
    split;
    $entry{@_[0]} = [ @init ] if !defined($entry{@_[0]});
    $entry{@_[0]}[$n] = @_[1];
  }
  $n++;
}
for ($i=0; $i<=$n; $i++) {
  printf("%-10s", $header[$i]);
}
print "\n";
foreach $key (sort {$a <=> $b} keys(%entry)) {
  printf("%-10s", $key);
  for ($i=0; $i<$n; $i++) {
    printf("%-10s",${entry{$key}}[$i]);
  }
  print "\n";
}

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Combine multiple columns from multiple files

Hi there, I was wondering if someone can help me with this. I am trying the combine multiple columns from multiple files into one file. Example file 1: c0t0d0 c0t2d0 # hostname vgname c0t0d1 c0t2d1 # hostname vgname c0t0d2 c0t2d2 # hostname vgname c0t1d0 c0t3d0 # hostname vgname1... (5 Replies)
Discussion started by: martva
5 Replies

2. UNIX for Dummies Questions & Answers

Combine multiple files with common string into one new file.

I need to compile a large amount of data with a common string from individual text files throughout many directories. An example data file is below. I want to search for the following string, "cc_sectors_1" and combine all the data from each file which contains this string, into one new... (2 Replies)
Discussion started by: GradStudent2010
2 Replies

3. Shell Programming and Scripting

combine multiple files by column into one files already sorted!

I have multiple files; each file contains a certain data in a column view simply i want to combine all those files into one file in columns example file1: a b c d file 2: 1 2 3 4 file 3: G (4 Replies)
Discussion started by: ahmedamro
4 Replies

4. Shell Programming and Scripting

How to combine 2 files into 1 file with 2 columns

Hi Guys, I want to combine 2 files and and put together in 1 file and make two columns out it. See below desired output. Any help will be much appreciated. inputfile1.txt 12345 67890 24580 inputfile2.txt AAAAA BBBBB CCCCC (11 Replies)
Discussion started by: pinpe
11 Replies

5. Emergency UNIX and Linux Support

Combine multiple Files into one big file

Hi Ppl, I have a requirement like i will be getting files of huge size daily and if the file size is so huge ,the files will be split into many parts and sent.The first file will have the header details followed by detail records and the consecutive files will have detail records and the last... (11 Replies)
Discussion started by: ganesh_248
11 Replies

6. UNIX for Dummies Questions & Answers

How to combine 2 files with 6 columns?

This may seem obvious but I am having problems doing this as columns get converted to rows when i try to write a script. I have 2 files text1.txt and text2.txt each of which have 6 columns of numbers separated by a space. I need to combine the 2 files so that the output file text3.txt maintains... (2 Replies)
Discussion started by: tgoldstone
2 Replies

7. UNIX for Dummies Questions & Answers

Combine columns from 100 files with same structure

Hi, I have a bunch of files with the following format. PUR.1.9 30910 0.024 0.926 0.050 36587 0.024 0.927 0.049 91857 0.023 0.928 0.049 105797 0.024 0.927 0.049 146659 0.024 0.927 0.049 152695 0.024 0.927 0.049 192118 0.022 0.930 0.048 193310 0.018 0.936 0.046 PUR.2.9 30910 0.028... (6 Replies)
Discussion started by: genehunter
6 Replies

8. Shell Programming and Scripting

Combine Multiple Files into Single One File One after other

I am trying to combine 4 .dat files into one single Output file Inputs are:- file123.dat, file256.dat, file378.dat & file490 Expected Output:- FileName=file1 {text from file1} EOF {blank line} FileName=file2 {text from file2} EOF {blank line} FileName=file3 {text from file3} EOF... (4 Replies)
Discussion started by: lancesunny
4 Replies

9. Shell Programming and Scripting

Combine columns from many files but keep them aligned in columns-shorter left column issue

Hello everyone, I searched the forum looking for answers to this but I could not pinpoint exactly what I need as I keep having trouble. I have many files each having two columns and hundreds of rows. first column is a string (can have many words) and the second column is a number.The files are... (5 Replies)
Discussion started by: isildur1234
5 Replies

10. Shell Programming and Scripting

Combine and complete multiple CSV files based on 1 parameter

I have to create a new CSV file based on the value listed on the 3rd column from different CSV files. This is what I need: 1. I should substitute the first column from each file, excluding the headers, with the file name InputXX. 2. Then, I need to look for rows with 0 on the third column in... (7 Replies)
Discussion started by: Xterra
7 Replies

LEARN ABOUT DEBIAN

mincconcat

MINCCONCAT(1)							 MINC User's Guide						     MINCCONCAT(1)

NAME

       mincconcat - concatenate minc files along a specific dimension

SYNOPSIS

       mincconcat [<options>] <infile1>.mnc [<infile2>.mnc ...] <outfile>.mnc

DESCRIPTION

       Mincconcat  will  concatenate  a number of minc files together, producing a single output file. The concatenation is done along a specified
       dimension, with the slices being sorted into ascending order.  The concatenation dimension can either be a dimension in the file, in  which
       case coordinates for sorting are taken directly from the input files, or it can be a new dimension and the coordinates are specified with a
       command-line option.

OPTIONS

       Note that options can be specified in abbreviated form (as long as they are unique) and can be given anywhere on the command line.

General options
       -2     Create a MINC 2.0 format output file.

       -clobber
	      Overwrite an existing file.

       -noclobber
	      Don't overwrite an existing file (default).

       -verbose
	      Print out progress information for each chunk of data copied (default).

       -quiet Do not print out progress information.

       -max_chunk_size_in_kb size
	      Specify the maximum size of the copy buffer (in kbytes). Default is 4096 kbytes.

       -filelist filename
	      Specify a file containing a list of input file names. If "-" is given, then file names are read from stdin. If this option is given,
	      then there should be no input file names specified on the command line. Empty lines in the input file are ignored.

Output type options
       -filetype
	      Don't do any type conversion (default).

       -byte  Write out 8-bit integer voxels.

       -short Write out 16-bit integer voxels.

       -int   Write out 32-bit integer voxels.

       -long  Superseded by -int.

       -float Write out single-precision floating point values.

       -double
	      Write out double-precision floating point values.

       -signed
	      Write out values as signed integers (default for short and long). Ignored for floating point types.

       -unsigned
	      Write out values as unsigned integers (default for byte). Ignored for floating point types.

       -valid_range min max
	      Specifies  the  valid range of output voxel values in their integer representation. Default is the full range for the type and sign.
	      This option is ignored for floating point values.

Concatenation options
       -concat_dimension name
	      Specifies the name of concatenation dimension. If the dimension exists in the input files, then coordinates  are	taken  from  those
	      files.  If  not,	then  a  new  dimension  is created and the coordinate for each input file is taken from command-line options. The
	      default is to use the slowest varying dimension of the first file.

       -start start
	      Specifies the starting coordinate for the new dimension (default = 0.0).

       -step step
	      Specifies the separation between voxels for the new dimension (default = 1.0).

       -width width
	      Specifies the (constant) width of each sample along the new dimension (default = none).

       -coordlist c1,c2,...
	      Specifies a comma-separated list of coordinates along the new dimension.

       -widthlist w1,w2,...
	      Specifies a comma-separated list of widths along the new dimension.

       -filestarts s1,s2,...
	      Specifies a comma-separated list of offsets to the coordinate origins for each of the files listed on the command line. This  option
	      is  useful  for concatenating files along an existing dimension, for example for concatenating multiple functional runs along a time
	      dimension.

       -check_dimensions
	      Check that all input files have matching sampling in world dimensions (default).

       -nocheck_dimensions
	      Ignore any differences between input files in world dimensions sampling.

       -ascending
	      Sort coordinates in ascending order (default).

       -descending
	      Sort coordinates in descending order.

       -interleaved
	      Sort slabs by their dimension coordinate, interleaving if necessary (default).

       -sequential
	      Don't sort slabs, just concatenate them together. WARNING - this will destroy the  dimension  information  along	the  concatenating
	      dimension, replacing the start and step with zero and one.

Generic options for all commands:
       -help  Print summary of command-line options and exit.

       -version
	      Print the program's version number and exit.

EXAMPLES

       To concatenate two volumes with dimensions zspace, yspace, xspace, having interleaved slices along zspace, we can simply use

	  mincconcat input1.mnc input2.mnc output.mnc

       If we have a bunch of compressed (yspace,  xspace) images that we wish to concatenate into an evenly spaced volume, then we can type

	  mincconcat input1.mnc.gz input2.mnc.gz input3.mnc.gz 
	     input4.mnc.gz output.mnc 
	     -concat_dimension zspace -start -23 -step 2

AUTHOR

       Peter Neelin

COPYRIGHTS

       Copyright (C) 1995 by Peter Neelin

							   $Date: 2005-07-15 17:38:08 $ 					     MINCCONCAT(1)
All times are GMT -4. The time now is 10:19 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy