shell script to join multiple files

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Join 2nd column of multiple files

Dear All, I have many files formatted like this: file1.txt: 1/2-SBSRNA4 18 A1BG 3 A1BG-AS1 6 A1CF 0 A2LD1 1 A2M 1160 file2.txt 1/2-SBSRNA4 53 A1BG 1 A1BG-AS1 7 A1CF 0 A2LD1 3 A2M 2780

2. Shell Programming and Scripting

Join files on multiple fields

Hello all, I want to join 2 tabbed files on the first 2 fields, and filling the missing values with 0. The 3rd column in each file is constant for the entire file. file1 12658699 ST5 XX2720 0 1 0 1 53039541 ST5 XX2720 1 0 1.5 1 file2 ...

3. Shell Programming and Scripting

Join multiple files with filename

Please help, I want to join multiple files based on column 1, and put the missing values as 0. Also the colname in the output should say which file the values came from. FILE1 1 11 2 12 3 13 FILE2 2 22 3 23 4 24 FILE3 1 31 3 33 4 34 FILE1 FILE2 FILE3 1 11 0 31

4. Shell Programming and Scripting

Join multiple files

Hi there, I am trying to join 24 files (i showed example of 3 files below). They all have 2 columns. The first columns is common to all. The files are tab delimited eg file 1 rs0001 100e-34 rs0003 2.8e-01 rs008 1.9e-90 file 2 rs0001 1.98e-22 rs0004 3.77e-10...

5. UNIX for Dummies Questions & Answers

How to use the the join command to join multiple files by a common column

Hi, I have 20 tab delimited text files that have a common column (column 1). The files are named GSM1.txt through GSM20.txt. Each file has 3 columns (2 other columns in addition to the first common column). I want to write a script to join the files by the first common column so that in the...

6. Shell Programming and Scripting

Awk - join multiple files

Is it possible to join all the files with input1 based on 1st column? input1 a b c d e f input2 a b input3 a e input4 c

7. Shell Programming and Scripting

Join multiple files by column with awk

Hi all, I searched through the forum but i can't manage to find a solution. I need to join a set of files placed in a directory (~1600) by column, and obtain an output with first and second column common to each file, but following columns are taken from the file in the list (precisely the fourth...

8. Shell Programming and Scripting

How to join multiple files?

I am trying to join a few hundred files using join. Is there a way to use while read or something else to automate this. My problem is the following. Day 1 City Temp ABC 20 DEF 30 HIJ 15 Day 2 City Temp ABC 22 DEF 29 KLM 5 Day 3

9. UNIX for Dummies Questions & Answers

Join 2 files with multiple columns: awk/grep/join?

Hello, My apologies if this has been posted elsewhere, I have had a look at several threads but I am still confused how to use these functions. I have two files, each with 5 columns: File A: (tab-delimited) PDB CHAIN Start End Fragment 1avq A 171 176 awyfan 1avq A 172 177 wyfany 1c7k A 2 7...

10. UNIX for Dummies Questions & Answers

Join multiple Split files in Unix

Hi, I have a big file of 50GB size. I need copy it to a second ftp from a ftp. I am not able to do the full 50GB transfer as it timesout after some time. SO i am trying to split the file into 5gb each 10 files with the below command. split -b 5368709120 pack.tar.gz backup.gz After I...

LEARN ABOUT HPUX

rc.config

rc.config(4)						     Kernel Interfaces Manual						      rc.config(4)

NAME

       rc.config, rc.config.d - files containing system configuration information

SYNOPSIS

DESCRIPTION

       The  system  configuration  used  at  startup  is  contained in files within the directory The file sources all of the files within and and
       exports their contents to the environment.

   /etc/rc.config
       The file is a script that sources all of the scripts, and also sources To read the  configuration  definitions,	only  this  file  need	be
       sourced.   This	file  is  sourced by whenever it is run, such as when the command is run to transition between run states.  Each file that
       exists in is sourced, without regard to which startup scripts are to be executed.

   /etc/rc.config.d
       The configuration information is structured as a directory of files, rather than as a single file containing the  same  information.   This
       allows  developers  to  create and manage their own configuration files here, without the complications of shared ownership and access of a
       common file.

   /etc/rc.config.d/* Files
       This is where files containing configuration variable assignments are located.

       Configuration scripts must be written to be read by the POSIX shell, and not the Bourne shell, or In some cases, these files must  also	be
       read  and  possibly modified by control scripts or the sam program.  See sd(4) and sam(1M).  For this reason, each variable definition must
       appear on a separate line, with the syntax:

       No trailing comments may appear on a variable definition line.  Comment statements must be on separate lines, with the comment character in
       column one.  This example shows the required syntax for configuration files:

       Configuration variables may be declared as array parameters when describing multiple instances of the variable configuration.  For example,
       a system may contain two network interfaces, each having a unique IP address and subnet mask (see ifconfig(1M)).  An example of such a dec-
       laration is as follows:

       Note  that  there  must	be  no requirements on the order of the files sourced.	This means configuration files must not refer to variables
       defined in other configuration files, since there is no guarantee that the variable being referenced is currently  defined.   There  is	no
       protection  against  environment variable namespace collision in these configuration files.  Programmers must take care to avoid such prob-
       lems.

   /etc/TIMEZONE
       The file contains the definition of the environment variable.  This file is required by POSIX.  It is sourced by at the same time the files
       are sourced.

SEE ALSO

       rc(1M).

																      rc.config(4)

Shell Programming and Scripting