Sponsored Content
Homework and Emergencies Emergency UNIX and Linux Support Combine multiple Files into one big file Post 302573770 by Corona688 on Tuesday 15th of November 2011 01:16:27 PM
Old 11-15-2011
Code:
ls |
        awk -F_ '{ STR=$1; for(N=2; N<NF; N++) STR=STR"_"$N;  T[STR]=1 } END { for(K in T) print K; }' |
        while read LINE
        do
                cat ${LINE}_* > $LINE
        done

The awk groups the filenames, feeding them into a while loop which globs them and sticks them together into the output filename.
These 2 Users Gave Thanks to Corona688 For This Post:
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help Needed : Split one big file to multiple files

Hi friends, I have data in flat file as following, first filed is the customer number. We have almost 50-100 customers in the system 100 ABC A123 100 BVC D234 100 BNC N324 200 CBC A122 200 AVC D294 200 HNC N324 300 GBC A173 300 FVC D234 300 DNC N344 I want to split the file and... (5 Replies)
Discussion started by: monicasgupta
5 Replies

2. Shell Programming and Scripting

Combine multiple columns from multiple files

Hi there, I was wondering if someone can help me with this. I am trying the combine multiple columns from multiple files into one file. Example file 1: c0t0d0 c0t2d0 # hostname vgname c0t0d1 c0t2d1 # hostname vgname c0t0d2 c0t2d2 # hostname vgname c0t1d0 c0t3d0 # hostname vgname1... (5 Replies)
Discussion started by: martva
5 Replies

3. UNIX for Dummies Questions & Answers

Combine multiple files with common string into one new file.

I need to compile a large amount of data with a common string from individual text files throughout many directories. An example data file is below. I want to search for the following string, "cc_sectors_1" and combine all the data from each file which contains this string, into one new... (2 Replies)
Discussion started by: GradStudent2010
2 Replies

4. Shell Programming and Scripting

Combine Multiple text or csv files column-wise

Hi All I am trying to combine columns from multiple text files into a single file using paste command but the record length being unequal in the different files the data is running over to the closest empty cell on the left. Please see below. What can i do to resolve this ? File 1 File... (15 Replies)
Discussion started by: venky_ibm
15 Replies

5. Shell Programming and Scripting

combine multiple files by column into one files already sorted!

I have multiple files; each file contains a certain data in a column view simply i want to combine all those files into one file in columns example file1: a b c d file 2: 1 2 3 4 file 3: G (4 Replies)
Discussion started by: ahmedamro
4 Replies

6. Shell Programming and Scripting

Combine columns from multiple files

Can anybody help on the script to combine/concatenate columns from multiple files input1 4 135 5 185 6 85 11 30 16 72 17 30 21 52 22 76 input2 2 50 4 50 6 33 8 62 10 25 12 46 14 42 15 46output (2 Replies)
Discussion started by: sdf
2 Replies

7. Shell Programming and Scripting

Combine Multiple Files into Single One File One after other

I am trying to combine 4 .dat files into one single Output file Inputs are:- file123.dat, file256.dat, file378.dat & file490 Expected Output:- FileName=file1 {text from file1} EOF {blank line} FileName=file2 {text from file2} EOF {blank line} FileName=file3 {text from file3} EOF... (4 Replies)
Discussion started by: lancesunny
4 Replies

8. Shell Programming and Scripting

Split a big file into multiple files based on first four characters

I have a requirement to split a huge file to smaller text files based on first four characters which look like ABCD 1234 DFGH RREX : : : : : 0000 Each of these records are OF EQUAL bytes with a different internal layout based on the above first digit identifier.. Any help to start... (5 Replies)
Discussion started by: etldev
5 Replies

9. Shell Programming and Scripting

Compare multiple files, identify common records and combine unique values into one file

Good morning all, I have a problem that is one step beyond a standard awk compare. I would like to compare three files which have several thousand records against a fourth file. All of them have a value in each row that is identical, and one value in each of those rows which may be duplicated... (1 Reply)
Discussion started by: nashton
1 Replies

10. Shell Programming and Scripting

Split a big file into multiple files using awk

this thread is a continuation from previous thread https://www.unix.com/shell-programming-and-scripting/223901-split-big-file-into-multiple-files-based-first-four-characters.html ..I am using awk to split file and I have a syntax error while executing the below code I am using AIX 7.2... (4 Replies)
Discussion started by: etldev
4 Replies
SUMO(1) 							   User Commands							   SUMO(1)

NAME
SUMO - Importer of polygons and POIs for the road traffic simulation SUMO SYNOPSIS
polyconvert [OPTION]* DESCRIPTION
SUMO polyconvert Version 0.15.0 Copyright (C) 2001-2012 DLR and contributors; http://sumo.sourceforge.net Importer of polygons and POIs for the road traffic simulation SUMO. Configuration Options: -c, --configuration-file FILE Loads the named config on startup --save-configuration FILE Saves current configuration into FILE --save-template FILE Saves a configuration template (empty) into FILE --save-schema FILE Saves the configuration schema into FILE --save-commented Adds comments to saved template, configuration, or schema Input Options: -n, --net-file FILE Loads SUMO-network FILE as reference to offset and projection --dlr-navteq-poly-files FILE Reads polygons from FILE assuming they're coded in DLR-Navteq (Elmar)-format --dlr-navteq-poi-files FILE Reads pois from FILE+ assuming they're coded in DLR-Navteq (Elmar)-format --visum-files FILE Reads polygons from FILE assuming it's a Visum-net --xml-files FILE Reads pois and shapes from FILE assuming they're coded in XML --osm-files FILE Reads pois from FILE+ assuming they're coded in OSM --osm.keep-full-type The type will be made of the key-value - pair. --osm.use-name The id will be set from the given 'name' attribute. --shapefile-prefixes FILE Reads shapes from shapefiles FILE+ --shapefile.guess-projection Guesses the shapefile's projection --shapefile.id-column FILE Defines in which column the id can be found --type-file FILE Reads types from FILE Output Options: -o, --output-file FILE Write generated polygons/pois to FILE Projection Options: --simple-projection Uses a simple method for projection --proj.scale INT Number of places to shift decimal point to right in geo-coordinates --proj.utm Determine the UTM zone (for a universal transversal mercator projection based on the WGS84 ellipsoid) --proj.dhdn Determine the DHDN zone (for a transversal mercator projection based on the bessel ellipsoid) --proj STR Uses STR as proj.4 definition for projection --proj.inverse Inverses projection Pruning Options: --prune.in-net Enables pruning on net boundaries --prune.in-net.offsets STR Uses STR as offset definition added to the net boundaries --prune.boundary STR Uses STR as pruning boundary --prune.keep-list STR Items in STR will be kept though out of boundary --prune.explicit STR Items with names in STR will be removed Processing Options: --offset.x FLOAT Adds FLOAT to net x-positions --offset.y FLOAT Adds FLOAT to net y-positions Building Defaults Options: --color STR Sets STR as default color --prefix STR Sets STR as default prefix --type STR Sets STR as default type --layer INT Sets INT as default layer --discard Sets default action to discard Report Options: -v, --verbose Switches to verbose output -p, --print-options Prints option values before processing -?, --help Prints this screen -V, --version Prints the current version -W, --no-warnings Disables output of warnings -l, --log FILE Writes all messages to FILE (implies verbose) --message-log FILE Writes all non-error messages to FILE (implies verbose) --error-log FILE Writes all warnings and errors to FILE EXAMPLES
polyconvert -c <CONFIGURATION> run with configuration options set in file REPORTING BUGS
Report bugs at <http://sourceforge.net/apps/trac/sumo/>. Get in contact via <sumo-user@lists.sourceforge.net>. Copyright (C) 2001-2012 DLR and contributors; http://sumo.sourceforge.net SUMO polyconvert Version 0.15.0 is part of SUMO. SUMO is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/gpl.html SUMO polyconvert Version 0.15.0 May 2012 SUMO(1)
All times are GMT -4. The time now is 01:06 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy