Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Concatenation of multiple files based on file pattern
Top Forums UNIX for Advanced & Expert Users Concatenation of multiple files based on file pattern Post 302979991 by Jesshelle David on Monday 22nd of August 2016 05:24:58 PM
Old 08-22-2016
Concatenation of multiple files based on file pattern
Hi,

I have the following reports that get generated every 1 hour and this is my requirement:

1. 5 reports get generated every hour with the names "Report.Dddmmyy.Thhmiss.CTLR"
"Report.Dddmmyy.Thhmiss.ACCD"
"Report.Dddmmyy.Thhmiss.BCCD"
"Report.Dddmmyy.Thhmiss.CCCD"
"Report.Dddmmyy.Thhmiss.DDDD"

2. At the end of the day I need to concatenate all reports with similar names into a single file.
For example: 24 files for pattern "Report.Dddmmyy.Thhmiss.CTLR" into a single file called "Test.dat" and so on.

3.Please note that the last four letters of the file name will be a constant and the reports have to be concatenated using this.

4. I do not want to parameterize just these last four letters or list the last four letter as ls -l *CTLR* as this will be hard coding so could there be a better way of handling this!?

Kindly advise.

Thanks,
Jess
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Concatenation of multiple files with wildcard

I have the following snippet to concatenate about a hundred csv-files: for file in *csv; do cat $file >> newfile; done This line works, but before I was experimenting with the following line, which is more intuitive and is a tad more robust: for file in *.csv; do cat $file >> newfile; done Can... (2 Replies)
Discussion started by: figaro
2 Replies

2. Shell Programming and Scripting

Split a file into multiple files based on the input pattern

I have a file with lines something like. ...... 123_start ...... ....... 123_end .... ..... 456_start ...... ..... 456_end .... ..... 789_start .... .... 789_end (6 Replies)
Discussion started by: abinash
6 Replies

3. Shell Programming and Scripting

Splitting large file into multiple files in unix based on pattern

I need to write a shell script for below scenario My input file has data in format: qwerty0101TWE 12345 01022005 01022005 datainala alanfernanded 26 qwerty0101mXZ 12349 01022005 06022008 datainalb johngalilo 28 qwerty0101TWE 12342 01022005 07022009 datainalc hitalbert 43 qwerty0101CFG 12345... (19 Replies)
Discussion started by: jimmy12
19 Replies

4. UNIX for Dummies Questions & Answers

print multiple lines from text file based on pattern list

I have a text file with a list of items/patterns: ConsensusfromCGX_alldays_trimmedcollapsedfilteredreadscontiglist(229095contigs)contig12238 ConsensusfromCGX_alldays_trimmedcollapsedfilteredreadscontiglist(229095contigs)contig34624... (1 Reply)
Discussion started by: Oyster
1 Replies

5. Shell Programming and Scripting

split XML file into multiple files based on pattern

Hello, I am using awk to split a file into multiple files using command: nawk '{ if ( $1 == "<process" ) { n=split($2, arr, "\""); file=arr } print > file }' processes.xml <process name="Process1.process"> ... (3 Replies)
Discussion started by: chiru_h
3 Replies

6. UNIX for Advanced & Expert Users

Moving multiple files based on the pattern

I want to search for a particular file name patterns and move them to a specific folder, is it possible to do it with awk or sed? (1 Reply)
Discussion started by: rudoraj
1 Replies

7. Shell Programming and Scripting

Multiple File Rename based on pattern - one line

All, I wanted to copy the files From: Daily_XYZ_TEST_1.csv Daily_XYZ_TEST_2.csv Daily_XYZ_TEST_3.csv Daily_XYZ_TEST_4.csv To: Daily_ABC_TEST_1.csv Daily_ABC_TEST_2.csv Daily_ABC_TEST_3.csv Daily_ABC_TEST_4.csv I have tried the rename command but it is not working (5 Replies)
Discussion started by: alfredo123
5 Replies

8. Shell Programming and Scripting

Split a text file into multiple pages based on pattern

Hi, I have a text file (attached the sample). I have also, attached the way the way the files need to be split. We get this file, that will either have 24 Jurisdictions, or will miss some and retain some. Like in the attached sample file, there are only Jurisdictions 03,11,14,15, 20 and 30.... (3 Replies)
Discussion started by: ebsus
3 Replies

9. UNIX for Beginners Questions & Answers

Consternation of multiple file names based on naming pattern

Hi, I have the following reports that get generated every 1 hour and this is my requirement: 1. 5 reports get generated every hour with the names "Report.Dddmmyy.Thhmiss.CTLR" "Report.Dddmmyy.Thhmiss.ACCD" "Report.Dddmmyy.Thhmiss.BCCD" "Report.Dddmmyy.Thhmiss.CCCD"... (1 Reply)
Discussion started by: Jesshelle David
1 Replies

10. UNIX for Beginners Questions & Answers

UNIX script to append multiple text files into one file based on pattern present in filaname

Hi All-I am new to Unix , I need to write a script. Can someone help me with a requirement where I have list of files in a directory, I want to Merge the files if a pattern of string matches in filenames? AAAL_555A_ORANGE1_F190404.TXT AAAL_555A_ORANGE2_F190404.TXT AAAL_555A_ORANGE3_F190404.TXT... (6 Replies)
Discussion started by: Shankar455
6 Replies

LEARN ABOUT DEBIAN

bb-snapshot.cgi

BB-SNAPSHOT.CGI(1)					      General Commands Manual						BB-SNAPSHOT.CGI(1)

NAME

       bb-snapshot.cgi - CGI program to rebuild the Xymon webpages for a specific point in time.

SYNOPSIS

       bb-snapshot.cgi

DESCRIPTION

       bb-snapshot.cgi	is  invoked as a CGI script via the bb-snapshot.sh CGI wrapper.  It rebuilds the Xymon web pages to the look they had at a
       particular point in time, based upon the historical information logged about events.

       bb-snapshot.cgi is passed a QUERY_STRING environment variable with the following parameters:

	  mon (Start month of the snapshot)
	  day (Start day-of-month of the snapshot)
	  yr  (Start year of the snapshot)
	  hour (Start hour of the snapshot)
	  min  (Start minute of the snapshot)
	  sec  (Start second of the snapshot)

       The "month" parameters must be specified as the three-letter english month name abbreviation: Jan, Feb, Mar ...

       "day" must be in the range 1..31; "yr" must be specified including century (e.g. "2003"). "hour" must be specified using a 24-hour clock.

       All of the processing involved in generating the report is done by invoking bbgen(1) with the proper "--snapshot" option.

OPTIONS

       --env=FILENAME
	      Load environment from FILENAME before executing the CGI.

       bbgen-options
	      All options except "--env" are passed on to the bbgen(1) program building the snapshot files.

ENVIRONMENT VARIABLES

       BBGENSNAPOPTS
	      bbgen options passed by default to the bb-snapshot.cgi script.  This happens in the bb-snapshot.sh CGI wrapper script.

       BBHOME Home directory of the Xymon server files

       BBSNAP Directory where generated snapshots are stored. This directory must be writable by the userid executing the  CGI	script,  typically
	      "www", "apache" or "nobody". Default: $BBHOME/www/snap/

       BBSNAPURL
	      The URL prefix to use when accessing the reports via a browser.  Default: $BBWEB/snap

SEE ALSO

       bbgen(1), bb-hosts(5), hobbitserver.cfg(5)

Xymon							    Version 4.2.3:  4 Feb 2009						BB-SNAPSHOT.CGI(1)
All times are GMT -4. The time now is 01:19 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy