Login or Register to Ask a Question and Join Our Community


UNIX for Advanced & Expert Users

How to logically reference multiple files as one

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users How to logically reference multiple files as one
# 1  
Old 12-29-2004
How to logically reference multiple files as one
Hi,
I have 10s of small files that need to be processed by the same program every day. The files are large.

I prefer to logicall reference all of these files as a single file so Instead of doing this (because it takes so much time)

cat f1 f2 f3....fn > onehugefile

I want to do be able to do something to tell UNIX or my program to read through the set of files and ignore the eof for all except the last (fn).

Is this possible?

Thanks much in advance.
# 2  
Old 12-29-2004
A decent program will be willing to read from stdin.

cat f1 f2 f3....fn | decent_program
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep strings on multiple files and output to multiple files

Hi All, I want to use egrep on multiple files and the results should be output to multiple files. I am using the below code in my shell script(working in Ksh shell). However with this code I am not attaining the desired results. #!/bin/ksh ( a="/path/file1" b="path/file2" for file in... (4 Replies)
Discussion started by: am24
4 Replies

2. Shell Programming and Scripting

Merge 2 files with one reference columns

Hi All Source1 servername1,patchid1 servername1,patchid2 servername1,patchid3 servername2,patchid1 servername2,patchid2 servername3,patchid4 servername3,patchid5 Source2 servername1,appname1 servername1,appname2 servername1,appname3 servername2,appname1 servername2,appname2... (13 Replies)
Discussion started by: mv_mv
13 Replies

3. Shell Programming and Scripting

Run one script on multiple files and print out multiple files.

How can I Run one script on multiple files and print out multiple files. FOR EXAMPLE i want to run script.pl on 100 files named 1.txt ....100.txt under same directory and print out corresponding file 1.gff ....100.gff.THANKS (4 Replies)
Discussion started by: grace_shen
4 Replies

4. Shell Programming and Scripting

awk -- Extract data from html within multiple tags as reference

Hi, I'm trying to get some data from an html file, but the problem is before it can extract the information I have multiple patterns that need to be passed through. https://www.unix.com/shell-programming-scripting/150711-extract-data-awk-html-files.html Is a similar problem. The only... (5 Replies)
Discussion started by: counfhou
5 Replies

5. UNIX for Dummies Questions & Answers

Combining two files with a reference coloumn

Hi all, this is file1.txt 10.210.226.21 alarmSupervisionActive=true 10.64.136.209 alarmSupervisionActive=true 10.64.174.209 alarmSupervisionActive=true 10.64.182.65 alarmSupervisionActive=true 10.66.193.113 alarmSupervisionActive=true 10.80.124.67 alarmSupervisionActive=true ... (6 Replies)
Discussion started by: sau_boy
6 Replies

6. Shell Programming and Scripting

Perl de-reference code reference variable

Guys, May i know how can we de reference the code reference variable.? my $a = sub{$a=shift;$b=shift;print "SUM:",($a+$b),"\n";}; print $a->(4,5); How can we print the whole function ? Please suggest me regarding this. Thanks for your time :) Cheers, Ranga :) (0 Replies)
Discussion started by: rangarasan
0 Replies

7. Shell Programming and Scripting

awk, multiple files input and multiple files output

Hi! I'm new in awk and I need some help. I have a folder with a lot of files and I need that awk do something in each file and print a new file with the output. The input file name should be modified when I print the outpu files. Thanks in advance for help! :-) ciao (5 Replies)
Discussion started by: gabrysfe
5 Replies

8. UNIX for Dummies Questions & Answers

Script help: Finding Files on a server with no DB reference

Hey Everyone, This is my first post here so I hope I'm in the right spot. I need some help with a script. I don't have much experience in UNIX besides the basic command line stuff which I haven't used much so bear with me. :o I've got a web application which acts as a document repository... (5 Replies)
Discussion started by: Clark_Griswold
5 Replies

9. Shell Programming and Scripting

How to take out multiple matches in file2 using file1 as a reference?

Hi guys, As the title, I want to take out the lines in file2 if the TCONS_* matches that in file1. Then put the lines in a file3. The TCONS numbers ranges from TCONS_00000024 to TCONS_00381684. Those numbers are continuous in file2, not in file1. Below is just some lines of file1 and file2 ... (4 Replies)
Discussion started by: lyni2ULF
4 Replies

10. UNIX for Dummies Questions & Answers

Using AWK: Extract data from multiple files and output to multiple new files

Hi, I'd like to process multiple files. For example: file1.txt file2.txt file3.txt Each file contains several lines of data. I want to extract a piece of data and output it to a new file. file1.txt ----> newfile1.txt file2.txt ----> newfile2.txt file3.txt ----> newfile3.txt Here is... (3 Replies)
Discussion started by: Liverpaul09
3 Replies
Login or Register to Ask a Question