Sponsored Content
Top Forums Programming Open Source Splitting files using awk and reading filename value from input data Post 302976086 by RudiC on Thursday 23rd of June 2016 03:38:17 PM
Old 06-23-2016
How about posting a few lines from the input file? Some with, and some without the string of interest.

Not sure if I understood the requirement correctly, but, taking my syslog for a sample, wouldn't this fulfill your needs (redirect printout to a "user" file in /tmp/log if need be):
Code:
awk '{split ($5, U, /[[]/); T[U[1]] = $1 " " $2 " " $3} END {for (t in T) print t, T[t]}' /var/log/syslog
systemd-tmpfiles Jun 23 08:47:54
anacron Jun 23 08:46:57
dhclient: Jun 23 18:28:50
dbus Jun 23 12:03:34
CRON Jun 23 21:17:01
kernel: Jun 23 21:18:13
mtp-probe: Jun 23 11:40:12

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Moving files by splitting the path embedded in the filename

Hello All. I am having a directory /tmp/rahul which contains many files in the format @#home@#rahul@#programs@#script.pl where /home/rahul/programs is the directory where the script.pl file is to be placed. I have many files in this format. What i want is a script which read these... (7 Replies)
Discussion started by: rahulrathod
7 Replies

2. Shell Programming and Scripting

Reading in data sets into arrays from an input file.

Hye all, I would like some help with reading in a file in which the data is seperated by commas. for instance: input.dat: 1,2,34,/test for the above case, the fn. will store the values into an array -> data as follows: data = 1 data = 2 data = 34 data = /test I am trying to write... (5 Replies)
Discussion started by: sidamin810
5 Replies

3. Shell Programming and Scripting

awk reading 2 input files but not getting expected value

I'm reading 2 input files but not getting expected value. I should get an alpha value on file_1_data but not getting any. Please help. >cat test6.sh awk ' FILENAME==ARGV { file_1_data=$0; print "----- 1 Line " NR " -----" $1; next } FILENAME==ARGV { file_2_data=$0; print "----- 2... (1 Reply)
Discussion started by: pdtak
1 Replies

4. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50... (3 Replies)
Discussion started by: arund_01
3 Replies

5. Shell Programming and Scripting

Reading specific contents from 1 input files and appending it to another input file

Hi guys, I am new to AWK and unix scripting. Please see below my problem and let me know if anyone you can help. I have 2 input files (example given below) Input file 2 is a standard file (it will not change) and we have to get the name (second column after comma) from it and append it... (5 Replies)
Discussion started by: sksahu
5 Replies

6. Shell Programming and Scripting

Filename from splitting files to have the same filename of the original file with counter value

Hi all, I have a list of xml file. I need to split the files to a different files when see the <ko> tag. The list of filename are B20090908.1100-20090908.1200_CDMA=1,NO=2,SITE=3.xml B20090908.1200-20090908.1300_CDMA=1,NO=2,SITE=3.xml B20090908.1300-20090908.1400_CDMA=1,NO=2,SITE=3.xml ... (3 Replies)
Discussion started by: natalie23
3 Replies

7. Shell Programming and Scripting

Help with reading two input files in awk

Hello, I'm trying to write an awk program that reads two files inputs. example, file 1: 0.00017835 0.000176738 0.00018811 0.000189504 0.000188155 0.000180065 0.000178991 0.000178252 0.000182513 file 2: 1.7871769E-05 1.5139576E-16 1.5140196E-16 1.5139874E-16 1.7827407E-04 ... (5 Replies)
Discussion started by: joseamck
5 Replies

8. Shell Programming and Scripting

Splitting input CSV file into 3 files

Hi , I am receiving a CSV file that can vary in number of rows each time. I am supposed to split this file into 3 separate files like this: 1. create a file named 'File1.csv' that will contain first 3 rows of the input file 2. create file named 'File2.csv' that will contain last 3 rows of the... (7 Replies)
Discussion started by: kedrick
7 Replies

9. Shell Programming and Scripting

Splitting the Data using awk

Hello All, I have a comma delimiter file with 10 columns. I took the desired data but from $4 I need to split into two columns as 3+7 bytes. awk -F"," -v OFS=',' '{print $2,$3,$4}' foo.txt 42366,11/10/2014,5012418769 42366,11/10/2014,2046955672 42366,11/10/2014,2076802951 ... (3 Replies)
Discussion started by: karumudi7
3 Replies

10. Shell Programming and Scripting

How to embed data instead of reading user input from an array?

Hello, I am running under ubuntu1 14.04 and I have a script which is sending given process names to vanish so that I'd see less output when I run most popular tools like top etc in terminal window. In usual method it works. Whenever I restart the system, I have to enter the same data from... (2 Replies)
Discussion started by: baris35
2 Replies
psiclean(1)															       psiclean(1)

NAME
psiclean - delete files in the PSI temporary directories DESCRIPTION
The psiclean command finds a job name by scanning the input file for a keyword assignment of the form DEFAULT:FILES:DEFAULT:NAME = string It then goes through all of the machine's temporary directories and deletes all files of the form string.*. In previous versions of psi- clean , temporary directories were assumed to be of the form /tmp[0-9]/$user In this version of psiclean , we get the names of the temporary directories from the user input file by looking for volume paths of the form DEFAULT:FILES:DEFAULT:VOLUMEi = string It is essential that users see to the removal of their scratch files as soon as their job completes, because temporary directories are usu- ally a shared resource and there is not necessarily an automatic way for files to be deleted from these areas. Thus, the last command run after a job has finished should be the psiclean command. The user must take care to follow certain conventions when choosing filenames. Any files which are to be kept after a job completes should not be kept in the default temporary directories. The FILES input must be used to specify other locations for the specific files which are to be kept. psiclean will ignore files which are specifically listed by number (e.g., PSIF_CHKPT ) in the FILES section. Files which are not needed after the run should use the default path given in the input file. Otherwise, these files will remain on the system and will impede other jobs. EXAMPLE
Suppose the PSI temporary directories contained the following subdirectories and files: /tmp1/cpuhog: -rw-r--r-- 1 cpuhog 14492 Jun 11 16:48 dicubane.30 -rw-r--r-- 1 cpuhog 187320 Jun 8 17:20 diketene.34 -rw-r--r-- 1 cpuhog 16384 Jun 7 19:17 o4big.30 -rw-r--r-- 1 cpuhog 16384 Jun 7 19:17 o4.30 -rw-r--r-- 1 cpuhog 974848 Jun 7 18:41 o4.34 /tmp2/cpuhog: -rw-r--r-- 1 cpuhog 14492 Jun 11 16:48 dicubane.30 -rw-r--r-- 1 cpuhog 187320 Jun 8 17:20 diketene.34 -rw-r--r-- 1 cpuhog 10904 Jun 7 18:50 o4big.30 -rw-r--r-- 1 cpuhog 10904 Jun 7 18:50 o4.30 -rw-r--r-- 1 cpuhog 973752 Jun 7 18:41 o4.34 /tmp3/cpuhog: -rw-r--r-- 1 cpuhog 14492 Jun 11 16:48 dicubane.30 -rw-r--r-- 1 cpuhog 187320 Jun 8 17:20 diketene.34 -rw-r--r-- 1 cpuhog 8192 Jun 7 19:17 o4big.30 -rw-r--r-- 1 cpuhog 8192 Jun 7 19:17 o4.30 -rw-r--r-- 1 cpuhog 966656 Jun 7 18:41 o4.34 Let's also say that the user cpuhog is in a directory which contains an input file which has the following line in it: DEFAULT:FILES:DEFAULT:NAME = "o4" If the user cpuhog now executes the psiclean command, then the o4 files in the temporary directories would be deleted, leaving the follow- ing files: /tmp1/cpuhog: -rw-r--r-- 1 cpuhog 14492 Jun 11 16:48 dicubane.30 -rw-r--r-- 1 cpuhog 187320 Jun 8 17:20 diketene.34 -rw-r--r-- 1 cpuhog 16384 Jun 7 19:17 o4big.30 /tmp2/cpuhog: -rw-r--r-- 1 cpuhog 14492 Jun 11 16:48 dicubane.30 -rw-r--r-- 1 cpuhog 187320 Jun 8 17:20 diketene.34 -rw-r--r-- 1 cpuhog 10904 Jun 7 18:50 o4big.30 /tmp3/cpuhog: -rw-r--r-- 1 cpuhog 14492 Jun 11 16:48 dicubane.30 -rw-r--r-- 1 cpuhog 187320 Jun 8 17:20 diketene.34 -rw-r--r-- 1 cpuhog 8192 Jun 7 19:17 o4big.30 AUTHOR
C. David Sherrill <sherrill@alum.mit.edu> Psi Version 3.0 29 July, 1999 psiclean(1)
All times are GMT -4. The time now is 10:03 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy