Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Dealing with Empty files, AWK and Loops
Top Forums UNIX for Dummies Questions & Answers Dealing with Empty files, AWK and Loops Post 302652057 by A-V on Wednesday 6th of June 2012 01:13:03 PM
Old 06-06-2012
they are not columns and i still get 0 and the number which shows as cols is not accurate because i might have different number of words or digits in one line ...
they are mainly txt files broken into lines and few that have numbers but steal need to be threated as text and they are
i get a file and break it to lines when i reach a "."
Code:
sed -n -e ":a" -e "$ s/\n/ /gp;N;b a" data.txt | tr '\. ' '\n '  > afile

i have set of these files
Quote:
file 1
this is me
this is me again

file 2
hello hello hello
hello

file 3
2 3 5
73 543 567 56788
which should give following numbers
Quote:
file 1
3
4

file 2
3
1

file 3
3
4
then these should be fed for calculating the mean and variance

i have this which works but I want to see how to make it look like the one that you wrote nicely

Code:
FILES="data/*"
for X in $FILES
do
	name=$(basename $X) 
	if [ -s $name ]
  		then
	awk '{print NF}' $X |awk '{x[NR]=$0; s+=$0; n++} 
	END{mean=s/n; for (i in x){ss += (x[i]-mean)^2} var=(ss/n); print mean, "," var}' > count/${name}
   else
      echo  "NA, NA" > count/${name}
  fi
done

and then put them all in one file
Code:
awk '{printf "%s,%s\n",FILENAME,$0}' count/* > all-results.txt

Last edited by A-V; 06-06-2012 at 06:45 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

While loops and awk

I am trying to make a script that will replace backslashes in a file, but only if the occurance is a pathname. In the file, there are a lot of regular expressions as well, so I'm trying to preserve the integrity of those regular expressions, but convert Windows relative paths. I'm using bash and... (1 Reply)
Discussion started by: Loriel
1 Replies

2. Shell Programming and Scripting

perl: When dealing with files that do not exist

I have a process run weekly where I must convert data formats for about thirty files. I read a text file that provides all of the filenames and switch settings. My perl code is: for ($j = 1; $j <= $k; $j++) { open(FIN2,$fin2) || die "open: $!"; do other stuff } Every once in... (2 Replies)
Discussion started by: joeyg
2 Replies

3. Shell Programming and Scripting

Dealing with log files

Hi , My requirement is that i need to search for a number of strings in a log file and print them with line numbers.The search should be date wise. The sample log file is : Jan 17 02:45:34 srim6165 MQSIv500: (UKBRKR1P_B.LZ_ BENCHMARKS)BIP2648E: Message backed out to a queue; node... (6 Replies)
Discussion started by: charudpss
6 Replies

4. Shell Programming and Scripting

Dealing with files with spaces in the name

Hello, I'm a computer science major and I'm having problems dealing with file names with spaces in them. Particularly I'm saving a file name in a variable and then using the variable in a compare function i.e. a='te xt.txt' b='file2.txt' cmp $a $b If anyone could help me with this particular... (10 Replies)
Discussion started by: jakethegreycat
10 Replies

5. Shell Programming and Scripting

Iterating over subdirectories and dealing with files within them

Hello, I am working on a coding project for a class and to test the program I have created, I have come up with 100 different test cases. The program takes four text files as input, so each of the test cases is contained in a folder with four files. I have a folder called 'tests', within which... (1 Reply)
Discussion started by: dpryor
1 Replies

6. UNIX Desktop Questions & Answers

awk using 2 input files instead of while loops

Hi Friends, I have two files as input with data that looks like this: file1.txt 1 2 3 4 file2.txt a,aa b,bb c,cc d,dd e,ee f,ff instead of me doing 2 while loops to get the combinations while read line_file1 (2 Replies)
Discussion started by: kokoro
2 Replies

7. UNIX for Dummies Questions & Answers

Dealing with Double Loops, Arrays and GREP

Can someone please help me to learn how to deal with loops, arrays and grep? I have two arrays (lets say I and j) each in a separate file And have file with lines of data I need to extract, such as Ruby Smith: some text here Ruby Smith: some other text here Ruby Brown: some text here Ruby... (10 Replies)
Discussion started by: A-V
10 Replies

8. Shell Programming and Scripting

Dealing with multiple files

Korn Shell I have hundreds of small files like below created every day. A midnight cron job moves them to the location /u04/temp/logs But sometimes I have to manually move these files based a certain dates or time. I have two basic requirements 1.Using mv command I want to move all .dat... (2 Replies)
Discussion started by: kraljic
2 Replies

9. Shell Programming and Scripting

Awk: Dealing with whitespace in associative array indicies

Is there a reliable way to deal with whitespace in array indicies? I am trying to annotate fails in a database using a table of known fails. In a begin block I have code like this: # Read in Known Fail List getline < "'"$failListFile"'"; getline < "'"$failListFile"'"; getline <... (6 Replies)
Discussion started by: Michael Stora
6 Replies

10. Shell Programming and Scripting

Check file from multiple files is empty using awk

I am passing multiple files in awk & since one of the file is empty(say file3) so the same gets skipped & logic goes for toss. Need suggestion/help in checking and putting additional checks for the same awk -F, 'FNR==1 {++filecounter} filecounter==1 {KRL=$2;next} filecounter==2... (8 Replies)
Discussion started by: siramitsharma
8 Replies

LEARN ABOUT ULTRIX

packf

packf(1mh)																packf(1mh)

Name
       packf - compress a folder into a single file

Syntax
       packf [ +folder ] [ msgs ] [ -file name ] [ -help ]

Description
       Each  message in a folder is normally stored as a separate file.  The command takes all messages from the current folder and copies them to
       a single specified file.  Each message in the file is separated by four <CTRL/A>s and a newline.

       You can specify a folder other than the current folder by using the +folder argument.  If you do not want all the messages in a	folder	to
       be packed into one file, you can specify a number of messages or a range of messages with message numbers.

       The first message packed will become the current message.  If you specify a +folder argument, that folder will become the current folder.

       When messages have been packed into a file using you can separate them into individual messages using the command.  See

Options
       -file name
		 Specifies  the  file  in which you want the message(s) to be stored.  If you specify an existing file then the specified messages
		 will be appended to the end of that file.  Otherwise, a new file will be created and the messages placed in it.  If  you  do  not
		 specify  a  filename,	attempts  to  place the messages in a file called in the current working directory.  If this file does not
		 exist, asks whether you want to create it.

       -help	 Prints a list of the valid options to this command.

       The default settings for this command are:

	      +folder defaults to the current folder
	      msgs defaults to all
	      -file ./msgbox

Examples
       The first example shows all the messages in the folder being packed into a file called
       % packf +lrp -file planning

       The next example shows how prompts you if you do not specify a -file option.  A file called is created by in your home directory, and  mes-
       sages 3 to 5 are packed into it:
       % packf +lrp 3-5
       Create file "/machine/disk/username/msgbox"? y

Profile Components
       Path:	      To determine the user's Mail directory
       Msg-Protect:   To set protections when creating a new file

Files
       $HOME/.mh_profile   The user profile.

See Also
       burst(1mh)

																	packf(1mh)
All times are GMT -4. The time now is 11:16 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy