Shell script calling Perl function, sort and find data, write to new files


 
Thread Tools Search this Thread
Homework and Emergencies Homework & Coursework Questions Shell script calling Perl function, sort and find data, write to new files
# 1  
Old 10-23-2011
Error Shell script calling Perl function, sort and find data, write to new files

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!

1. The problem statement, all variables and given/known data:

I must write a shell script that calls two external Perl functions--one of which sorts the data in a file, and allows the user to write it to a new file, and the other that searches for a word in a file that's entered in by the user, and then returns where the word is, or "not found" if the word is not in the file. It also can perform the sorting and writing function in the shell. It has to start by taking in a filename of a simple text file with at least 50 words as an argument and if there is none prompt the user for a filename, and if the user does not enter a filename, then throw up a usage statement and kick the user out of the program.


2. Relevant commands, code, scripts, algorithms:

File: "test003.pl"

Code:
#!/usr/bin/perl -w

use 5.010;

print "Enter a word to search for\n";
$find = <STDIN>;
print "Enter a file to search in\n";
$look = <STDIN>;
print "Lines that matched $find\n";
open FILE, "<$look" or die "can't open $look $!";
my @file_array = <FILE>;
while (<FILE>)
{
    foreach my $line (@file_array)
    {
            if ($line =~ m/$find/i)
        {
                print "The word $find is found on line $line\n";
          }
        else
        { 
            print "Not found\n"; 
        }
    }
}

close (FILE);

File: "test002.pl"

Code:
#!/usr/bin/perl

use 5.010;

use warnings;

print "Enter a file\n";
chomp($FILE1 = <STDIN>);
print "Enter another file\n";
chomp($FILE2 = <STDIN>);

my $filename = "$FILE1";
my $newfile = "$FILE2";

open(OUTPUT, "|sort $FILE1 > $FILE2");
close OUTPUT;

print "Finished";

File: "sideShell.sh"

Code:
#!/bin/sh

echo "Enter filename"
read FILE
echo "Please enter a new filename\n"
read NEWFILE
if [ $NEWFILE == "" ]
then
echo "You must enter a new filename"
exit
else
sort $FILE > $NEWFILE
echo "Finished"
fi

File: "test.sh"

Code:
#!/bin/sh



    echo "Please enter a filename"
    read FILE
    if [ $FILE == "" ]; then
        echo "You must enter a filename, e.g:"
        echo "./shell.sh foo.bar"
        exit    
    fi

    cat < $FILE
    while [ "$option" != 4 ]
    do
        echo "Enter a selection:\n"
        echo "1) Sort data in shell"
        echo "2) Sort data in Perl"
        echo "3) Search for a word in Perl"
        echo "4) Exit"
        read option
        case $option in 
            1) ./sideShell.sh $FILE;;
            2) ./perlScript001.pl $FILE;;
            3) ./perlScript002.pl $FILE;;            
        esac
    done
    echo "'Respect.' -Seth"
    exit
fi

File: "file"

Code:
the
quick
brown
fox
jumps
over
the
lazy
dog
Wellif
you
want
it
here
it
is
come
and
get
it
mmmmmake
your
mind
up
fast
need
a
little
excitement
snap
into
a
slim
Jim
oh
yeah
any
way
you
want
it
thats
the
way
you
need
it
any
way
you
want
it

3. The attempts at a solution (include all code and scripts):

Script file: "testsc"

Code:
Script started on Sun 23 Oct 2011 09:35:09 PM CDT
]0;kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC: ~kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC:~$ ./test.sh 
Please enter a filename 
file 
[: 11: file: unexpected operator 
the 
quick 
brown 
fox 
jumps 
over 
the 
lazy 
dog 
Wellif 
you 
want 
it 
here 
it 
is 
come 
and 
get 
it 
mmmmmake 
your 
mind 
up 
fast 
need 
a 
little 
excitement 
snap 
into 
a 
slim 
Jim 
oh 
yeah 
any 
way 
you 
want 
it 
thats 
the 
way 
you 
need 
it 
any 
way 
you 
want 
it 
Enter a selection: 
 
1) Sort data in shell 
2) Sort data in Perl 
3) Search for a word in Perl 
4) Exit 
1 
Enter filename 
file 
Please enter a new filename 
 
newr er 
[: 14: newer: unexpected operator 
Finished 
Enter a selection: 
 
1) Sort data in shell 
2) Sort data in Perl 
3) Search for a word in Perl 
4) Exit 
2 
Enter a file 
file 
Enter another file 
newest 
FinishedEnter a selection: 
 
1) Sort data in shell 
2) Sort data in Perl 
3) Search for a word in Perl 
4) Exit 
4 
'Respect.' -Seth 
]0;kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC: ~kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC:~$ ./test.sh 
Please enter a filename 
file 
[: 11: file: unexpected operator 
the 
quick 
brown 
fox 
jumps 
over 
the 
lazy 
dog 
Wellif 
you 
want 
it 
here 
it 
is 
come 
and 
get 
it 
mmmmmake 
your 
mind 
up 
fast 
need 
a 
little 
excitement 
snap 
into 
a 
slim 
Jim 
oh 
yeah 
any 
way 
you 
want 
it 
thats 
the 
way 
you 
need 
it 
any 
way 
you 
want 
it 
Enter a selection: 
 
1) Sort data in shell 
2) Sort data in Perl 
3) Search for a word in Perl 
4) Exit 
3 
Enter a word to search for 
need 
Enter a file to search in 
newest 
Lines that matched need 
 
Enter a selection: 
 
1) Sort data in shell 
2) Sort data in Perl 
3) Search for a word in Perl 
4) Exit 
4 
'Respect.' -Seth 
]0;kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC: ~kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC:~$ ls 
another           fileA         newere            perlScript002.pl  test003.pl 
Audiobooks        filessss      newerfile         Pictures          testBash.sh 
d2.pls            fileTest      newest            Podcasts          test.pl 
Desktop           fileTest.bac  newfile           Public            testsc 
Documents         HPIM1214.JPG  newfiler          reviewMidterm     test.sh 
Downloads         laugh02.mp3   newfiles          sideShell.sh      test.sh~ 
evennewerest      laugh02.wav   newfily           start             Ubuntu One 
examples.desktop  magic.mgc     perlScript001     temp file         Videos 
file              Music         perlScript001.pl  Templates 
file1             newer         perlScript002     test002.pl 
]0;kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC: ~kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC:~$ cat newer 
a 
a 
and 
any 
any 
brown 
come 
dog 
excitement 
fast 
fox 
get 
here 
into 
is 
it 
it 
it 
it 
it 
it 
Jim 
jumps 
lazy 
little 
mind 
mmmmmake 
need 
need 
oh 
over 
quick 
slim 
snap 
thats 
the 
the 
the 
up 
want 
want 
want 
way 
way 
way 
Wellif 
yeah 
you 
you 
you 
you 
your 
]0;kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC: ~kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC:~$ cat newest 
a 
a 
and 
any 
any 
brown 
come 
dog 
excitement 
fast 
fox 
get 
here 
into 
is 
it 
it 
it 
it 
it 
it 
Jim 
jumps 
lazy 
little 
mind 
mmmmmake 
need 
need 
oh 
over 
quick 
slim 
snap 
thats 
the 
the 
the 
up 
want 
want 
want 
way 
way 
way 
Wellif 
yeah 
you 
you 
you 
you 
your 
]0;kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC: ~kowit010@kowit010-HP-Pavilion-dm4-Notebook-PC:~$ exit 
exit 

Script done on Sun 23 Oct 2011 09:36:09 PM CDT

I cannot seem to get how to pass a filename as an argument into the main program, or how to call the Perl functions with this filename as the argument. I am a complete noob at both languages, and have tried reading various websites and help forums but am having trouble finding the right way to do this--pass a file into the start of the main function and pass it to the others without having to re-enter the file each time. I have been working on this for a couple days now. This thing is due Tuesday evening, and I am stuck on the find function for sure, as well as the opening file argument part.Smilie

Any help would be much appreciated!

4. Complete Name of School (University), City (State), Country, Name of Professor, and Course Number (Link to Course):

University of Minnesota (Twin Cities), Minneapolis (MN), USA, Langanki, INET 3101 (" htt p s : / / webapps - prd . oit . umn . edu /courseinfo/ viewCourseGuideTermAndSubject . do?institution=UMNTC&searchTerm=1119&searchSubject=INET&searchCatalogNumber=3101&Submit=View#3101 " sorry, but your forum will not let me post URL links until I make 5 posts so I had to put the spaces in my link, it's legitimate once you take the spaces out)

Note: Without school/professor/course information, you will be banned if you post here! You must complete the entire template (not just parts of it).

P.S. Mods: how do you want me to cite this thread here on my final hand-ins for this project? Will just pasting the URL suffice or do you want me to do a full "MLA" citation or something like that?
# 2  
Old 10-24-2011
Code:
[ $FILE == "" ]

You only get == in bash and ksh, and even then, only in [[ ]] not [ ].

Try
Code:
[ -z "$FILE" ]

instead, that should work in any shell.

---------- Post updated at 09:47 AM ---------- Previous update was at 09:45 AM ----------

You should use '$look=shift;', not '$look=<STDIN>', since you are not feeding the file into perl as text to standard input, but as a parameter. You shouldn't be asking for it either if you're feeding it into the program automatically.
This User Gave Thanks to Corona688 For This Post:
# 3  
Old 10-24-2011
I've fixed my code using your suggestions and some other things, now my code looks like this:

"shell.sh"
Code:
#!/bin/sh

FILE=$1

if [ -z $FILE ]; then
    echo "Please enter a filename"
    read FILE
    if [ -z $FILE ]; then
        echo "You must enter a filename, e.g:"
        echo "./shell.sh foo.bar"
        exit    
    fi
else
    cat < $FILE
    while [ "$option" != 4 ]
    do
        echo "Enter a selection:\n"
        echo "1) Sort data in shell"
        echo "2) Sort data in Perl"
        echo "3) Search for a word in Perl"
        echo "4) Exit"
        read option
        case $option in
            1) ./sideShell.sh $FILE;;
            2) ./perl001.pl $FILE;;
            3) ./perl002.pl $FILE;;            
        esac
    done
    echo "'Respect.' -Seth"
    exit
fi

"sideShell.sh"
Code:
#!/bin/sh

FILE=$1

echo "Please enter a new filename\n"
read NEWFILE
if [ $NEWFILE == "" ]
then
echo "You must enter a new filename"
exit
else
sort $FILE > $NEWFILE
echo "Finished"
fi

"perl001.pl"
Code:
#!/usr/bin/perl

use 5.010;

use warnings;

$FILE1=shift;
print "Enter a new filename\n";
$FILE2=<STDIN>;


open(OUTPUT, "|sort $FILE1 > $FILE2");
close OUTPUT;

print "Finished\n";

"perl002.pl"
Code:
#!/usr/bin/perl -w

use 5.010;

$look=shift;
open(FILE, "<$look");
print "Enter a word to search for\n";
$find=<STDIN>;

print "Lines that matched $find\n";
my @file_array = <FILE>;
while (<@file_array>)
{
    foreach my $line (@file_array)
    {
            if ($line =~ m/$find/i)
        {
                print "The word $find is found on line $line\n";
          }
        else
        { 
            print "Not found\n"; 
        }
    }
}

close FILE;

When I run the "perl002.pl" script with a file "text" as the argument, and I search for the word "you", it works but I guess this crazy output that looks something like this (cycled many times):
Code:
Not found 
Not found 
Not found 
Not found 
Not found 
Not found 
Not found 
Not found 
Not found 
Not found 
The word you 
 is found on line you 
 
Not found 
Not found 
Not found 
The word you 
 is found on line you 
 
Not found 
Not found 
Not found 
The word you 
 is found on line you 
 
Not found 
Not found 
Not found 
Not found

Any idea how to get it to display the number line it's on? I thought of adding a counting integer variable to the code which would increment "++" if it finds a match, but not sure if that would work right? I also would like to swap the case switch for an if loop so I can keep the shell sort function in the same shell (and not have to call a second shell), unless you know how I can put multiple lines of code in a case switch (not just one thing; I've tried to put multiple lines in a case but cannot get that to work right)?

Last edited by kowit010; 10-24-2011 at 11:58 PM..
# 4  
Old 10-24-2011
I like your forum, I think it says something that is very reasonable. I will always look to this forum, hoping each time to see some different things.
This User Gave Thanks to Jenny Daisy For This Post:
# 5  
Old 10-25-2011
Quote:
Originally Posted by kowit010
Any idea how to get it to display the number line it's on? I thought of adding a counting integer variable to the code which would increment "++" if it finds a match, but not sure if that would work right? I also would like to swap the case switch for an if loop so I can keep the shell sort function in the same shell (and not have to call a second shell), unless you know how I can put multiple lines of code in a case switch (not just one thing; I've tried to put multiple lines in a case but cannot get that to work right)?
You already put the content lines of the file into an array, so you can use the array index to display the line number. Using an extra counter is not necessary. Please see the comments in the code below.

Code:
#!/usr/bin/perl -w

# Why need this line?
#use 5.010;

my $look = shift;

print "Enter a word to search for\n";
my $find = <STDIN>;
chomp($find); # Remove the newline at the end. Otherwise, pattern matching will fail

print "Lines that matched $find\n";
open(FILE, "<$look");
my @file_array = <FILE>;
my $found = 0; # Use a flag to indicate the word can be matched or not

# Use for loop and (i + 1) will be the line number
for (my $i = 0; $i < @file_array; $i++)
{
    my $line = $file_array[$i];
    chomp($line); # Remove the newline at the end before matching

    if ($line =~ m/$find/i)
    {
        print "The word $find is found on line ".($i + 1).": $line\n"; # Display the matched line with (i + 1) as line number
        $found = 1;
    }
}

# Put this out of the loop since it should display only once
print "Not found\n" if (!$found);

close FILE;


Last edited by MacMonster; 10-25-2011 at 12:18 AM.. Reason: Add some comments
This User Gave Thanks to MacMonster For This Post:
# 6  
Old 10-25-2011
MySQL Thank you!

All done! Thank you for the advice and kind words from those who posted on this thread! SmilieSmilie

Oh yes, and the mods can be assured I will give the proper credit on my hand-ins for the help here

Last edited by kowit010; 10-25-2011 at 12:28 AM.. Reason: Adding a very important detail I forgot at first
# 7  
Old 11-02-2011
Computer Thank you (again!)

Quote:
Originally Posted by kowit010
All done! Thank you for the advice and kind words from those who posted on this thread! SmilieSmilie

Oh yes, and the mods can be assured I will give the proper credit on my hand-ins for the help here
I just received the grade back for this assignment: 100%!!

Thanks again!!
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need help to write a function in shell scripting to execute sql files

Hi, I am new to shell scripting and i need to write a automation script to execute sql files. I need to check the table if it is there in system tables and need to write a function to call the .sql files. For ex. I have a.sql,b.sql,c.sql files, where the sql file contains DELETE and INSERT... (1 Reply)
Discussion started by: Samah
1 Replies

2. Shell Programming and Scripting

Perl script for Calling a function and writing all its contents to a file

I have a function which does awk proceessing sub mergeDescription { system (q@awk -F'~' ' NR == FNR { A = $1 B = $2 C = $0 next } { n = split ( C, V, "~" ) if... (3 Replies)
Discussion started by: crypto87
3 Replies

3. Shell Programming and Scripting

Calling Pl/sql function in shell script to modify csv

I need to 1.Open a csv 2.Process the csv i.e. Modify 2 column in the csv. To modify the column the value needs to be passed to a pl/sql function and the return value should be updated For eg: If column 2 E,then E will be passed in database function which will return Employee. 3. Write a... (5 Replies)
Discussion started by: Chinky23
5 Replies

4. Shell Programming and Scripting

Calling a function in cpp file inside shell script

Hi I need to call a function written in a cpp file with arguments inside the shell script..Can anyone help me how to do this:( (1 Reply)
Discussion started by: rkrish
1 Replies

5. Shell Programming and Scripting

Perl script to load data by calling sqlldr

Hello all, I know this is Unix forum, but i also know that there are some experts here who can help me out with this situation; I am loading a data file into oracle table using Perl script by calling sqlldr script. It does not do anything, and no data is getting loaded. Any help,... (2 Replies)
Discussion started by: msrahman
2 Replies

6. Shell Programming and Scripting

SHELL SCRIPT Function Calling Another Function Please Help...

This is my function which is creating three variables based on counter & writing these variable to database by calling another function writeRecord but only one record is getting wrote in DB.... Please advise ASAP...:confused: function InsertFtg { FTGSTR="" echo "Saurabh is GREAT $#" let... (2 Replies)
Discussion started by: omkar.sonawane
2 Replies

7. Shell Programming and Scripting

calling a function in Shell script troubleshooting

Some Code After Some code part is executed the control doesnt go to rvin_doxx_scrt.. and the script exits rvin_doxx_scrt() { Some Code } if (som code) ... (4 Replies)
Discussion started by: ultimatix
4 Replies

8. Shell Programming and Scripting

Calling a C-function froma Perl script

Hi All, How can we call a c function from a perl script? Is it the same way as we do for shell script ? Thanks in advance JS (9 Replies)
Discussion started by: jisha
9 Replies

9. Shell Programming and Scripting

Calling a C-function froma shell script

Hi, I have searched the forum for the query, But i didnt find an exact answer. I have a script(1.sh) and a c program(sample.c) sample.c contains many function definitions.( run(), find(), add() etc). I want to call functions in sample.c from 1.sh and use the return value in 1.sh... (3 Replies)
Discussion started by: jisha
3 Replies

10. UNIX for Dummies Questions & Answers

calling one function from another shell script

i have a function defined in one ksh (ksh 1) i want to use that function in another ksh (ksh 2) i am using . $<directoryname>/<ksh name> i am calling the function defined in ksh 1 in ksh 2 i want the returnstatus from the above operation but it is not executing the function what i... (1 Reply)
Discussion started by: trichyselva
1 Replies
Login or Register to Ask a Question