Visit Our UNIX and Linux User Community


Help with AWK


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with AWK
# 1  
Old 10-08-2007
Question Help with AWK

Hi All,

I'm usually pretty good with this stuff, but my current shell script project has got me stumped. Essentially, I've created a dynamic shell menu based upon files in a single folder. It's tree-based and uses a numeric and standardised naming format:

Code:
#ls -l
total 0
-rw-r--r--  1 root eai 0 Oct  8 08:49 011_Functionality_Example.sh
-rw-r--r--  1 root eai 0 Oct  8 08:49 012_Another_Example.sh
-rw-r--r--  1 root eai 0 Oct  8 08:48 01_Menu_1
-rw-r--r--  1 root eai 0 Oct  8 08:49 021_More_Functionality.sh
-rw-r--r--  1 root eai 0 Oct  8 08:49 02_Menu_2
-rw-r--r--  1 root eai 0 Oct  8 08:48 0_Main_Menu

My shell script works well, but at the moment I can only provide the user with the following to assist in menu selection:

Code:
#ls -l | awk '{print $9}' | sort -n

0_Main_Menu
01_Menu_1
02_Menu_2
011_Functionality_Example.sh
012_Another_Example.sh
021_More_Functionality.sh

...but clearly this does not show files in a tree structure. Ideally, this is what I would like to see:

Code:
0)   Main Menu
01)  Menu 1
011) Functionality Example
012) Another Example
02)  Menu 2
021) More Functionality

In reality, I won't display the entire tree at any given time, but it is the following that I am looking to do for each particular ls using awk:
  • Drop the suffix '.sh', if any
  • Remove all underscores
  • Sort into a tree-like order*
  • Swap the first space for right bracket and tab
*Optional, since I will typically be displaying files from the same 'level', and hence a numeric sort will suffice.

Thanks in advance if you can help me out... Smilie

Last edited by cs03dmj; 10-08-2007 at 10:23 AM..
# 2  
Old 10-08-2007
Maybe using a multidimensional array will make it easier to achieve this objective? Or you can use one array to store the names as reference to the arrays containing the menu items. The sorting and positioning problem is solved then.

Arrays - The GNU Awk User's Guide
# 3  
Old 10-08-2007
You can start with something like this:

Code:
> ll 
total 0
-rw-r--r--   1 oracle     dba              0 Oct  8 10:24 011_Functionality_Example.sh
-rw-r--r--   1 oracle     dba              0 Oct  8 10:24 012_Another_Example.sh
-rw-r--r--   1 oracle     dba              0 Oct  8 10:24 01_Menu_1
-rw-r--r--   1 oracle     dba              0 Oct  8 10:24 021_More_Functionality.sh
-rw-r--r--   1 oracle     dba              0 Oct  8 10:24 02_Menu_2
-rw-r--r--   1 oracle     dba              0 Oct  8 10:24 0_Main_Menu
> ls |awk -F\_ '{gsub(/\..+$/,"",$0);printf("\n%s)\t",$1);for (i=2;i<=NF-1;i++)printf("%s ",$i);printf("%s",$NF) }'|grep -vE "^$"|sort -k1
0)      Main Menu
01)     Menu 1
011)    Functionality Example
012)    Another Example
02)     Menu 2
021)    More Functionality


Last edited by Klashxx; 10-08-2007 at 07:20 AM..
# 4  
Old 10-08-2007
with GNU awk
Code:
ls ..... | awk '{ 
gsub(/\.sh?/,"",$9)
file=$9
n=split($9,a,"_")
temp[a[1]]=file    
}END{
     m = asorti(temp, newtemp)    
     for(i=1;i<=m;i++){
          gsub( newtemp[i]"_",") ",temp[newtemp[i]]) 
          print newtemp[i] temp[newtemp[i]]
     }
}
'

output:
Code:
# ./test.sh

0) Main_Menu
01) Menu_1
011) Functionality_Example
012) Another_Example
02) Menu_2
021) More_Functionality

# 5  
Old 10-08-2007
Computer

Massive thanks to all three responses - I will be using a combination of your suggestions in the final version. Here's how it looks for now for anyone who may need similar:

Code:
#!/bin/ksh
# Script Name   : test.sh
# Purpose       : Basic User Interface
# Origin Date   : 02/10/07
# Version       : 1.0
# Author        : 
# Description   : Basic dynamic menu system for Unix scripts.

#===================================================
f_get_key()
#---------------------------------------------------
# Function to return the next keystroke.
#===================================================
{
    oldstty=`stty -g`
    stty -icanon -echo min 1 time 0
    key=`dd bs=1 count=1 2>/dev/null`
    stty "$oldstty"
}

#===================================================
f_head()
#---------------------------------------------------
# Function to clear the screen and draw the header.
#===================================================
{
    if [ "$nomenu" = "1" ]; then
        echo "===================================================="
        echo "$*"
        echo "===================================================="
    else
        clear
        echo "####################################################"
        echo "#                       _        _            _    #"
        echo "#   ___ _ __ ___   ___ | | _____| |_ ___  ___| |_  #"
        echo "#  / __| '_ \` _ \ / _ \| |/ / _ \ __/ _ \/ __| __| #"
        echo "#  \__ \ | | | | | (_) |   <  __/ ||  __/\__ \ |_  #"
        echo "#  |___/_| |_| |_|\___/|_|\_\___|\__\___||___/\__| #"
        echo "#                                                  #"
        echo "####################################################"
        echo `date '+%d/%m/%y'`"                                       "`date '+%H:%M'`
        echo "===================================================="
        echo
        c_width=52
        c_text="- $* - $current -"
        c_width=$(( ($c_width + ${#c_text}) / 2 )) 
        printf "%${c_width}.${c_width}s\n" "$c_text"
        echo
    fi
}

#===================================================
f_foot()
#---------------------------------------------------
# Function to add the footer and request an input.
#===================================================
{
    if [ "$nomenu" = "1" ]; then
        echo
        echo
    else
        echo
        echo "===================================================="
        echo "         MAIN MENU: 0 | UP: RETURN | EXIT: x        "
        echo "===================================================="
        f_get_key
    fi
}

#===================================================
#---------------------------------- END OF FUNCTIONS
#---------------------------------------------------
# START OF MAIN PROGRAM ----------------------------
#===================================================

current=""
parent=""
key=""
nomenu=""

if [ "$1" != "" ]; then
    current=$1
	key=unset
else
    current=0
fi

until [ "$key" = "x" ]
do
    if [ "$current" = "0" ]; then
        parent=0
    else
        parent=`echo $current | awk '{print substr($0,1,length($0)-1)}'`
    fi
    
	temp=$current$key"_*"
	if [ -e $temp ]; then
		current=$current$key
	else
		current=$current
	fi
	
	if [ "$key" = "" ]; then
		current=$parent
	elif [ "$key" = "0" ]; then
		current=0
	fi
	
	temp=$current"_*"
	title=`ls -l $temp | awk '{print $9}' | sed 's/^[0-9]*_//;s/_/ /g;s/.sh$//'`
	temp=$current"?_*"
	if [ -e $temp ]; then
		f_head $title
		ls -l $temp | awk '{print $9}' | sort -n | sed 's/^[0-9]*\([0-9]\)_/ \1) /;s/_/ /g;s/.sh$//'
		f_foot
	else
		temp=$current"_*.sh"
		f_head $title
		if [ -x $temp ]; then
			./$temp
		else
			echo "No associated executables ($temp) have been found!"
		fi
		f_foot
	fi
done
clear
echo "...THANKS FOR USING THE SMOKETEST!"
echo
exit 0

N.B. Naming convention is per the question.
# 6  
Old 10-09-2007
add sed command to your code

I think this solution should be ok.

Just add follow code to your code:

Code:
sed 's/_/) /' a | sed 's/_/ /g'

so the total code should be:
Code:
awk '{print $9}' | sort -n | sed 's/_/) /' | sed 's/_/ /g'


Previous Thread | Next Thread
Test Your Knowledge in Computers #174
Difficulty: Medium
The Apache 2 'Fancy indexing' directive shows the files plus the date the file was last modified, the size and the user who originally created the files.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk output yields error: awk:can't open job_name (Autosys)

Good evening, Im newbie at unix specially with awk From an scheduler program called Autosys i want to extract some data reading an inputfile that comprises jobs names, then formating the output to columns for example 1. This is the inputfile: $ more MapaRep.txt ds_extra_nikira_usuarios... (18 Replies)
Discussion started by: alexcol
18 Replies

2. Shell Programming and Scripting

Pass awk field to a command line executed within awk

Hi, I am trying to pass awk field to a command line executed within awk (need to convert a timestamp into formatted date). All my attempts failed this far. Here's an example. It works fine with timestamp hard-codded into the command echo "1381653229 something" |awk 'BEGIN{cmd="date -d... (4 Replies)
Discussion started by: tuxer
4 Replies

3. Shell Programming and Scripting

Passing awk variable argument to a script which is being called inside awk

consider the script below sh /opt/hqe/hqapi1-client-5.0.0/bin/hqapi.sh alert list --host=localhost --port=7443 --user=hqadmin --password=hqadmin --secure=true >/tmp/alerts.xml awk -F'' '{for(i=1;i<=NF;i++){ if($i=="Alert id") { if(id!="") if(dt!=""){ cmd="sh someScript.sh... (2 Replies)
Discussion started by: vivek d r
2 Replies

4. Shell Programming and Scripting

HELP with AWK one-liner. Need to employ an If condition inside AWK to check for array variable ?

Hello experts, I'm stuck with this script for three days now. Here's what i need. I need to split a large delimited (,) file into 2 files based on the value present in the last field. Samp: Something.csv bca,adc,asdf,123,12C bca,adc,asdf,123,13C def,adc,asdf,123,12A I need this split... (6 Replies)
Discussion started by: shell_boy23
6 Replies

5. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

6. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

7. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

8. Shell Programming and Scripting

awk: assign variable with -v didn't work in awk filter

I want to filter 2nd column = 2 using awk $ cat t 1 2 2 4 $ VAR=2 #variable worked in print $ cat t | awk -v ID=$VAR ' { print ID}' 2 2 # but variable didn't work in awk filter $ cat t | awk -v ID=$VAR '$2~/ID/ { print $0}' (2 Replies)
Discussion started by: honglus
2 Replies

9. Shell Programming and Scripting

scripting/awk help : awk sum output is not comming in regular format. Pls advise.

Hi Experts, I am adding a column of numbers with awk , however not getting correct output: # awk '{sum+=$1} END {print sum}' datafile 2.15291e+06 How can I getthe output like : 2152910 Thank you.. # awk '{sum+=$1} END {print sum}' datafile 2.15079e+06 (3 Replies)
Discussion started by: rveri
3 Replies

10. Shell Programming and Scripting

Awk problem: How to express the single quote(') by using awk print function

Actually I got a list of file end with *.txt I want to use the same command apply to all the *.txt Thus I try to find out the fastest way to write those same command in a script and then want to let them run automatics. For example: I got the file below: file1.txt file2.txt file3.txt... (4 Replies)
Discussion started by: patrick87
4 Replies

Featured Tech Videos