Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Grabbing fields without using external commands

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Grabbing fields without using external commands
# 1  
Old 11-27-2017
Grabbing fields without using external commands
data:
Code:
bblah1_blah2_blah3_blah4_blah5
bblahA_blahB_blahC_blahD_blahE

im using the following code to grab the field i want:

Code:
cat data | while IFS='_' read v1 v2 v3 v4 v5; do printf '%s\n' "${v4}"; done

im catting data here. in the real world, the exact content of data will be in a variable. so instead of catting, i'll be doing something like printf '%s\n' "${datacontents}" | while IFS='_' read v1 v2 v3 v4 v5; do printf '%s\n' "${v4}"; done

This works for me. but there are many instances where I have to grab the last field or second to last field. how do i do that using the above command, without having to call any external utilities?

if i was to call an external utility i can grab the last field with this:
Code:
awk -F"_" '{print $NF}' data

and i can get the second to last with i believe this:
Code:
awk -F"_" '{print $(NF-1)}' data

i dont want to use awk or any external utilities. i gave the above examples so that i can be clear in what im asking.

i intend to use this code on across multiple unix platforms so it should be portable.
Last edited by SkySmart; 11-27-2017 at 06:58 PM..
# 2  
Old 11-27-2017
If you change the read to read into an array, you can access each member of the array by index.
e.g.
Code:
unset line
while IFS=_ read -A line; do
  NF=$((${#line[@]}-1))
  echo ${line[(($NF))]} # last field
  echo ${line[(($NF-1))]} # second last field
done < file

You could combine those two echo lines inside the while-loop with:
Code:
echo ${line[((${#line[@]}-1))]} # last field
echo ${line[((${#line[@]}-2))]} # second last field

but it's a bit messier to look at.

edit: I guess that's read -a (lowercase -a in Bash)

edit 2: Another option, using shell positional parameters:
Code:
while read line; do
 IFS=_ set -- $line
 ...
done < file

Last edited by Scott; 11-27-2017 at 07:16 PM.. Reason: edit
This User Gave Thanks to Scott For This Post:
SkySmart
# 3  
Old 11-27-2017
Quote:
Originally Posted by Scott
If you change the read to read into an array, you can access each member of the array by index.
e.g.
Code:
unset line
while IFS=_ read -A line; do
  NF=$((${#line[@]}-1))
  echo ${line[(($NF))]} # last field
  echo ${line[(($NF-1))]} # second last field
done < file

You could combine those two echo lines inside the while-loop with:
Code:
echo ${line[((${#line[@]}-1))]} # last field
echo ${line[((${#line[@]}-2))]} # second last field

but it's a bit messier to look at.
this works for bash:
Code:
#!/bin/bash

DATA="bblah1_blah2_blah3_blah4_blah5
bblahA_blahB_blahC_blahD_blahE"

printf '%s\n' "${DATA}" | while IFS=_ read -a line; do
  NF=$((${#line[@]}-1))
  echo ${line[(($NF-1))]}
done

but does not work for for sh. i get the following error:

Code:
read: Illegal option -a

if i try with the original -A which you had, i still get:

Code:
read: Illegal option -A

i care about this because there are some old systems we have here that dont have bash. they just have sh. systems such as AIX, SunOS.

any suggestions on how to circumvent this?
# 4  
Old 11-27-2017
If the data is in a variable as in:
Code:
var=bblah1_blah2_blah3_blah4_blah5

you can get the last field with:
Code:
last=${var##*_}

and the next to the last field with:
Code:
tmp=${var%_*}
second_last=${tmp##*_}

and to see the results:
Code:
printf '%s\n' "$second_last" "$last"

which with var set as shown above will print:
Code:
blah4
blah5

P.S.: I hadn't seen your last post (post #3) when I originally posted this and didn't know what OS you are using. The above suggestion will work with /usr/xpg4/bin/sh, ksh, or bash; but not /bin/sh on Solaris 10 systems. This will work with any shell that conforms to the POSIX standards. If some of your old systems were built before 1993, you may need to use expr to split substrings out of your variables unless you know how many underscores appear in your variables before you start splitting out fields from them.
Last edited by Don Cragun; 11-27-2017 at 07:34 PM.. Reason: Add postscript.
This User Gave Thanks to Don Cragun For This Post:
SkySmart
# 5  
Old 11-27-2017
Quote:
Originally Posted by SkySmart
this works for bash:
i care about this because there are some old systems we have here that dont have bash. they just have sh. systems such as AIX, SunOS.
Well, AIX uses Ksh, not SH, but you can always trust Solaris to have some dilapidated default junk right out of the box Smilie although if you have the option of /usr/xpg4/bin/sh, as Don mentions, that's an option.
These 2 Users Gave Thanks to Scott For This Post:
drl SkySmart
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grabbing variabes from logs

Hey guys, I am working on a script that needs to grab variables from a log file. The script will run morning 9 to 5pm and save variables for each run every hour, these results I will be aggregating at the end of the day. I am thinking I will be placing the date on each entry in the log every... (7 Replies)
Discussion started by: mo_VERTICASQL
7 Replies

2. Shell Programming and Scripting

Grabbing fields with perl

I have several .csv files containing data like this: field_1;field_2;date;comment;amount; I want to extract the 3 last fields and load them in a database. my input_file = "/dir/file.csv"; my output_file = "/dir/file.sql"; open my $csv_file, '<', $input_file or die "Can't... (1 Reply)
Discussion started by: freddie50
1 Replies

3. Shell Programming and Scripting

Grabbing strings with awk

Hello everyone, I am doing some sort of analysis for some data about organic solvents, and I have a problem with writing a command to do this: Here's a sample of my file: 1 ethanol 2 methanol 3 methanol/ethanol 4 ethanol/methanol 5 ethanol/DMF 6 ethyl... (6 Replies)
Discussion started by: Error404
6 Replies

4. Shell Programming and Scripting

[Solved] Value of a variable is not recognised for commands comes from external file

Hi, my script is setting a variable with value and this variable is present in my another command that is coming from external file and this command is internally called after this variable is set. but while execution of this command, the value is not retrieved properly. say, my script... (5 Replies)
Discussion started by: rbalaj16
5 Replies

5. Web Development

cgi script and external UNIX commands (like swadm)

Hi, I am trying to implement a server monitoring dashboard using cgi scripting. I am planning to run the necessary unix scripts from the web page using cgi. This method works fine for standard unix commands but I am unable to run some external unix commands (like swadm show_processes, swadm... (9 Replies)
Discussion started by: jofinjoseph
9 Replies

6. Shell Programming and Scripting

Grabbing Certain Fields

ok, so a script i wrote spits out an output like the below: 2,JABABA,BV=114,CV=1,DF=-113,PCT=99.1228% as you can see, each field is separated by a comma. now, how can I get rid of the first field and ONLY show the rest of the fields. meaning, i want to get rid of the "2,", and... (3 Replies)
Discussion started by: SkySmart
3 Replies

7. Shell Programming and Scripting

Grabbing info from Telnet

I have a process that is running locally on the machine. When you telnet to the process: telnet IP port, it automatically returns a string which shows the status of that process. Something like this: # telnet IP Port Trying 127.0.0.1... Connected to localhost (127.0.0.1). Escape... (3 Replies)
Discussion started by: skaptakalian
3 Replies

8. Shell Programming and Scripting

grabbing more than one argument in a loop

Hello all I hope someone can help me. I am trying to convert something I wrote in C to bash. But how do I go about reading more than one item at a time in a for loop? i have been using this format for the loops in the bash script i have been building. e.g. for word in `cat -s... (4 Replies)
Discussion started by: Intense4200
4 Replies

9. UNIX for Dummies Questions & Answers

Grabbing a value from an output file

I am executing a stored proc and sending the results in a log file. I then want to grab one result from the output parameters (bolded below, 2) so that I can store it in a variable which will then be called in another script. There are more details that get printed in the beginning of the log file,... (3 Replies)
Discussion started by: hern14
3 Replies
Login or Register to Ask a Question