String has * as the field delimiter and I need echo/awk to escape it, how? Post: 302989074

Sponsored Content

Top Forums UNIX for Beginners Questions & Answers String has * as the field delimiter and I need echo/awk to escape it, how? Post 302989074 by Scrutinizer on Saturday 7th of January 2017 02:16:53 AM

01-07-2017

Moderator

Hi the awk statements are indeed "not clean" but since they are inside a loop they also slow things down considerably.

Here is an alternative way that you could try using the shell's read statement, which should be much faster:

Code:

{
  IFS=' -'  read day month year timestamp
  IFS='(=)' read x x x x x x program x x x x x user x x x x x service_name x
  IFS='(=)' read x x x x app_protocol x x app_host x x app_port x
} << EOF
$TS
$CS
$HOST
EOF

The repeated x variables are used to contain the things that we do not need.
The IFS variable is local to the read command and it is used to specify the characters that separate the fields in a given string.
A "Here document" ( << EOF ) is used to emulate a file that contains the three variables TC, CS and HOST on a separate line.
The curly braces { .. } to together with << EOF are used to define a block of shell code that uses the here document as input.

---
Here is another way of writing it, using separate here documents, which may be preferable since it provides a cleaner look and maybe is a bit easier to read for the human eye:

Code:

IFS=' -'  read day month year timestamp << EOF
$TS
EOF

IFS='(=)' read x x x x x x program x x x x x user x x x x x service_name x << EOF
$CS
EOF

IFS='(=)' read x x x x app_protocol x x app_host x x app_port x << EOF
$HOST
EOF

Last edited by Scrutinizer; 01-07-2017 at 03:35 AM..

Scrutinizer

View Public Profile for Scrutinizer

Find all posts by Scrutinizer

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Set a variable field delimiter using awk

How can i set a variable field delimiter using awk?? I wanna do something like this ,but i can�t get the correct syntaxis : VARI=TEST echo "0121212TESTxvcshaashd"|awk 'FS="$VARI" {print $2}' Thanks.

2. UNIX for Advanced & Expert Users

Printing Field with Delimiter in AWK/cut

Hello, I had posted earlier about printing fields using AWK, but now I have a slightly different problem. I have text files in the format: 1*2,3,4,5 and wish to print the first, third, and fifth fields, including the asterisk and commas. In other words, after filtering it should look...

3. Shell Programming and Scripting

need to convert a decimal value to an ascii char with awk for the field delimiter

Hello, I need an awk script to receive a variable that's an decimal value such as 009 or 031 and then convert this value to an ascii character to use as the FS (field separator for the input file). For example, 009 should be converted to an ascii tab 031 should be converted to an ascii...

4. Shell Programming and Scripting

awk output field delimiter

Dear All, 1.txt (tab in between each value in a line) a b c a b c a c d you can see below, why with ~ i can output with tab, but = cannot? # awk -F'\t' '$2 ~ /b/' 1 a b c a b c # awk -F'\t' '$2 = "b"' 1 a b c a b c a b d ...

5. Shell Programming and Scripting

how to find the nth field value in delimiter file in unix using awk

Hi All, I wanted to find 200th field value in delimiter file using awk.? awk '{print $200}' inputfile I am getting error message :- awk: The field 200 must be in the range 0 to 199. The source line number is 1. The error context is {print >>> $200 <<< } using...

6. Shell Programming and Scripting

Awk Search text string in field, not all in field.

Hello, I am using awk to match text in a tab separated field and am able to do so when matching the exact word. My problem is that I would like to match any sequence of text in the tab-separated field without having to match it all. Any help will be appreciated. Please see the code below. awk...

7. Shell Programming and Scripting

perform echo and awk inside a string

hi, just wanted to make a shortcut of this one a="a b c" b=`echo $a | awk '{print $2}'` echo "the middle is $b" why can't i do this: a="a b c" echo "the middle is ${`echo $a | awk '{print $2}'`}" <- bad substitution :wall: thanks

8. Shell Programming and Scripting

awk :how to change delimiter without giving all field name

Hi Experts, i need to change delimiter from tab to "," sample test file cat test A0000368 A29938511 072569352 5 Any 2 for �1.00 BUTCHERS|CAT FOOD|400G Sep 12 2012 12:00AM Jan 5 2014 11:59PM Sep 7 2012 12:00AM M 2.000 group 5 ...

9. Shell Programming and Scripting

How can awk ignore the field delimiter like comma inside a field?

We have a csv file as mentioned below and the requirement is to change the date format in file as mentioned below. Current file (file.csv) ---------------------- empname,date_of_join,dept,date_of_resignation ram,08/09/2015,sales,21/06/2016 "akash,sahu",08/10/2015,IT,21/07/2016 ...

10. UNIX for Beginners Questions & Answers

awk Associative Array and/or Referring to Field by String (Nonconstant String Value)

I will start with an example of what I'm trying to do and then describe how I am approaching the issue. File PS028,005 Lexeme HRS # M # PhraseType 1(1:1) 7(7) PhraseLab 501 503 ClauseType ZYq0 PS028,005 Lexeme W # L> # BNH # M #...

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Set a variable field delimiter using awk

Discussion started by: Klashxx

2. UNIX for Advanced & Expert Users

Printing Field with Delimiter in AWK/cut

Discussion started by: Jahn

3. Shell Programming and Scripting

need to convert a decimal value to an ascii char with awk for the field delimiter

Discussion started by: script_op2a

4. Shell Programming and Scripting

awk output field delimiter

Discussion started by: jimmy_y

5. Shell Programming and Scripting

how to find the nth field value in delimiter file in unix using awk

Discussion started by: Jairaj

6. Shell Programming and Scripting

Awk Search text string in field, not all in field.

Discussion started by: rocket_dog

7. Shell Programming and Scripting

perform echo and awk inside a string

Discussion started by: h0ujun

8. Shell Programming and Scripting

awk :how to change delimiter without giving all field name

Discussion started by: Lakshman_Gupta

9. Shell Programming and Scripting

How can awk ignore the field delimiter like comma inside a field?

Discussion started by: gopal.biswal

10. UNIX for Beginners Questions & Answers

awk Associative Array and/or Referring to Field by String (Nonconstant String Value)

Discussion started by: jvoot