Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Print all with along with stripped one column string
Top Forums Shell Programming and Scripting Print all with along with stripped one column string Post 303023814 by drysdalk on Sunday 23rd of September 2018 02:51:16 AM
Old 09-23-2018
Hello,

My initial thought was that this would be straightforward, and something like this one line of awk would work:

Code:
$ cat test.txt
1234 84 test1 file:about user_detials(bankUser) :jpeg 10 40 xys
1356 2 branches dir:list of files(dirlisting:1) :directory 20 80 abc
$ awk '{ gsub("\\(", " ") ; gsub("\\)", " ") ; print $1,$2,$3,$6,$8,$9,$10}' test.txt
1234 84 test1 bankUser 10 40 xys
1356 2 branches files :directory 20 80
$

So the idea is that we use awk, first replacing the brackets with spaces, and then just do a straightforward print of the fields we need.

But as you'll have seen, the output we get doesn't quite match what you want. It turns out that the reason for this is that the number of fields is inconsistent, and changes from one line of your test data to the other.

To be specific, the first line has nine fields, whereas the second line has ten:

Code:
$ head -1 test.txt | awk '{print NF}'
9
$ tail -1 test.txt | awk '{print NF}'
10

Now others with greater familiarity with awk than myself may well be able to still come up with an elegant one-line way to deal with this, but personally I would think that you have to make sure that the only spaces in your data are used strictly as field separators, or alternatively that any fields using spaces are at least quoted.

The following script would seem to do what you need:

Code:
$ cat script.sh 
#!/bin/bash
file=test.txt

while read -r line
do
        type1=`echo "$line" | awk -F\( '{print $2}' | awk -F\) '{print $1}'`
        num1=`echo "$line" | awk -F\) '{print $2}' | awk '{print $2}'`
        num2=`echo "$line" | awk -F\) '{print $2}' | awk '{print $3}'`
        text1=`echo "$line" | awk -F\) '{print $2}' | awk '{print $4}'`
        echo $line | awk -v type1=$type1 -v num1=$num1 -v num2=$num2 -v text1=$text1 '{print $1,$2,$3,type1,num1,num2,text1}'
done < "$file"

$ ./script.sh 
1234 84 test1 bankUser 10 40 xys
1356 2 branches dirlisting:1 20 80 abc
$

So we use what field separators we can always count on (the brackets, or so I'm hoping !) to strip out the fields we need one at a time, then we build up our awk line at the end.

Hope this helps. If not, then if you can let me know in what respects it fails we can take things from there. The main thing in general with this type of problem is to make your input as consistently- and reliably-formatted as you possibly can, always.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Question about sort specific column and print other column at the same time !

Hi, This is my input file: ali 5 usa abc abu 4 uk bca alan 6 brazil bac pinky 10 utah sdc My desired output: pinky 10 utah sdc alan 6 brazil bac ali 5 usa abc abu 4 uk bca Based on the column two, I want to do the descending order and print out other related column at the... (3 Replies)
Discussion started by: patrick87
3 Replies

2. Shell Programming and Scripting

find expression with awk in only one column, and if it fits, print whole column

Hi. How do I find an expression with awk in only one column, and if it fits, then print that whole column. 1 apple oranges 2 bannanas pears 3 cats dogs 4 hesaid shesaid echo "which number:" read NUMBER (user inputs number 2 for this example) awk " /$NUMBER/ {field to search is field... (2 Replies)
Discussion started by: glev2005
2 Replies

3. Shell Programming and Scripting

print first few lines, then apply regex on a specific column to print results.

abc.dat tty cpu tin tout us sy wt id 0 0 7 3 19 71 extended device statistics r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 133.2 0.0 682.9 0.0 1.0 0.0 7.2 0 79 c1t0d0 0.2 180.4 0.1 5471.2 3.0 2.8 16.4 15.6 15 52 aaaaaa1-xx I want to skip first 5 line... (4 Replies)
Discussion started by: kchinnam
4 Replies

4. Shell Programming and Scripting

comparing column of two different files and print the column from in order of 2nd file

Hi friends, My file is like: Second file is : I need to print the rows present in file one, but in order present in second file....I used while read gh;do awk ' $1=="' $gh'" {print >> FILENAME"output"} ' cat listoffirstfile done < secondfile but the output I am... (14 Replies)
Discussion started by: CAch
14 Replies

5. UNIX for Dummies Questions & Answers

how to print the column that contains a string in delimited file in unix

Hi Team, I have a requirement to print the column or find the column number of a particular string in delimited (;) file. Ex: aaa;bbb;ccc;rrr;mmm; gggg;rrr;mmmm;ssss;eee;aaa; ccc;gggg;tttt;bbbb;dddd;ggggg;rrr; my file contains 1000+ rows like above example with semicolon... (3 Replies)
Discussion started by: baskivs
3 Replies

6. Shell Programming and Scripting

awk command to print only selected rows in a particular column specified by column name

Dear All, I have a data file input.csv like below. (Only five column shown here for example.) Data1,StepNo,Data2,Data3,Data4 2,1,3,4,5 3,1,5,6,7 3,2,4,5,6 5,3,5,5,6 From this I want the below output Data1,StepNo,Data2,Data3,Data4 2,1,3,4,5 3,1,5,6,7 where the second column... (4 Replies)
Discussion started by: ks_reddy
4 Replies

7. Shell Programming and Scripting

Print every 5 4th column values as separate row with different first column

Hi, I have the following file, chr1 100 200 20 chr1 201 300 22 chr1 220 345 23 chr1 230 456 33.5 chr1 243 567 90 chr1 345 600 20 chr1 430 619 21.78 chr1 870 910 112.3 chr1 914 920 12 chr1 930 999 13 My output would be peak1 20 22 23 33.5 90 peak2 20 21.78 112.3 12 13 Here the... (3 Replies)
Discussion started by: jacobs.smith
3 Replies

8. Shell Programming and Scripting

awk Print New Column For Every Two Lines and Match On Multiple Column Values to print another column

Hi, My input files is like this axis1 0 1 10 axis2 0 1 5 axis1 1 2 -4 axis2 2 3 -3 axis1 3 4 5 axis2 3 4 -1 axis1 4 5 -6 axis2 4 5 1 Now, these are my following tasks 1. Print a first column for every two rows that has the same value followed by a string. 2. Match on the... (3 Replies)
Discussion started by: jacobs.smith
3 Replies

9. Shell Programming and Scripting

Help with compare two column and print out column with smallest number

Input file : 5 20 500 2 20 41 41 0 23 1 Desired output : 5 2 20 0 1 By comparing column 1 and 2 in each line, I hope can print out the column with smallest number. I did try the following code, but it don't look good :( (2 Replies)
Discussion started by: perl_beginner
2 Replies

10. Shell Programming and Scripting

Need awk or Shell script to compare Column-1 of two different CSV files and print if column-1 matche

Example: I have files in below format file 1: zxc,133,joe@example.com cst,222,xyz@example1.com File 2 Contains: hxd hcd jws zxc cst File 1 has 50000 lines and file 2 has around 30000 lines : Expected Output has to be : hxd hcd jws (5 Replies)
Discussion started by: TestPractice
5 Replies

LEARN ABOUT PHP

fs_whereis

FS_WHEREIS(1)						       AFS Command Reference						     FS_WHEREIS(1)

NAME

       fs_whereis - Reports each file server housing a file or directory

SYNOPSIS

       fs whereis [-path <dir/file path>+] [-help]

       fs whe [-p <dir/file path>+] [-h]

DESCRIPTION

       The fs whereis command returns the name of each file server machine that houses the volume containing each directory or file named by the
       -path argument.

OPTIONS

       -path <dir/file path>+
	   Names each AFS file or directory for which to return the host file server machine. Partial pathnames are interpreted relative to the
	   current working directory, which is also the default value if this argument is omitted.

       -help
	   Prints the online help for this command. All other valid options are ignored.

OUTPUT

       The output includes a line for each specified directory or file. It names the file server machine on which the volume that houses the
       specified directory or file resides. A list of multiple machines indicates that the directory or file is in a replicated volume.

       Machine names usually have a suffix indicating their cell membership. If the cell is not clear, use the fs whichcell command to display the
       cell in which the directory or file resides. To display the cell membership of the local machine, use the fs wscell command.

EXAMPLES

       The following example indicates that volume housing the directory /afs/abc.com resides is replicated on both "fs1.abc.com" and
       "fs3.abc.com":

	  % fs whereis -path /afs/abc.com
	  File /afs/abc.com is on hosts fs1.abc.com fs3.abc.com

PRIVILEGE REQUIRED

       None

SEE ALSO

       fs_whichcell(1), fs_wscell(1)

COPYRIGHT

       IBM Corporation 2000. <http://www.ibm.com/> All Rights Reserved.

       This documentation is covered by the IBM Public License Version 1.0.  It was converted from HTML to POD by software written by Chas
       Williams and Russ Allbery, based on work by Alf Wachsmann and Elizabeth Cassell.

OpenAFS 							    2012-03-26							     FS_WHEREIS(1)
All times are GMT -4. The time now is 02:10 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy