Sponsored Content
Top Forums Shell Programming and Scripting Sending output of program into subsequent commands (i.e. awk/sort) Post 303036399 by sand1234 on Tuesday 25th of June 2019 01:48:50 AM
Old 06-25-2019
Sending output of program into subsequent commands (i.e. awk/sort)

Hi,

I have identified how to use command chaining as per below on a file, to capture the header of a file, as well as the line containing the C: drive.

Code:
$ cat test.txt
Filesystem      Size  Used Avail Use% Mounted on
rootfs          237G  153G   84G  65% /
none            237G  153G   84G  65% /dev
none            237G  153G   84G  65% /run
none            237G  153G   84G  65% /run/lock
none            237G  153G   84G  65% /run/shm
none            237G  153G   84G  65% /run/user
C:              237G  153G   84G  65% /mnt/c

$ cat <(head -n1 test.txt) <(awk '/C/' test.txt)
Filesystem      Size  Used Avail Use% Mounted on
C:              237G  153G   84G  65% /mnt/c

I am trying to use the same logic on the output of a command, but it does not work. How can I get this to work?

Aim is to sort docker images by size column on the right, while printing the first line (header).

Code:
$ docker image ls
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
alpine              latest              4d90542f0623        5 days ago          5.58MB
ubuntu              xenial              13c9f1285025        6 days ago          119MB
ubuntu              latest              4c108a37151f        6 days ago          64.2MB
centos              latest              9f38484d220f        3 months ago        202MB
linode/lamp         latest              2359fa12fded        4 years ago         372MB

$ docker image ls | awk 'NR>1' | sort -k5 -V -r
linode/lamp         latest              2359fa12fded        4 years ago         372MB
centos              latest              9f38484d220f        3 months ago        202MB
ubuntu              xenial              13c9f1285025        6 days ago          119MB
ubuntu              latest              4c108a37151f        6 days ago          64.2MB
alpine              latest              4d90542f0623        5 days ago          5.58MB

$ docker image ls | (awk 'NR==1') <(sort -k5 -V -r)
-bash: syntax error near unexpected token `<(sort -k5 -V -r)'  <----- failure
$ docker image ls
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
alpine              latest              4d90542f0623        5 days ago          5.58MB
ubuntu              xenial              13c9f1285025        6 days ago          119MB
ubuntu              latest              4c108a37151f        6 days ago          64.2MB
centos              latest              9f38484d220f        3 months ago        202MB
linode/lamp         latest              2359fa12fded        4 years ago         372MB

Thanks

Last edited by sand1234; 06-29-2019 at 11:52 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

combining unix commands and awk program

Dear Experts I am trying to find if it is possible to combine unix commands in awk program. For example if it is possible embed rm or ls or any unix command inside the awk program and while it is reading the file besides printing be able to do some unix commands. I am thinking may be just print... (2 Replies)
Discussion started by: Reza Nazarian
2 Replies

2. UNIX for Dummies Questions & Answers

Using the Sort, Cut, and Awk commands

Hello, I am trying, utilizing the few commands I know, to extract all records within my file that were generated in November of 2007. Each record within the file has a "date" field giving the month, day, and year (9-8-88). How do I extract those records to their own file? Once I extract... (4 Replies)
Discussion started by: babbabooey
4 Replies

3. UNIX for Dummies Questions & Answers

Sending awk output to nothing?

How can I direct awk output to go nowhere? I can write the data to a file easy enough or print it on the screen. But for this particular command I don't actually want the data and I don't want to create a file. I just want the data discarded. Thanks in advance (3 Replies)
Discussion started by: MrEddy
3 Replies

4. Shell Programming and Scripting

awk text record - prepend first field to all subsequent fields

Hello everyone, I've suddenly gotten very interested in sed and awk (and enjoying it quite a bit too) because of a large conversion project that we're working on. I'm currently stuck with a very inefficient process for processing text blocks. I'm sure someone here should be able to easily point out... (2 Replies)
Discussion started by: jameswatson3
2 Replies

5. Shell Programming and Scripting

awk - use fields from subsequent lines

I've run into a problem getting exactly what I want out of awk - some folks may recognize this as an output from Amazon's ec2-describe-instances: Given the following: INSTANCE i-4960f321 BLOCKDEVICE Line2Var2 TAG instance i-4960f321 Name web1 TAG instance i-4960f321... (2 Replies)
Discussion started by: colinjohnson
2 Replies

6. UNIX for Dummies Questions & Answers

is there a way to assing variable a value that is output of a program in awk script?

Hi there is there a way to assing variable a value that is output of a program in awk script. For e.g., I did temp=(`grep "" $5 | cut -f8 -d' '`) but it does not work. Any advice??? Thanks in advance!!! :) (3 Replies)
Discussion started by: FUTURE_EINSTEIN
3 Replies

7. Shell Programming and Scripting

Want to sort a file using awk & sed to get required output

Hi All, Need Suggestion, Want to sort a file using awk & sed to get required, output as below, such that each LUN shows correct WWPN and FA port Numbers correctly: Required output: 01FB 10000000c97843a2 8C 0 01FB 10000000c96fb279 9C 0 22AF 10000000c97843a2 8C 0 22AF 10000000c975adbd ... (10 Replies)
Discussion started by: aix_admin_007
10 Replies

8. Shell Programming and Scripting

Pipe or combine output of three awk commands

What is the correct syntax to pipe or run three awk commands? Basically, using the output of the first awk as input in the second. Then using the output of the second awk in the third. Thank you :). awk 'FNR==NR {E; next }$3 in E {print $3, $5}' panel_genes.txt RefSeqGene.txt > update.txt |... (3 Replies)
Discussion started by: cmccabe
3 Replies

9. Shell Programming and Scripting

awk capturing first sample, but not subsequent id's

In the awk below the first sample MEV45 gets extracted from the html, but the subsequent MEV46 and MEV47 do not as they are not part of parse. I can not seem to add them to the code. Thank you very much @RudiC your awk is very nice :). input {"barcodeId": "IonXpress", "barcodedSamples":... (3 Replies)
Discussion started by: cmccabe
3 Replies

10. Shell Programming and Scripting

awk Sort 2d histogram output from min(X,Y) to max(X,Y)

I've got Gnuplot-format 2D histogram data output which looks as follows. 6.5 -1.25 10.2804 6.5404 -1.25 10.4907 6.58081 -1.25 10.8087 6.62121 -1.25 10.4686 6.66162 -1.25 10.506 6.70202 -1.25 10.3084 6.74242 -1.25 9.68256 6.78283 -1.25 9.41229 6.82323 -1.25 9.43078 6.86364 -1.25 9.62408... (1 Reply)
Discussion started by: chrisjorg
1 Replies
lofiadm(1M)						  System Administration Commands					       lofiadm(1M)

NAME
lofiadm - administer files available as block devices through lofi SYNOPSIS
/usr/sbin/lofiadm -a file [device] /usr/sbin/lofiadm -d file | device /usr/sbin/lofiadm [ file | device] DESCRIPTION
lofiadm administers lofi(7D), the loopback file driver. lofi(7D) allows a file to be associated with a block device. That file can then be accessed through the block device. This is useful when the file contains an image of some filesystem (such as a floppy or CD-ROM image), because the block device can then be used with the normal system utilities for mounting, checking or repairing filesystems. See fsck(1M) and mount(1M). Use lofiadm to add a file as a loopback device, remove such an association, or print information about the current associations. OPTIONS
The following options are supported: -a file [deviceAdd file as a block device. If device is not specified, an available device is picked. If device is specified, lofiadm attempts to assign it to file. device must be available or lofiadm will fail. The ability to specify a device is provided for use in scripts that wish to re-establish a particular set of associations. -d file | deviceRemove an association by file or device name, if the associated block device is not busy, and deallocates the block device. OPERANDS
The following operands are supported: file Print the block device associated with file. device Print the file name associated with the block device device. Without arguments, print a list of the current associations. Filenames must be valid absolute pathnames. When a file is added, it is opened for reading or writing by root. Any restrictions apply (such as restricted root access over NFS). The file is held open until the association is removed. It is not actually accessed until the block device is used, so it will never be written to if the block device is only opened read-only. EXAMPLES
Example 1: Mounting an Existing CD-ROM Image You should ensure that Solaris understands the image before creating the CD. lofi allows you to mount the image and see if it works. This example mounts an existing CD-ROM image (sparc.iso), of the Red Hat 6.0 CD which was downloaded from the Internet. It was created with the mkisofs utility from the Internet. Use lofiadm to attach a block device to it: # lofiadm -a /home/mike_s/RH6.0/sparc.iso /dev/lofi/1 lofiadm picks the device and prints the device name to the standard output. You can run lofiadm again by issuing the following command: # lofiadm Block Device File /dev/lofi/1 /home/mike_s/RH6.0/sparc.iso Or, you can give it one name and ask for the other, by issuing the following command: # lofiadm /dev/lofi/1 /home/mike_s/RH6.0/sparc.iso Use the mount command to mount the image: # mount -F hsfs -o ro /dev/lofi/1 /mnt Check to ensure that Solaris understands the image: # df -k /mnt Filesystem kbytes used avail capacity Mounted on /dev/lofi/1 512418 512418 0 100% /mnt # ls /mnt ./ RedHat/ doc/ ls-lR rr_moved/ ../ TRANS.TBL dosutils/ ls-lR.gz sbin@ .buildlog bin@ etc@ misc/ tmp/ COPYING boot/ images/ mnt/ usr@ README boot.cat* kernels/ modules/ RPM-PGP-KEY dev@ lib@ proc/ Solaris can mount the CD-ROM image, and understand the filenames. The image was created properly, and you can now create the CD-ROM with confidence. As a final step, unmount and detach the images: # umount /mnt # lofiadm -d /dev/lofi/1 # lofiadm Block Device File Example 2: Mounting a Floppy Image This is similar to Example 1. Using lofi to help you mount files that contain floppy images is helpful if a floppy disk contains a file that you need, but the machine which you are on does not have a floppy drive. It is also helpful if you do not want to take the time to use the dd command to copy the image to a floppy. This is an example of getting to MDB floppy for Solaris on an x86 platform: # lofiadm -a /export/s28/MDB_s28x_wos/latest/boot.3 /dev/lofi/1 # mount -F pcfs /dev/lofi/1 /mnt # ls /mnt ./ COMMENT.BAT* RC.D/ SOLARIS.MAP* ../ IDENT* REPLACE.BAT* X/ APPEND.BAT* MAKEDIR.BAT* SOLARIS/ # umount /mnt # lofiadm -d /export/s28/MDB_s28x_wos/latest/boot.3 Example 3: Making a UFS Filesystem on a File Making a UFS filesystm on a file can be useful, particularly if a test suite requires a scratch filesystem. It can be painful (or annoying) to have to re-partition a disk just for the test suite, but you do not have to. You can newfs a file with lofi Create the file: # mkfile 35m /export/home/test Attach it to a block device. You also get the character device that newfs requires, so newfs that: # lofiadm -a /export/home/test /dev/lofi/1 # newfs /dev/rlofi/1 newfs: construct a new file system /dev/rlofi/1: (y/n)? y /dev/rlofi/1: 71638 sectors in 119 cylinders of 1 tracks, 602 sectors 35.0MB in 8 cyl groups (16 c/g, 4.70MB/g, 2240 i/g) super-block backups (for fsck -F ufs -o b=#) at: 32, 9664, 19296, 28928, 38560, 48192, 57824, 67456, Note that ufs might not be able to use the entire file. Mount and use the filesystem: # mount /dev/lofi/1 /mnt # df -k /mnt Filesystem kbytes used avail capacity Mounted on /dev/lofi/1 33455 9 30101 1% /mnt # ls /mnt ./ ../ lost+found/ # umount /mnt # lofiadm -d /dev/lofi/1 Example 4: Creating a PC (FAT) File System on a Unix File The following series of commands creates a FAT file system on a Unix file. The file is associated with a block device created by lofiadm. # mkfile 10M /export/test/testfs # lofiadm -a /export/test testfs /dev/lofi/1 Note use of rlofi, not lofi, in following command. # mkfs -F pcfs -o nofdisk,size=20480 /dev/rlofi/1 Construct a new FAT file system on /dev/rlofi/1: (y/n)? y # mount -F pcfs /dev/lofi/1 /mnt # cd /mnt # df -k . Filesystem kbytes used avail capacity Mounted on /dev/lofi/1 10142 0 10142 0% /mnt ENVIRONMENT VARIABLES
See environ(5) for descriptions of the following environment variables that affect the execution of lofiadm: LC_CTYPE, LC_MESSAGES and NLSPATH. EXIT STATUS
The following exit values are returned: 0 Successful completion. >0 An error occurred. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ |ATTRIBUTE TYPE |ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWcsu | +-----------------------------+-----------------------------+ SEE ALSO
fsck(1M), mount(1M), mount_ufs(1M), newfs(1M), attributes(5), lofi(7D), lofs(7FS) NOTES
Just as you would not directly access a disk device that has mounted file systems, you should not access a file associated with a block device except through the lofi file driver. It might also be appropriate to ensure that the file has appropriate permissions to prevent such access. Associations are not persistant across reboots. A script can be used to re-establish them if required. The abilities of lofiadm, and who can use them, are controlled by the permissions of /dev/lofictl. Read-access allows query operations, such as listing all the associations. Write-access is required to do any state-changing operations, like adding an association. As shipped, /dev/lofictl is owned by root, in group sys, and mode 0644, so all users can do query operations but only root can change any- thing. The administrator can give users write-access, allowing them to add or delete associations, but that is very likely a security hole and should probably only be given to a trusted group. When mounting a filesystem image, take care to use appropriate mount options. In particular, the nosuid mount option might be appropriate for UFS images whose origin is unknown. Also, some options might not be useful or appropriate, like logging or forcedirectio for UFS. For compatibility purposes, a raw device is also exported along with the block device. For example, newfs(1M) requires one. The output of lofiadm (without arguments) might change in future releases. SunOS 5.10 17 Nov 1999 lofiadm(1M)
All times are GMT -4. The time now is 09:05 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy