Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Move File Containing More Than two "-" at 3rd Line To New Directory
Top Forums UNIX for Dummies Questions & Answers Move File Containing More Than two "-" at 3rd Line To New Directory Post 302944184 by bakunin on Saturday 16th of May 2015 02:36:15 PM
Old 05-16-2015
Quote:
Originally Posted by RudiC
You could do it also without sed, just shell parameter expansion...
Yes, but the original problem was: read a lot (~700k) files and extract only a certain part of line 3. Shell expansion can extract that part but it is not easy to interrupt the reading process after only 3 lines. Therefore i figured there must be a tradeoff between the preserved fork() of shell expansion and the lesser I/O the sed solution produces.

Which optimisation weighs heavier is probably different from system to system and depends on so many factors i didn't even try to take measurements. I could have, but the disks i have on all my systems all come from several EMC VMaxes (we even boot from LUNs via VIOS) and i doubt that thread-O/P has an I/O-subsystem capable of shoveling up to 700MB/s to/from the disks. This will, IMHO, have such a big impact on the tme it takes to read the 700k files that i could as well roll a dice.

I hope this helps.

bakunin
This User Gave Thanks to bakunin For This Post:
Nexeu
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Explain the line "mn_code=`env|grep "..mn"|awk -F"=" '{print $2}'`"

Hi Friends, Can any of you explain me about the below line of code? mn_code=`env|grep "..mn"|awk -F"=" '{print $2}'` Im not able to understand, what exactly it is doing :confused: Any help would be useful for me. Lokesha (4 Replies)
Discussion started by: Lokesha
4 Replies

2. Shell Programming and Scripting

awk command to replace ";" with "|" and ""|" at diferent places in line of file

Hi, I have line in input file as below: 3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL My expected output for line in the file must be : "1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL" Can someone... (7 Replies)
Discussion started by: shis100
7 Replies

3. UNIX for Dummies Questions & Answers

script works well but displays " line 6: =: No such file or directory"

strange :) can you tell why?:cool: #!/bin/bash echo " enter your age " read age if ; then echo " you do not have to pay tax " elif ]; then echo " you are eligible for income tax " else echo " you dont have to pay tax " fi (3 Replies)
Discussion started by: me.
3 Replies

4. UNIX for Dummies Questions & Answers

look for file size greater than "0" of specific pattern and move those to another directory

Hi , i have some files of specific pattern ...i need to look for files which are having size greater than zero and move those files to another directory.. Ex... abc_0702, abc_0709, abc_782 abc_1234 ...etc need to find out which is having the size >0 and move those to target directory..... (7 Replies)
Discussion started by: dssyadav
7 Replies

5. Shell Programming and Scripting

Find lines with "A" then change "E" to "X" same line

I have a bunch of random character lines like ABCEDFG. I want to find all lines with "A" and then change any "E" to "X" in the same line. ALL lines with "A" will have an "X" somewhere in it. I have tried sed awk and vi editor. I get close, not quite there. I know someone has already solved this... (10 Replies)
Discussion started by: nightwatchrenba
10 Replies

6. UNIX for Dummies Questions & Answers

Using "mailx" command to read "to" and "cc" email addreses from input file

How to use "mailx" command to do e-mail reading the input file containing email address, where column 1 has name and column 2 containing “To” e-mail address and column 3 contains “cc” e-mail address to include with same email. Sample input file, email.txt Below is an sample code where... (2 Replies)
Discussion started by: asjaiswal
2 Replies

7. Shell Programming and Scripting

Move a line containg "char" above line containing "xchar"

Okay, so I have a rather large text file and will have to process many more and this will save me hours of work. I'm not very good at scripting, so bear with me please. Working on Linux RHEL I've been able to filter and edit and clean up using sed, but I have a problem with moving lines. ... (9 Replies)
Discussion started by: rex007can
9 Replies

8. Shell Programming and Scripting

Failure: if grep "$Var" "$line" inside while read line loop

Hi everybody, I am new at Unix/Bourne shell scripting and with my youngest experiences, I will not become very old with it :o My code: #!/bin/sh set -e set -u export IFS= optl="Optl" LOCSTORCLI="/opt/lsi/storcli/storcli" ($LOCSTORCLI /c0 /vall show | grep RAID | cut -d " "... (5 Replies)
Discussion started by: Subsonic66
5 Replies

9. Shell Programming and Scripting

Bash script - Print an ascii file using specific font "Latin Modern Mono 12" "regular" "9"

Hello. System : opensuse leap 42.3 I have a bash script that build a text file. I would like the last command doing : print_cmd -o page-left=43 -o page-right=22 -o page-top=28 -o page-bottom=43 -o font=LatinModernMono12:regular:9 some_file.txt where : print_cmd ::= some printing... (1 Reply)
Discussion started by: jcdole
1 Replies

10. AIX

Apache 2.4 directory cannot display "Last modified" "Size" "Description"

Hi 2 all, i have had AIX 7.2 :/# /usr/IBMAHS/bin/apachectl -v Server version: Apache/2.4.12 (Unix) Server built: May 25 2015 04:58:27 :/#:/# /usr/IBMAHS/bin/apachectl -M Loaded Modules: core_module (static) so_module (static) http_module (static) mpm_worker_module (static) ... (3 Replies)
Discussion started by: penchev
3 Replies

LEARN ABOUT CENTOS

unsquashfs

UNSQUASHFS(1)						  uncompress squashfs filesystems					     UNSQUASHFS(1)

NAME

       mksquashfs - tool to uncompress squashfs filesystems

SYNOPSIS

       unsquashfs [OPTIONS] FILESYSTEM [directories or files to extract]

DESCRIPTION

       Squashfs  is  a	highly compressed read-only filesystem for Linux. It uses zlib compression to compress both files, inodes and directories.
       Inodes in the system are very small and all blocks are packed to minimize data overhead. Block sizes greater than 4K are supported up to  a
       maximum of 64K.

       Squashfs  is  intended for general read-only filesystem use, for archival use (i.e. in cases where a .tar.gz file may be used), and in con-
       strained block device/memory systems (e.g. embedded systems) where low overhead is needed.

OPTIONS

       -v, -version
	   print version, licence and copyright information.

       -d PATHNAME, -dest PATHNAME
	   unsquash to PATHNAME, default "squashfs-root".

       -n, -no-progress
	   don't display the progress bar.

       -no, -no-xattrs
	   don't extract xattrs in file system.

       -x, -xattrs
	   extract xattrs in file system (default).

       -p NUMBER, -processors NUMBER
	   use NUMBER processors. By default will use number of processors available.

       -i, -info
	   print files as they are unsquashed.

       -li, -linfo
	   print files as they are unsquashed with file attributes (like ls -l output).

       -l, -ls
	   list filesystem, but don't unsquash.

       -ll, -lls
	   list filesystem with file attributes (like ls -l output), but don't unsquash.

       -f, -force
	   if file already exists then overwrite.

       -s, -stat
	   display filesystem superblock information.

       -e EXTRACT_FILE, -ef EXTRACT_FILE
	   list of directories or files to extract. One per line.

       -da SIZE, -data-queue SIZE
	   Set data queue to SIZE Mbytes. Default 256 Mbytes.

       -fr SIZE, -frag-queue SIZE
	   Set fragment queue to SIZE Mbytes. Default 256 Mbytes.

       -r, -regex
	   treat extract names as POSIX regular expressions rather than use the default shell wildcard expansion (globbing).

   Decompressors available
       gzip

       lzo

       xz

SEE ALSO

       mksquashfs(1)

HOMEPAGE

       More information about unsquashfs and the squashfs filesystem can be found at <http://squashfs.sourceforge.net/>.

AUTHOR

       squashfs was written by Phillip Lougher <plougher@users.sourceforge.net>.

       This manual page was written by Daniel Baumann <daniel.baumann@progress-technologies.net>.

4.2								    2012-06-30							     UNSQUASHFS(1)
All times are GMT -4. The time now is 06:10 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy