Shrinking a file Post: 43036

Sponsored Content

Top Forums Shell Programming and Scripting Shrinking a file Post 43036 by Perderabo on Monday 10th of November 2003 09:15:25 AM

11-10-2003

Administrator Emeritus

This can be done in most languages. I would go with c mostly based on file size. If not c, then I would use ksh. The choice of language really is just a personal choice.

This task is tough enough that it will require a real programmer. You say that you have worked on a few simple shell scripts. Unless you have several years of programming experience in some procedural language it's unlikely that you will succeed.

To answer your question, you need to make a pass though the file creating lists of each of the types of 03 records. Then you need to examine the lists. If a list has less then 100 items, all items on the list will be marked ok. If the list has over 100 items, only some will be marked ok.

Since you counted the elements, you can compute 2% of that number. Now you know how many to mark ok.

To mark one ok, generate a random integer between 1 and n where n in the number of non-ok elements in the list. Now scan the list from element 1 to the end and find the selected element. Mark it ok. Subtract one from your number of non-ok elements on the list. Generate a new random integer between 1 and current number of non-ok elements. Find that one. And so on until you have marked the required number ok.

After you have done this with each list, go back to main file. For each 03 record, see it it's marked ok on the lists. If so write it and the child records to the final output file.

Perderabo

View Public Profile for Perderabo

Find all posts by Perderabo

9 More Discussions You Might Find Interesting

1. Linux

shrinking root partition and using free space to create a block device

We are intending to protect a set of user specified files using LVM mirroring where the protected space on which the user files are stored is mirrored on an LV on a different disk. Our problem is that for a user with a custom layout has installed linux with 2 partitons for swap and / and there is...

2. AIX

shrinking filesystem error

Hi Guys, probably a standard issue, so what do I miss here? Error message: > chfs -a size=-128M /export/nim/aix/5300-10 chfs: 0506-964 There is not enough free space to shrink the file system. df shows 0.75GB free > df -g . Filesystem GB blocks Free %Used Iused %Iused...

3. Windows & DOS: Issues & Discussions

Consolidating Freespace to allow shrinking partition?

i have an "old" laptop with 84gb used space, 203gb free, running 32bit Windows Vista. i've tried all defragmenting programs i could find and though some offer Free Space Defrag, they don't seem to take into account where on the disk to consolidates the space to. what i am trying to achieve is...

4. Linux

About shrinking LVM and then adding the freed space to another OS on dualboot system

Hi all, Fedora 17, 64bit Ubuntu 12.04 desktop 64bit HD 160G I installed Ubuntu 12.04 on the HD first taking up the whole disc. Later I added/installed Fedora 17 selecting the "Shrink" option and save the bootloader on /dev/sda1 to make them dualboot. Installation is successful with...

5. Shell Programming and Scripting

Match list of strings in File A and compare with File B, C and write to a output file in CSV format

Hi Friends, I'm a great fan of this forum... it has helped me tone my skills in shell scripting. I have a challenge here, which I'm sure you guys would help me in achieving... File A has a list of job ids and I need to compare this with the File B (*.log) and File C (extend *.log) and copy...

6. Solaris

Shrinking zpool

Hello experts, I have a solaris 10 (SunOS 5.10 Generic_148888-05 sun4u sparc SUNW,SPARC-Enterprise) that by mistake I added a second san space of 700g to the pool. the whole pool is now 1.2T and, I need to take the space away from the pool and, make the pool 700g total. this is live oracle...

7. Shell Programming and Scripting

Compare 2 text file with 1 column in each file and write mismatch data to 3rd file

Hi, I need to compare 2 text files with around 60000 rows and 1 column. I need to compare these and write the mismatch data to 3rd file. File1 - file2 = file3 wc -l file1.txt 58112 wc -l file2.txt 55260 head -5 file1.txt 101214200123 101214700300 101250030067 101214100500...

8. UNIX for Dummies Questions & Answers

Shrinking partitions in enterprise

Hello , to invent some software we need to massive shrink system volumes in our company (800 pc windows xp) . For that purpose we are planing to run remotely some linux distro with fdisk script. Some one have similar experience? ? Any information would be helpfull . THanks.;)

9. Shell Programming and Scripting

Shell script (sh file) logic to compare contents of one file with another file and output to file

Shell script logic Hi I have 2 input files like with file 1 content as (file1) "BRGTEST-242" a.txt "BRGTEST-240" a.txt "BRGTEST-219" e.txt File 2 contents as fle(2) "BRGTEST-244" a.txt "BRGTEST-244" b.txt "BRGTEST-231" c.txt "BRGTEST-231" d.txt "BRGTEST-221" e.txt I want to get...

LEARN ABOUT DEBIAN

interface-order

INTERFACE-ORDER(5)						    resolvconf							INTERFACE-ORDER(5)

NAME

       interface-order - resolvconf configuration file

DESCRIPTION

       The  file  /etc/resolvconf/interface-order is used to control the order in which resolvconf nameserver information records are processed by
       those resolvconf update scripts that consult this file.	(The name of the file is apt because a resolvconf nameserver information record is
       named after the interface with which it is associated.)

       The  file  contains  a sequence of shell glob patterns, one per line.  The position of a record in the order is the point at which its name
       first matches a pattern.

       Patterns may not contain whitespace, slashes or initial dots or tildes.	Blank lines and lines beginning with a '#' are ignored.

       Resolvconf update scripts in /etc/resolvconf/update.d/ that consult this file include the current default versions of  dnsmasq,	pdnsd  and
       libc.   (Actually  they don't read the file directly; they call the utility program /lib/resolvconf/list-records which lists records in the
       specified order and omits the names of empty records.)

EXAMPLE

       # /etc/resolvconf/interface-order
       # Use nameservers on the loopback interface first.
       lo*
       # Next use records for Ethernet interfaces
       eth*
       # Next use records for Wi-Fi interfaces
       wlan*
       # Next use records for PPP interfaces
       ppp*
       # Last use other interfaces
       *

AUTHOR

       Resolvconf was written by Thomas Hood <jdthood@gmail.com>.

COPYRIGHT

       Copyright (C) 2004, 2011 Thomas Hood
       This is free software; see the source for copying conditions.  There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICU-
       LAR PURPOSE.

SEE ALSO

       resolvconf(8)

resolvconf							    18 May 2011 						INTERFACE-ORDER(5)