split a file with unique sets Post: 302250065

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

FILE SETS in unix

Hi all, Pls. let me know whether there is any concept called "FILE SETS" in unix? Because, I am using ETL tool DataStage which creates FILE SETS. While I am able to view the data of such a file set in the tool, the "cat" command on this FILESET lists only the Metadata and not the data content...

2. AIX

IP Security file sets

hello, we are implementing ip security on several of our aix 5.2-09 boxes and i am unable to locate the prerequisite file sets. does anyone know where i can find these? i have the original 5.2 cd's but these file sets are not on any of the cd's. Any thoughts or suggestions?

3. Virtualization and Cloud Computing

Clouds (Partially Order Sets) - Streams (Linearly Ordered Sets) - Part 2

timbass Sat, 28 Jul 2007 10:07:53 +0000 Originally posted in Yahoo! CEP-Interest Here is my follow-up note on posets (partially ordered sets) and tosets (totally or linearly ordered sets) as background set theory for event processing, and in particular CEP and ESP. In my last note, we...

4. Shell Programming and Scripting

get part of file with unique & non-unique string

I have an archive file that holds a batch of statements. I would like to be able to extract a certain statement based on the unique customer # (ie. 123456). The end for each statement is noted by "ENDSTM". I can find the line number for the beginning of the statement section with sed. ...

5. Shell Programming and Scripting

sort split merge -u unique

Hi, this is about sorting a very large file (like 10 gb) to keep lines with unique entries across SOME of the columns. The line originally looked like this: sort -u -k2,2 -k3,3n -k4,4n -k5,5n -k6,6n file_unsorted > file_sorted please note the -u flag. The problem is that this single...

6. Shell Programming and Scripting

Change unique file names into new unique filenames

I have 84 files with the following names splitseqs.1, spliseqs.2 etc. and I want to change the .number to a unique filename. E.g. change splitseqs.1 into splitseqs.7114_1#24 and change spliseqs.2 into splitseqs.7067_2#4 So all the current file names are unique, so are the new file names....

7. Shell Programming and Scripting

Identifying dupes within a database and creating unique sub-sets

Hello, I have a database of name variants with the following structure: variant=variant=variant The number of variants can be as many as thirty to forty. Since the database is quite large (at present around 60,000 lines) duplicate sets of variants creep in. Thus John=Johann=Jon and...

8. UNIX for Beginners Questions & Answers

sed awk: split a large file to unique file names

Dear Users, Appreciate your help if you could help me with splitting a large file > 1 million lines with sed or awk. below is the text in the file input file.txt scaffold1 928 929 C/T + scaffold1 942 943 G/C + scaffold1 959 960 C/T +...

9. UNIX for Beginners Questions & Answers

Split into multiple files by using Unique columns in a UNIX file

I have requirement to split below file (sample.csv) into multiple files by using the unique columns (first 3 are unique columns) sample.csv 123|22|56789|ABCDEF|12AB34|2019-07-10|2019-07-10|443.3400|1|1 123|12|5679|BCDEFG|34CD56|2019-07-10|2019-07-10|896.7200|1|2...

LEARN ABOUT NETBSD

scan_lfs

SCAN_FFS(8)						    BSD System Manager's Manual 					       SCAN_FFS(8)

NAME

     scan_ffs, scan_lfs -- find FFSv1/FFSv2/LFS partitions on a disk or file

SYNOPSIS

     scan_ffs [-blv] [-e end] [-F file] [-s start] device

DESCRIPTION

     scan_ffs will take a raw disk device that covers the whole disk or a file and will find all possible FFSv[12]/LFS partitions, independent of
     block sizes on it.  It will show the file system type (FFSv1, FFSv2, or LFS), size, and offset.  Also it has an option to show the values
     with a disklabel-alike output.

     The options are as follows:

     -b 	  Report every superblock found with its sector address, rather than trying to report the partition boundaries.  This option can
		  be useful to find the other superblocks in a partition if the first superblock has become corrupted.	It is most useful if
		  device refers to the raw device for the partition, rather than the entire disk.

     -e end	  Where to stop searching for file systems.  The end argument specifies the last sector that will be searched.	Default is the
		  last sector of device.

     -F file	  Path to a file containing possible partitions inside of it.

     -l 	  Print out a string looking much like the input to disklabel.	With a little massaging, this output can usually be used by
		  disklabel(8).

     -s start	  Where to start searching for file systems.  This makes it easier to skip swap partitions or other large non-UFS/FFS partitions.
		  The start argument specifies the first sector that will be searched.	Default is the first sector of device.

     -v 	  Be verbose about what scan_ffs is doing, and what has been found.

     The device argument specifies which device scan_ffs should scan for file systems.

     scan_lfs is just another name for the same program, both behave in exactly the same way.

SEE ALSO

     disklabel(8)

HISTORY

     The scan_ffs program first appeared in OpenBSD 2.3 and then in NetBSD 3.1.  Support for searching in files was added in NetBSD 4.0.

AUTHORS

     scan_ffs was written for OpenBSD by Niklas Hallqvist and Tobias Weingartner.  It was ported to NetBSD by Juan Romero Pardines, who added sup-
     port for LFS/FFSv2, partitions with fragsize/blocksize greater than 2048/16384 for FFSv1, searching on files, etc.

BUGS

     Currently scan_ffs won't find partitions with fragsize/blocksize greater than 8192/65536.

BSD
								    May 1, 2007 							       BSD