Sponsored Content
Full Discussion: sort split merge -u unique
Top Forums Shell Programming and Scripting sort split merge -u unique Post 302551802 by radoulov on Wednesday 31st of August 2011 05:05:08 PM
Old 08-31-2011
You need a database, not shell scripting, to manipulate such amount of data ...
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Sort and Unique in Perl

Hi, May I know, if a pipe separated File is large, what is the best method to calculate the unique row count of 3rd column and get a list of unique value of the 3rdcolum? Thanks in advance! (20 Replies)
Discussion started by: deepakwins
20 Replies

2. UNIX for Dummies Questions & Answers

split a file with unique sets

This may sound like a trivial problem, but I still need some help: I have a file with ids and I want to split it 'n' ways (could be any number) into files: 1 1 1 2 2 3 3 4 5 5 Let's assume 'n' is 3, and we cannot have the same id in two different partitions. So the partitions may... (8 Replies)
Discussion started by: ChicagoBlues
8 Replies

3. Shell Programming and Scripting

Awk sort and unique

Input file --------- 12:name1:|host1|host1|host2|host1 13:name2:|host1|host1|host2|host3 14:name3: ...... Required output --------------- 12:name1:host1(2)|host1(1) 13:name2:host1(2)|host2(1)|host3(1) 14:name3: where (x) - Count how many times field appears in last column ... (3 Replies)
Discussion started by: greycells
3 Replies

4. Shell Programming and Scripting

How to merge columns into lines, using unique keys?

I would really appreciate a sulution for this : invoice# client# 5929 231 4358 231 2185 231 6234 231 1166 464 1264 464 3432 464 1720 464 9747 464 1133 791 4930 791 5496 791 6291 791 8681 989 3023 989 (2 Replies)
Discussion started by: hemo21
2 Replies

5. UNIX for Dummies Questions & Answers

How to count specific columns and merge with unique ones?

Hi. I am not sure the title gives an optimal description of what I want to do. I have several text files that contain data in many columns. All the files are organized the same way, but the data in the columns might differ. I want to count the number of times data occur in specific columns,... (0 Replies)
Discussion started by: JamesT
0 Replies

6. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks. (7 Replies)
Discussion started by: cokedude
7 Replies

7. Shell Programming and Scripting

How to merge two files with unique values matching.?

I have one script as below: #!/bin/ksh Outputfile1="/home/OutputFile1.xls" Outputfile2="/home/OutputFile2.xls" InputFile1="/home/InputFile1.sql" InputFile2="/home/InputFile2.sql" echo "Select hobby, class, subject, sports, rollNumber from Student_Table" >> InputFile1 echo "Select rollNumber... (3 Replies)
Discussion started by: Sharma331
3 Replies

8. Shell Programming and Scripting

Sort unique

Hi, I have an input file that I have sorted in a previous stage by $1 and $4. I now need something that will take the first record from each group of data based on the key being $1 Input file 1000AAA|"ZZZ"|"Date"|"1"|"Y"|"ABC"|""|AA 1000AAA|"ZZZ"|"Date"|"2"|"Y"|"ABC"|""|AA... (2 Replies)
Discussion started by: Ads89
2 Replies

9. UNIX for Beginners Questions & Answers

Merge 4 bim files by keeping only the overlapping variants (unique rs values )

Dear community, I am facing a problem and I kindly ask your help: I have 4 different data sets consisted from 3 different types of array. On each file, column 1 is chromosome position, column 2 is SNP id etc... Lets say I have the following (bim) datasets: x2014: 1 rs3094315... (4 Replies)
Discussion started by: fondan
4 Replies
XrmMergeDatabases(3X11) 					     MIT X11R4						   XrmMergeDatabases(3X11)

Name
       XrmMergeDatabases, XrmGetFileDatabase, XrmPutFileDatabase, XrmGetStringDatabase, XrmDestroyDatabase - manipulate resource databases

Syntax
       void XrmMergeDatabases(source_db, target_db)
	  XrmDatabase source_db, *target_db;

       XrmDatabase XrmGetFileDatabase(filename)
	  char *filename;

       void XrmPutFileDatabase(database, stored_db)
	  XrmDatabase database;
	  char *stored_db;

       XrmDatabase XrmGetStringDatabase(data)
	  char *data;

       void XrmDestroyDatabase(database)
	  XrmDatabase database;

Arguments
       data	 Specifies the database contents using a string.

       database  Specifies the database that is to be used.

       filename  Specifies the resource database file name.

       source_db Specifies the resource database that is to be merged into the target database.

       stored_db Specifies the file name for the stored database.

       target_db Specifies a pointer to the resource database into which the source database is to be merged.

Description
       The function merges the contents of one database into another.  It may overwrite entries in the destination database.  This function is
       used to combine databases (for example, an application specific database of defaults and a database of user preferences).  The merge is
       destructive; that is, the source database is destroyed.

       The function opens the specified file, creates a new resource database, and loads it with the specifications read in from the specified
       file.  The specified file must contain lines in the format accepted by If it cannot open the specified file, returns NULL.

       The function stores a copy of the specified database in the specified file.  The file is an ASCII text file that contains lines in the for-
       mat that is accepted by

       The function creates a new database and stores the resources specified in the specified null-terminated string.	is similar to except that
       it reads the information out of a string instead of out of a file.  Each line is separated by a new-line character in the format accepted
       by

       If database is NULL, returns immediately.

See Also
       XrmGetResource(3X11), XrmInitialize(3X11), XrmPutResource(3X11), XrmUniqueQuark(3X11)
       X Window System: The Complete Reference, Second Edition, Robert W. Scheifler and James Gettys

															   XrmMergeDatabases(3X11)
All times are GMT -4. The time now is 02:06 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy