Split huge File System Post: 303037768

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split a huge data into few different files?!

Input file data contents: >seq_1 MSNQSPPQSQRPGHSHSHSHSHAGLASSTSSHSNPSANASYNLNGPRTGGDQRYRASVDA >seq_2 AGAAGRGWGRDVTAAASPNPRNGGGRPASDLLSVGNAGGQASFASPETIDRWFEDLQHYE >seq_3 ATLEEMAAASLDANFKEELSAIEQWFRVLSEAERTAALYSLLQSSTQVQMRFFVTVLQQM ARADPITALLSPANPGQASMEAQMDAKLAAMGLKSPASPAVRQYARQSLSGDTYLSPHSA...

2. Shell Programming and Scripting

Perl script error to split huge data one by one.

Below is my perl script: #!/usr/bin/perl open(FILE,"$ARGV") or die "$!"; @DATA = <FILE>; close FILE; $join = join("",@DATA); @array = split( ">",$join); for($i=0;$i<=scalar(@array);$i++){ system ("/home/bin/./program_name_count_length MULTI_sequence_DATA_FILE -d...

3. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

I’m new to Linux script and not sure how to filter out bad records from huge flat files (over 1.3GB each). The delimiter is a semi colon “;” Here is the sample of 5 lines in the file: Name1;phone1;address1;city1;state1;zipcode1 Name2;phone2;address2;city2;state2;zipcode2;comment...

4. Shell Programming and Scripting

how to split a huge file by every 100 lines

into small files. i need to add a head.txt and tail.txt into small files at the begin and end, and give a name as q1.xml q2.xml q3.xml .... thank you very much.

5. UNIX for Dummies Questions & Answers

How to split a huge file into small pieces (per 2000 columns)?

Dear all, I have a big file:2879(rows)x400,170 (columns) like below. I 'd like to split the file into small pieces:2879(rows)x2000(columns) per file (the last small piece will be 2879x170. So far, I only know how to create one samll piece at one time. But actually I need to repeat this work...

6. UNIX for Dummies Questions & Answers

My file system is 100%, can't find the huge file

Please help. My file system is 100%, I can't seem to find what is taking so much space. The total hard drive space is 150Gig free but I got nothing now. I did to this to find the big file but it's taking so much time. Is there any other way? du -ah / | more find ./ -size +200M...

7. Shell Programming and Scripting

Split a file using 2-D indexing system

I have a file and want to split it using a 2-D index system for example if the file is p.dat with 6 data sets separated by ">". I want to set nx=3, ny=2. I need to create files p.dat.1.1 p.dat.1.2 p.dat.1.3 p.dat.2.1 p.dat.2.2 p.dat.2.3 I have tried using a single index and want...

8. UNIX for Dummies Questions & Answers

Split a huge 7 GB File Based on Pattern into 4 files

Hi, I have a Huge 7 GB file which has around 1 million records, i want to split this file into 4 files to contain around 250k messages each. Please help me as Split command cannot work here as it might miss tags.. Format of the file is as below ...

9. Shell Programming and Scripting

Split a folder with huge number of files in n folders

We have a folder XYZ with large number of files (>350,000). how can i split the folder and create say 10 of them XYZ1 to XYZ10 with 35,000 files each. (doesnt matter which files go where).

10. Solaris

Backup for NAS huge File system

Gents, I have NAS File System mounted in Solaris as \Sysapp with size 8 TB the problem once the backup stared it is impacting the performance of the OS. Do you have any idea how to can we backup this FS with fast scenario without impacting the OS. Backup type : Netbackup

LEARN ABOUT OSF1

dxfileshare

dxfileshare(8)						      System Manager's Manual						    dxfileshare(8)

NAME

       dxfileshare - Exports local directories and mounts directories from the network

SYNOPSIS

       /usr/bin/X11/dxfileshare

DESCRIPTION

       Use the File Sharing application, dxfileshare, to: Export (or share) local UNIX directories to the network Stop exporting UNIX local direc-
       tories to the network Specify which directories mounted from the network are to be remounted every time the system is  rebooted,  that  is,
       add  an entry to the /etc/fstab file Add, change, or delete NFS entries from the /etc/exports file Share local UNIX directories with a per-
       sonal computer (PC) when Advanced Server for UNIX is installed on your system Display local directories that are shared (exported) with the
       network Display network mounts (directories that can be mounted from the network)

       The File Sharing application can also be invoked from the CDE Application Manager from the following categories:

       Application Group:	System_Admin
       System Admin Subgroup:	Daily Admin

       Online help is available for the File Sharing application by clicking on any Help button or using the Help pull-down menu.

RESTRICTIONS

       You  must  have root privileges to use certain features of File Sharing.  Namely, the ability to export (or share) a directory or to modify
       the properties of a directory that is already being exported.

       You must have Advanced Server for UNIX installed on your system to share local directories with PCs.

FILES

       Defaults that are shared by the graphical and command line user interface. File Sharing uses the same file as the Host Manager application.
       File  Sharing  application File Sharing help volume Directory containing File Sharing application icons Application defaults file that sets
       the default values for the X resources File Sharing message catalog Message catalog containing File Sharing location IDs for  on-item  help
       i18n_motif_shared_text.cat

	      Message catalog containing application-independent messages i18n_motif_shared_text_LocIds.cat

	      Message catalog containing application-independent location IDs for on-item help

SEE ALSO

       Commands: X(1X), automount(8), bcheckrc(8), mount(8), mountd(8), showmount(8), umount(8)

       Functions: getfsstat(2), getmntinfo(3), getmntinfo_r(3), mount(2), mount(2sv), umount(2), umount(2sv), umount(3)

       Files: exports(4), fstab(4), mountdtab(4)

       Tru64 UNIX System Administration

       ASU Installation and Administration Guide

       ASU Concepts and Planning Guide

																    dxfileshare(8)