awk does not work well with huge data? Post: 302912778

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

A variable and sum of its value in a huge data.

Hi Experts, I got a question.. In the following output of `ps -elf | grep DataFlow` I get:- 242001 A mqsiadm 2076676 1691742 0 60 20 26ad4f400 130164 * May 09 - 3:02 DataFlowEngine EAIDVBR1_BROKER 5e453de8-2001-0000-0080-fd142b9ce8cb VIPS_INQ1 0 242001 A mqsiadm...

2. Shell Programming and Scripting

Split a huge data into few different files?!

Input file data contents: >seq_1 MSNQSPPQSQRPGHSHSHSHSHAGLASSTSSHSNPSANASYNLNGPRTGGDQRYRASVDA >seq_2 AGAAGRGWGRDVTAAASPNPRNGGGRPASDLLSVGNAGGQASFASPETIDRWFEDLQHYE >seq_3 ATLEEMAAASLDANFKEELSAIEQWFRVLSEAERTAALYSLLQSSTQVQMRFFVTVLQQM ARADPITALLSPANPGQASMEAQMDAKLAAMGLKSPASPAVRQYARQSLSGDTYLSPHSA...

3. UNIX for Dummies Questions & Answers

Copy huge data into vi editor

Hi All, HP-UX dev4 B.11.11 U 9000/800 3251073457 I need to copy huge data from windows text file to vi editor. when I tried copy huge data, the format of data is not preserverd and appered to scatterd through the vi, something like give below. Please let me know, how can I correct this? ...

4. Red Hat

Disk is Full but really does not contain huge data

Hi All, My disk usage show 100 % . When I check “df –kh” it shows my root partition is full. But when I run the “du –skh /” shows only 7 GB is used. Filesystem Size Used Avail Use% Mounted on /dev/sda1 30G 28G 260MB 100% / How I can identify who is using the 20 GB of memory. Os: Centos...

5. Shell Programming and Scripting

Work with huge Zipped files

Hello dear members, I have one general and one specific question which I will be very grateful if you could help me with them. Let's start with my general question: 1. I am working on cluster computer shared with other people and I need to manipulate a big zipped text file of 13 GB. There is...

6. Shell Programming and Scripting

awk - fetch multiple data from huge dump

Hello Experts I have a requirement wherein I need to fetch multiple data from huge dump egrep -f Pattern.txt Dump.txt My pattern file has got like 300 entries and Dump file is like 8GB data. It taking eternity to complete on my machine. Is their a faster way to search pattern like using...

7. Shell Programming and Scripting

Aggregation of huge data

Hi Friends, I have a file with sample amount data as follows: -89990.3456 8788798.990000128 55109787.20 -12455558989.90876 I need to exclude the '-' symbol in order to treat all values as an absolute one and then I need to sum up.The record count is around 1 million. How...

8. Solaris

The Fastest for copy huge data

Dear Experts, I would like to know what's the best method for copy data around 3 mio (spread in a hundred folders, size each file around 1kb) between 2 servers? I already tried using Rsync and tar command. But using these command is too long. Please advice. Thanks Edy

9. Shell Programming and Scripting

Phrase XML with Huge Data

HI Guys, I have Big XML file with Below Format :- Input :- <pokl>MKL=1,FN=1,GBNo=B10C</pokl> <d>192</d> <d>315</d> <d>35</d> <d>0,7,8</d> <pokl>MKL=1,dFN=1,GBNo=B11C</pokl> <d>162</d> <d>315</d> <d>35</d> <d>0,5,6</d> <pokl>MKL=1,dFN=1,GBNo=B12C</pokl> <d>188</d>

10. UNIX for Advanced & Expert Users

Need Optimization shell/awk script to aggreagte (sum) for all the columns of Huge data file

Optimization shell/awk script to aggregate (sum) for all the columns of Huge data file File delimiter "|" Need to have Sum of all columns, with column number : aggregation (summation) for each column File not having the header Like below - Column 1 "Total Column 2 : "Total ... ......

LEARN ABOUT CENTOS

aic

AIC(4)							 BSD/i386 Kernel Interfaces Manual						    AIC(4)

NAME

     aic -- Adaptec AIC-6260 and AIC-6360 SCSI driver

SYNOPSIS

     device aic

     In /boot/device.hints:
     hint.aic.0.at="isa"

DESCRIPTION

     The aic driver provides support for the Adaptec AIC-6260 and AIC-6360 SCSI controller chips.  Many systems that use these controller chips do
     not have a boot ROM and therefore cannot be booted from.

HARDWARE

     The adapters supported by the aic driver include:

     o	 Adaptec AHA-1505 (ISA)
     o	 Adaptec AHA-1510A, AHA-1510B (ISA)
     o	 Adaptec AHA-1520A, AHA-1520B (ISA)
     o	 Adaptec AHA-1522A, AHA-1522B (ISA)
     o	 Adaptec AHA-1535 (ISA)
     o	 Creative Labs SoundBlaster SCSI host adapter (ISA)
     o	 Adaptec AHA-1460, AHA-1460B, AHA-1460C, AHA-1460D (PC Card)
     o	 Adaptec AHA-1030B, AHA-1030P (PC98)
     o	 NEC PC-9801-100 (PC98)

SEE ALSO

     aha(4), ahb(4), ahc(4), cd(4), ch(4), da(4), intro(4), sa(4)

BUGS

     The driver does not work well with multiple devices on the SCSI bus.  The driver works well with devices like CDROMs and Tape drives.  The
     driver works not so well with disk drives.  The PC Card version appears to work better than the ISA version, but that may be due to differing
     levels of testing of the devices.

BSD
								 November 8, 2003							       BSD

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

A variable and sum of its value in a huge data.

Discussion started by: varungupta

2. Shell Programming and Scripting

Split a huge data into few different files?!

Discussion started by: patrick87

3. UNIX for Dummies Questions & Answers

Copy huge data into vi editor

Discussion started by: alok.behria

4. Red Hat

Disk is Full but really does not contain huge data

Discussion started by: kalpeer

5. Shell Programming and Scripting

Work with huge Zipped files

Discussion started by: Homa

6. Shell Programming and Scripting

awk - fetch multiple data from huge dump

Discussion started by: navkanwal

7. Shell Programming and Scripting

Aggregation of huge data

Discussion started by: Ravichander