Need advice: Copying large CSV report files off SCO system Post: 302538146

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

copying .profile files to a new server (SCO)

Hello Intelligent Life Forms (I hope) This should be a snap for some of you. I need to copy the /usr .profiles from 1 sco system to another. Migrating to a new server. I've tried a recursive copy to the target system with a NFS mount point from the source. Wouldn't do it permissions...

2. Web Development

Content Management System for uploading large files

Hi everybody, I am currently trying to develop a simple content management system where I have an internal website for my users to upload large files onto the server. The site is password protected and my users won't be trying to hack into the system so security is a non-factor (as least for...

3. Shell Programming and Scripting

Sed or awk script to remove text / or perform calculations from large CSV files

I have a large CSV files (e.g. 2 million records) and am hoping to do one of two things. I have been trying to use awk and sed but am a newbie and can't figure out how to get it to work. Any help you could offer would be greatly appreciated - I'm stuck trying to remove the colon and wildcards in...

4. Programming

Is there a system call other than 'open' for opening very large files?

Dear all, Inside a C program, I want to open a very big file (about 12 GB) in order to read its content. Here is the code: /* argv contains the path to the file. */ inputFileDescriptor = open(argv, O_RDONLY); if (inputFileDescriptor < 0) { ...

5. Shell Programming and Scripting

Copying of large files fail

Hi, I have a process which duplicates files for different environments. As the files arrive, my script (korn shell) makes copies of them (giving a unique name) and then renames the original file so that my process won't get triggered again. I don't like it either, but it's what we were told to...

6. Shell Programming and Scripting

Copying multiple csv files

Hi, I have mutiple csv files at server1 at /apps/test/data. I needed a script that would copy these csv files from server1 at /usr/data, put them in server2,archive the earlier files that were present in server2 before removing those already present. Kindly help.

7. Red Hat

Advice regarding filesystems handling large number of files

Hi All, I have a CentOS operating system installed. I work with really huge number of files which are not only huge in number but some of them really huge in size. Minimum number of files could be 1 million to 2 million in one directory itself. Some of the files are even several Gigabytes in...

8. Shell Programming and Scripting

Merging Very large CSV files in Unix

Hi, I have two very large CSV files, which I want to merge (equi-join) based on a key (column). One of the file (say F1) would have ~30 MM records and 700 columns. The other file (~f2) would have same # of records and lesser columns (say 50). I want to create an output file joining on a...

9. Shell Programming and Scripting

Comparing two large unsorted csv files

Hi All, My requirement is to write a shell script to compare two large csv files. I've created sample files for explaining my problem i.e., a.csv and b.csv contents of files: ----------------- a.csv ------ Type,Memory (Kb),Location HD,Size (Mb),Serial # XT,640,D402,0,MG0010...

10. Shell Programming and Scripting

Copying large files in a bash script stops execution

Hello, I'm new to this forum and like to first of all say hello to everyone. I've got a really annoying problem at the moment. I'm trying to rsync some files (about 200MB with one file of 120MB) from a Raspberry PI with raspbian to a debian server via rsync. This procedure is stored in a...

LEARN ABOUT CENTOS

ng_ubt

NG_UBT(4)						   BSD Kernel Interfaces Manual 						 NG_UBT(4)

NAME

     ng_ubt -- Netgraph node type that is also a driver for Bluetooth USB devices

SYNOPSIS

     #include <sys/types.h>
     #include <netgraph/bluetooth/include/ng_ubt.h>

DESCRIPTION

     The ubt node type is both a persistent Netgraph node type and a driver for Bluetooth USB devices.	It implements a Bluetooth USB transport
     layer as per chapter H2 of the Bluetooth Specification Book v1.1.	A new node is created when a supported USB device is plugged in.

     The node has a single hook called hook.  Incoming bytes received on the device are re-assembled into HCI frames (according to the length).
     Full HCI frames are sent out on the hook.	The node will add a HCI frame indicator if the device did not send it.	HCI frames received on
     hook are transmitted out.	The node will drop the HCI frame indicator unless the device requires it to be present.

HARDWARE

     The ng_ubt driver supports all Bluetooth USB devices that conform with the Bluetooth specification v1.1, including:

     o	 3Com 3CREB96
     o	 AIPTEK BR0R02
     o	 EPoX BT-DG02
     o	 Mitsumi Bluetooth USB adapter
     o	 MSI MS-6967
     o	 TDK Bluetooth USB adapter

HOOKS

     This node type supports the following hooks:

     hook    single HCI frame contained in a single mbuf structure.

CONTROL MESSAGES

     This node type supports the generic control messages, plus the following:

     NGM_UBT_NODE_GET_DEBUG
	     Returns an integer containing the current debug level for the node.

     NGM_UBT_NODE_SET_DEBUG
	     This command takes an integer argument and sets the current debug level for the node.

     NGM_UBT_NODE_GET_QLEN
	     This command takes a parameter that specifies the queue number and returns the current maximal length of the queue for the node.

     NGM_UBT_NODE_SET_QLEN
	     This command takes two parameters that specify the queue number and the maximum length of the queue and sets the maximal length of
	     the queue for the node.

     NGM_UBT_NODE_GET_STAT
	     Returns various statistic information for the node, such as: number of bytes (frames) sent, number of bytes (frames) received and
	     number of input (output) errors.

     NGM_UBT_NODE_RESET_STAT
	     Reset all statistic counters to zero.

SHUTDOWN

     This node shuts down when the corresponding USB device is un-plugged.

SEE ALSO

     netgraph(4), ugen(4), usb(4), ngctl(8)

HISTORY

     The ubt node type was implemented in FreeBSD 5.0.

AUTHORS

     Maksim Yevmenkin <m_evmenkin@yahoo.com>

BUGS

     Isochronous USB transfers are broken.  This means that the USB device will not be able to transfer SCO data (voice).  USB interrupt transfers
     are implemented as bulk-in transfers (not really a bug).

BSD
								September 13, 2004							       BSD

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

copying .profile files to a new server (SCO)

Discussion started by: sighbrrguy

2. Web Development

Content Management System for uploading large files

Discussion started by: z1dane

3. Shell Programming and Scripting

Sed or awk script to remove text / or perform calculations from large CSV files

Discussion started by: metronomadic

4. Programming

Is there a system call other than 'open' for opening very large files?

Discussion started by: dariyoosh