Sponsored Content
Top Forums Shell Programming and Scripting Need a ready Shell script to validate a high volume data file Post 302859219 by blackrageous on Wednesday 2nd of October 2013 03:15:48 PM
Old 10-02-2013
There is no "ready shell script" for such a task. Provide a sample of the data file. Be specific about the rules for validating each column (field) for a line (record) of the data file.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Want to execute rest of the script after the file is ready ...

Hi All I have a requirement like, where a file gets generated in a particular dir and once the file is ready and available then I want to execute rest of the script, because untill and unless the file exists and is available there is no use of running rest of the commands in that script. ... (5 Replies)
Discussion started by: csaha
5 Replies

2. Shell Programming and Scripting

Better way to Validate column data in file.

I am trying to validate the third column in a pipe delimited file. The column must be 10 char long and all digits 0-9. I am writing out two new files from the existing file, if it would be quicker, I could leave the bad rows in the file and ignore them in the next process. What I have is... (12 Replies)
Discussion started by: barry1
12 Replies

3. Shell Programming and Scripting

The scope of the shell/perl script is to read the input text file. Validate the expiry date of each

The scope of the shell/perl script is to read the input text file. Validate the expiry date of each certificate and send the mail to the user. The user takes action to add the new certificate to the storage file and user owns the responsibility to update the input text file with the new certificate... (5 Replies)
Discussion started by: casmo
5 Replies

4. Shell Programming and Scripting

how to validate data of excel using perl or shell

I have a software which generates excel report with some specific data. The excel file format is .xls (old 2003 format) The data are in the forms like differenct cells contains numeric, string and alphanumeric data. The data per cell for specific input data is fixed. I need to retrive specific... (5 Replies)
Discussion started by: PratLinux
5 Replies

5. Shell Programming and Scripting

Validate file count in korn shell script

Hi, I have files in the directory like below which I need to validate if all the required files are present. A_B_001 of 002_time1.txt A_B_002 of 002_time1.txt A_B_001 of 001_time2.txt Scenarios- a)If file with 001 of 002_time1 or 002 of 002_time1 is missing in the folder,script should... (6 Replies)
Discussion started by: aneeta13
6 Replies

6. UNIX for Dummies Questions & Answers

Shell script to read lines in a text file and filter user data Shell Programming and Scripting

sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies

7. Shell Programming and Scripting

Script to ingest a csv, validate data and insert into Oracle

Hi all i would appreciate your help... I am looking for a set of unix commands which i can use to 1) ingest a csv file with a known format 2) validate the filename 3) validate the data/datatypes 4) Insert into an oracle db Can you help get me started? yogz888 (1 Reply)
Discussion started by: yogz888
1 Replies

8. Shell Programming and Scripting

Output large volume of data to CSV file

I have a program that output the ownership and permission on each directory and file on the server to a csv file. I am getting error message when I run the program. The program is not outputting to the csv file. Error: the file access permissions do not allow the specified action cannot... (2 Replies)
Discussion started by: dellanicholson
2 Replies

9. Shell Programming and Scripting

Bash to verify and validate file header and data type

The below bash is a file validation check executed that will verify the correct header count of 10 and the correct data type in each field of the tab-delimited file. The key has the data type of each field in it. My real data has 58 headers in it but only the header and next row need to be... (6 Replies)
Discussion started by: cmccabe
6 Replies

10. Shell Programming and Scripting

Shell Script to validate the access for Servers

Hi Experts, Please advise to Write a Shell script, To check , whether the user has access to UNIX PRODUCTION server or not? If no, then need to provide the access to UNIX PRODUCTION server and then need to provide access to print only few FILES. After connecting to ther server, again... (5 Replies)
Discussion started by: vasuvv
5 Replies
sadc(8) 						    BSD System Manager's Manual 						   sadc(8)

NAME
sadc -- system activity data collector SYNOPSIS
/usr/lib/sa/sadc [-m mode] [t n] [ofile] DESCRIPTION
The sadc tool is used to collect cumulative system activity data. The sample system data is collected at intervals t seconds apart, in a loop n times. The binary sample data is written to ofile if specified. Otherwise, the binary data is written to stdout. If the ofile file does not exist, it is created, otherwise it is truncated. sadc is intended to be used as the engine behind the sar(1) command, and is not typically invoked on the command line. Two shell scripts, sa1 and sa2, are provided to drive the typical sampling, saving, and reporting process. OPTIONS
The following options modify the way data is collected by sadc. -m mode Modify the collection of system statistics as specified by mode. Currently only one mode is supported. PPP By default, the collection of ppp network interface statistics is turned off. This is because the number of ppp connec- tions can be very high, causing the raw data file to grow unexpectedly large, especially when samples are collected at short intervals. Use the PPP mode to turn the collection back on. EXAMPLES
/usr/lib/sa/sadc 15 20 /tmp/sample.out This call collects 20 samples at 15 second intervals. The binary data is written to the /tmp/sample.out file FILES
/var/log/sa/sadd Default daily activity file that holds the binary sampling data. dd are digits that represent the day of the month. /usr/lib/sa/sa1 Shell script used to drive the sar data collection. /usr/lib/sa/sa2 Shell script used to drive the sar data reporting. SEE ALSO
fs_usage(1), netstat(1), sar(1), sc_usage(1), top(1), vm_stat(1), iostat(8), sa1(8), sa2(8) Mac OS X Jul 25 2003 Mac OS X
All times are GMT -4. The time now is 05:16 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy