Sponsored Content
Top Forums Shell Programming and Scripting Help with multiple variables into one row in CSV! Post 302756787 by The_Grim_Coder on Wednesday 16th of January 2013 01:45:45 PM
Old 01-16-2013
Joey you are spot on my friend. Were I more knowledgabkle with the code I'm sure i could explain this better because I know from working at large companies that its fairly common to use commands, snmpgets, etc to pull raw data then format that to a csv or something similar and then import it into a database for others to access via websites or reporting tools.

I've gotten to the point I can pull this data in via scripts, for loops or whatever but getting it into a format that a database or a spreadsheet app likes afterwards has been the tricky part for me.

So to better explain what I'm doing here is the output of a command that tells me most the info I need about a server, its HBAs and the storage it has:

Code:
 
Symmetrix ID      : 00019010111
Host Name         : ServerA
Identifiers Found : 100000001111111
                         100000002222222
 
Device  Cap(MB)  Attr  Dir:P
------  -------  ----  ----
0155          3         7A:0,10A:0
0156          3         7A:0,10A:0
0157          3         7A:0,10A:0
-----------------------------
MB Total: 9

I'm using some simple awk commands to format this data as I listed in the first post. I don't have to use three different files, one would suffice and your cat/tr command combo against that one file would make it one row that I can then redirect to a master list.

So step one of my process would be to:

1. Run the command above in a loop against a list of a few hundred servers.
2. Pipe this data to a temp file per server as the loop is executed
3. Run your cat/tr command against the temp file and >> to my master list
4. Repeat until I have each server in my master list!

This works perfectly for me but being I'm not very knowledgable on the subject I would love to here yours or anyones opinion on how best to do this as I'm sure this is done often by server admins, network guys, etc for various admin reporting.

Thanks again!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

first row data into variables

I have a datafile having structure like col1,col2,col3 col1,col2,col3,col4,col5 col1,col2,col3,col4,col5 ..... Can we take only first row of values from datafile and put into respective variable. How col1 can be captured in a variable called v_col1 from unix script. like first row(only)... (1 Reply)
Discussion started by: u263066
1 Replies

2. Shell Programming and Scripting

manipulating csv to add extra row

hi how do i manipulate .csv file to add an extra row after each row using shell script? I need a blank line added for each 1000 records in my file? I will then need to copy and paste some data in the blank row created. thanks 4 ur support neil (3 Replies)
Discussion started by: neil546
3 Replies

3. UNIX for Dummies Questions & Answers

Delete first row of csv file

I have a csv file, which is > 2 Gigs. I need to BCP that file to Sybase db , but I cant upload that b'caz first row of the file is failing. ( having some errors probably.) I can manually insert the first line into db & then I can upload the rest of the data in file, if i can delete the first row. ... (2 Replies)
Discussion started by: kedar.mehta
2 Replies

4. Shell Programming and Scripting

Error in fetching multiple row values into variables

Hello Team, In the below code....The variabe values are not fetch from input table into SELECT statements. =========================== #!/usr/bash DATABASE=XXXXX inputFILE=$1 db2 connect to $DATABASE TABLENAME=`echo $inputFILE|awk '{print $1}'` COLUMNNAME=`echo $inputFILE|awk... (2 Replies)
Discussion started by: rocking77
2 Replies

5. Shell Programming and Scripting

awk: Transpose csv row to column.

Hello, am I new to awk, and I am tryint to: INPUT FILE: "73423555","73423556","73423557","73423558","73423559" OUTPUT FILE: 73423555 73423556 73423557 73423558 73423559 My useless code so far: #!/bin/awk -F ',' BEGIN { i=0; } (8 Replies)
Discussion started by: drbiloukos
8 Replies

6. Shell Programming and Scripting

CSV to SQL insert: Awk for strings with multiple lines in csv

Hi Fellows, I have been struggling to fix an issue in csv records to compose sql statements and have been really losing sleep over it. Here is the problem: I have csv files in the following pipe-delimited format: Column1|Column2|Column3|Column4|NEWLINE Address Type|some descriptive... (4 Replies)
Discussion started by: khayal
4 Replies

7. Shell Programming and Scripting

Splitting single row into multiple rows based on for every 10 digits of last field of the row

Hi ALL, We have requirement in a file, i have multiple rows. Example below: Input file rows 01,1,102319,0,0,70,26,U,1,331,000000113200000011920000001212 01,1,102319,0,1,80,20,U,1,241,00000059420000006021 I need my output file should be as mentioned below. Last field should split for... (4 Replies)
Discussion started by: kotra
4 Replies

8. Shell Programming and Scripting

Row bind multiple csv files having different column headers

All, I guess by this time someone asked this kind of question, but sorry I am unable to find after a deep search. Here is my request I have many files out of which 2 sample files provided below. File-1 (with A,B as column headers) A,B 1,2 File-2 (with C, D as column headers) C,D 4,5 I... (7 Replies)
Discussion started by: ks_reddy
7 Replies

9. Shell Programming and Scripting

Row Count in .csv file

Hi, I have to find the count of rows starting with "E," in given a.csv file . Sample Data File. E,2333AED,A,MC3,25,31-MAY-18 E,2333AED,A,MC3,25,31-MAY-18 CYMC3 25AED 0000 E,2333CZK,A,MC3,25,31-MAY-18 CYMC3 25CZK 0000 E,2333EUR,A,MC3,25,31-MAY-18... (3 Replies)
Discussion started by: Prabhakar Y
3 Replies

10. UNIX for Beginners Questions & Answers

Generate files and use csv data to replace multiple variables in a template

I have a source csv file consists of first field as variable name, and the rest are site-specific information (converted from excel file, where site -specific values in columns). I am trying to create a file for every site using a template and replace the multiple variables with values from the... (3 Replies)
Discussion started by: apalex
3 Replies
nissetup(8)						      System Manager's Manual						       nissetup(8)

NAME
nissetup, ypsetup - Sets up the Network Information Service (NIS) environment SYNOPSIS
/usr/sbin/nissetup /usr/sbin/ypsetup DESCRIPTION
The nissetup (formerly ypsetup) script configures and runs NIS on your system. You can use nissetup to initially set up your NIS configura- tion, to change your current NIS configuration, or to remove your NIS configuration. NIS provides a distributed data lookup service for sharing data among networked systems. Before running nissetup, make sure that your system is connected to a local area network and that the network is configured and running. You must know the name of your NIS domain and your system's role in the domain (master server, slave server, or client). Security Note You invoke nissetup from the SysMan Menu. See sysman(8) for more information. When using the nissetup script to set up a NIS server that is running with enhanced security, you must answer yes to the question about locking the domain name and authorized servers (the ypbind -S option). If you are setting up a master server, the server is bound to itself (done by default). If you are setting up a slave server, the server is bound to itself done by default) and optionally to the master server and any other slave servers. If your system will be the master server for your NIS domain, be sure no other master exists for your domain and that the NIS database files are in the /var/yp/src directory. Note Remove the root entry, if it exists, from the passwd database file. If your system be will be a slave server or client, be sure a master server is already set up for your NIS domain. FILES
Specifies the command pathname NIS parameters pertinent to a specific system Default NIS Databases In the /var/yp/src directory, the default databases are: Group database Host database Sendmail alias database Network group aliases data- base Network database Password database Protocol database RPC database Service database SEE ALSO
Commands: domainname(1), ypwhich(1), svcsetup(8), sysman(8), sysman_station(8), ypbind(8), yppasswdd(8), ypserv(8), ypxfr(8) Files: svc.conf(4) Networking: nis_intro(7), nis_manual_setup(7) Network Administration nissetup(8)
All times are GMT -4. The time now is 11:06 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy