this is my very first comment on this forum and i hope i don't mess it up. If i do, please forgive me (also for any language mistakes you may wanna know that i'm not native speaking).
As i just started doing a bigger paper for my studies i got a bunch of data in seperate csv-files which i'll have to analyze. Unfortunately the data logger messed up the naming for most of the files, so i have to fix that first in order to have a consistent naming. So i figured i'll write a little bash program for that. Here's roughly what i got so far:
Code:
#!/bin/bash
filelist="SP*"
echo "filenames" > filenames.dat
for file in $filelist
do
temp=$(head -1 $file)
# echo "$temp" >> filenames.dat
cp $file $temp
done
So what i'm doing is finding all files that have the string "SP" in it and add them to the list "filelist". Then i consecutively go through that list, open the file and save the first line in the variable "temp" (the correct name of the files is saved in that first line). Then i copy the files using the variable "temp" as new name.
Theoretically the first line consists of two tokens seperated by a semicolon (so two columns since csv-file), whereas i only need the first. But that's just an extra i don't necessarily need to work. The first line would be okay, too.
As i thought it should work but did not ("Argument too long") i took a closer look to what actually happens. Apparently the head command doesn't work properly, so what i really does is saving the whole file (so including all the numbers also) in the variable "temp". If i then use that variable to create/copy my file the command is too long for the shell (actually the file consists of about 500 000 lines :-) ). So apparently the "head -1" doesn't work, but i don't know why. "head -n 1" didn't work either.
I have no idea what's going on and i don't know what i could change.
Can anybody help me out here and give me a piece of advice (i'd appreciate it if the advice was actually concerning this topic of course :-) ).
Hi ,
I have a CSV file ( file.csv) with some data as
below:
A,1,abc,x,y,z,,xyz,20100101,99991231
A,1,abc,x,y,z,234,xyz,20100101,99991231
I have to delete the duplicate line based on
unique identifiers which are values in the
fields- 2,3,4,8.These coulmns in both the rows
have same... (6 Replies)
SHELL SCRIPT
Hi,
I have a file in which contents are as follows:
9999,abdc,123
9988,aba_12,2323
and so on
I want to read the contents of this file such that i can do
echo "This is $a followed by $b an then $c"
I tried the following but id did not work
cat test | cut -d ',' -f1|... (7 Replies)
Need UNIX script read below .csv file and print the line only records where type = TRN.
Srno,Type,InputFileName,NewColumnData
1,TRN,File1.dat,11
2,TRN,File2.dat,12
3,TRN,File3.dat,13
4,REF,File4.dat,
5,REF,File5.dat,
regards,
santosh (4 Replies)
Friends,
This is what I need:
I will pass a CSV file as an input, and I want my shell to be reading that CSV file, and based on the parameters it should generate SQLs and write those SQL in a different file in the same location.
I'm new to Shell scripting. I'm currently working on a... (1 Reply)
Folks,
how do i skip the first line in a csv, while doing the read of a csv file in to a variable line by line.
eg :
do
echo $line
done < $rpt
where rpt is path to csv file
The initial 1st line is a garbage that i want to avoid, and start reading from 2nd line
... (2 Replies)
Hello All,
i am a newbie and need some help when reading a csv file in a bourne shell script. I want to read 10 lines, then wait for a minute and then do a reading of another 10 lines and so on in the same way. I want to do this till the end of file.
Any inputs are appreciated
... (3 Replies)
how to I use IFS to read 2 files (csv) and run the followiung script
./naviseccli -h 1.2.3.4 storagegroup -addhlu -gname $hostname -hlu $hlu_num -alu $alu_num
the csv file for $hostname is
host1
host2
.
.
.
for hlu and alu
its
alu,hlu (2 Replies)
Hi,
I am facing a problem regarding .csv file, my script does not read .csv file and if i open this file in vi editor and perform :wq option then only my script reads the .csv file.
Thanks (5 Replies)
I have input data looks like this which is a part of a csv file
7,1265,76548,"0102:04"
8,1266,76545,"0112:04"
I need to make the output data should look like this and the output data will be part of text file:
7|1265000 |7654899 |A|
8|12660000 |76545999 |B|
The logic behind the... (6 Replies)
Discussion started by: RJG
6 Replies
LEARN ABOUT DEBIAN
ifpps
ifpps(8) netsniff-ng-toolkit ifpps(8)NAME
ifpps - fetch and format kernel network statistics
SYNOPSIS
ifpps -d|--dev <netdev> [-t|--interval <sec>][-p|--promisc][-c|--term]
[-C|--csv][-H|--csv-tablehead][-l|--loop][-v|--version][-h|--help]
DESCRIPTION
A tiny tool to provide top-like reliable networking statistics. ifpps reads out the 'real' kernel statistics, so it does not give
erroneous statistics on high I/O load.
OPTIONS
ifpps --dev eth0
Fetch eth0 interface statistics.
ifpps --dev eth0 --interval 60 --csv
Output eth0 interface statistics every minute in CSV format.
OPTIONS
-h|--help
Print help text and lists all options.
-v|--version
Print version.
-d|--dev <netdev>
Device to fetch statistics for i.e., eth0.
-p|--promisc
Put the device in promiscuous mode
-t|--interval <time>
Refresh time in sec (default 1 sec)
-c|--term
Output to terminal
-C|--csv
Output in CSV format. E.g. post-processing with Gnuplot et al.
-H|--csv-tablehead
Print CSV table head.
-l|--loop
Loop terminal output.
AUTHOR
Written by Daniel Borkmann <daniel@netsniff-ng.org>
DOCUMENTATION
Documentation by Emmanuel Roullit <emmanuel@netsniff-ng.org>
BUGS
Please report bugs to <bugs@netsniff-ng.org>
2012-06-29 ifpps(8)