Sponsored Content
Top Forums Shell Programming and Scripting Merge *.csv files, each in separate sheets Post 302742465 by frhling on Tuesday 11th of December 2012 05:16:00 AM
Old 12-11-2012
Code:
#!/bin/bash
find /a/b  -name "*.log"  -mtime 0 -exec cat "{}" \; >> aa.log # finds all log files in a special path
grep -e XXX -e YYY aa.log | grep -v ZZZ | awk '{print $1 " " $2 ";" $3 ";" $9 ";" $11}' | cut -d ' ' -f3- <<<"$8" >> aa.csv # looks for XXX and YYY and ignores ZZZ, looks for fields: $1,.... and import then in aa.csv
sed -i '1iDate;Time;From;To' aa.csv # makes header as Date,Time,From,To echo "done."

as you see my headers are date, time, from, to. everyday it genereates new data based on this header with a new date.
I just want each date(each new generated sheet) be in one csv next to the yesterday generated sheet.

preferably not to use perl.

Moderator's Comments:
Mod Comment Please use code tags for code and data

Last edited by Scrutinizer; 12-11-2012 at 06:36 AM.. Reason: code tags
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Add multiple .csv files as sheets to an excel file in unix.

Hi, I am using Solaris 8. My script outputs 4 .csv files. Currently I am SFTPing the files and creating a new excel file with the 4 files as sheets. Can anyone suggest ways to do this in UNIX ? Thanks, David. (2 Replies)
Discussion started by: libin4u2000
2 Replies

2. Shell Programming and Scripting

How to create a CSV File by reading fields from separate files

SHELL SCRIPT Hi, I have 3 separate files within a folder. Every File contains data in a single column like File1 contains data mayank sushant dheeraj File2 contains DSA_AT MG_AT FLAT_09 File3 contains data 123123 232323 (2 Replies)
Discussion started by: mayanksargoch
2 Replies

3. Shell Programming and Scripting

Merge 2 csv files with awk

I have 2 files pipe delimted and want to merge them based on a key e.g file 1 123$aaa$yyy$zzz 345$xab$yzy$zyz 456$sss$ttt$foo 799$aaa$ggg$dee file 2 123$hhh 345$ddd 456$xxx 888$zzz so if the key is the first field, and the result should be the common key between file 1 and 2 (6 Replies)
Discussion started by: loloAix
6 Replies

4. Shell Programming and Scripting

Merge 2 CSV files using sed

Help in writing a script using sed which updates fileOne with the contents from fileTwo Example: Contents of fileOne 1,111111 2,897823 3,235473 4,222222 Contents of fileTwo 1,111111,A,1,2 4,222222,A,2,2 5,374632,A,3,2 6,374654,A,4,2 Final File should be: 1,111111,A,1,2... (9 Replies)
Discussion started by: NewToSed
9 Replies

5. Shell Programming and Scripting

create separate files from one excel file with multiple sheets

Hi, I have one requirement, create separate files (".csv") from one excel file(xlsx) with multiple sheets. These ".csv" files are my source files. So anybody please suggest me the process. Thanks in Advance. Regards, Harris (3 Replies)
Discussion started by: harris
3 Replies

6. Shell Programming and Scripting

Write two csv files into one excel with multiple sheets

I have requirement to write two CSV files to one single excel with multiple sheets. Data present in the two files should sit in excel as different sheets. How can we achieve this using shell script? 1.csv 2. csv 1,2,3,4 5,6,7,8 XXXXX YYYYY Res.excel 1.csv data... (1 Reply)
Discussion started by: duplicate
1 Replies

7. Shell Programming and Scripting

Merge CSV files

I have lot of csv file collected from script like below : Name of files (some examples) there are thousands of it: 192.168.0.123_251_18796_1433144473.csv 192.168.0.123_251_18796_1433144772.csv 192.168.0.123_251_18796_1433145073.csv 192.168.0.123_251_18796_1433145372.csvContent of each... (5 Replies)
Discussion started by: rk4k
5 Replies

8. UNIX for Dummies Questions & Answers

Merge two csv files using column name

Hi all, I have two separate csv files(comma delimited) file 1 and file 2. File 1 contains PAN,NAME,Salary AAAAA5467D,Raj,50000 AAFAC5467D,Ram,60000 BDCFA5677D,Kumar,90000 File 2 contains PAN,NAME,Dept,Salary ASDFG6756T,Karthik,ABC,450000 QWERT8765Y,JAX,CDR,780000... (5 Replies)
Discussion started by: Nivas
5 Replies

9. Programming

Perl script to merge cells in column1 which has same strings, for all sheets in a excel workbook

Perl script to merge cells ---------- Post updated at 12:59 AM ---------- Previous update was at 12:54 AM ---------- I am using below code to read files from a dir and print to excel. open(my $in, '<', $file) or die "Could not open file: $!"; my $rowCount = 0; my $colCount = 0;... (11 Replies)
Discussion started by: Jack_Bruce
11 Replies

10. UNIX for Beginners Questions & Answers

Merge the three csv files as one according to first coloumn.

I have three files with similar pattern i need to merge all the coloumns side by side from all three files according to the first coloumn example as shown below I mentioned 5 coloumns only in example but i have around 15 coloumns in each file. file1: Name,Samples,Error,95RT,90RT... (4 Replies)
Discussion started by: Raghuram717
4 Replies
INTLTOOL-MERGE(8)					      System Manager's Manual						 INTLTOOL-MERGE(8)

NAME
intltool-merge - merge translated strings into various types of file SYNOPSIS
intltool-merge [option]... PO_DIRECTORY FILENAME OUTPUT_FILE DESCRIPTION
Merge translated strings in po files in PO_DIRECTORY with the original application file FILENAME, and output the file OUTPUT_FILE contain- ing both original and localized strings. If FILENAME is an XML file, OUTPUT_FILE will contain repeated xml nodes, where each node contains one of the localized strings with "xml:lang" attribute. OPTIONS
Mode of operation -b --ba-style Merge files in bonobo-activation style, which is used for bonobo servers. -d --desktop-style Merge files in desktop style, which is similar to the Windows .ini file format. -k --keys-style Merge files in keys style, which is used for metadata. -o --oaf-style (OBSOLETE) Same as -b/--ba-style. -r --rfc822deb-style Merge files in RFC 822 style, which is usually used in Debian configuration files. --quoted-style Merge files in quoted string style, which just translates any strings within "". -x --xml-style Merge files in standard XML style, both as attributes and as raw pcdata. Other options -u --utf8 Convert all strings to UTF-8 before merging. -p --pass-through Use strings as is in .po files without conversion (STRONGLY unrecommended with -x). -c --cache (TBD) -q --quiet Be quiet while running. -v --version Show version information. -h --help Show usage and basic help information. FILES
po/.intltool-merge-cache Cache file generated by intltool-merge, that contains all strings in all po files separated by 1. REPORTING BUGS
Report bugs to http://bugs.launchpad.net/intltool AUTHOR
Darin Adler <darin@bentspoon.com> Kenneth Christiansen <kenneth@gnu.org> Maciej Stachowiak <mjs@eazel.com> SEE ALSO
iconv(1), intltoolize(8), intltool-prepare(8), intltool-extract(8), intltool-update(8) intltool 2003-08-02 INTLTOOL-MERGE(8)
All times are GMT -4. The time now is 08:02 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy