09-29-2011
Sort and join all .csv files
Hi ,
I have a dump of .csv files in a folder, I need to sort all files by the first 3 columns and merge them all in one big csv file.
I am using a cat command to join them, but how can i sort before appending all the files as one big file,
Regards,
Shruthi
9 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hello,
My apologies if this has been posted elsewhere, I have had a look at several threads but I am still confused how to use these functions. I have two files, each with 5 columns:
File A: (tab-delimited)
PDB CHAIN Start End Fragment
1avq A 171 176 awyfan
1avq A 172 177 wyfany
1c7k A 2 7... (3 Replies)
Discussion started by: InfoSeeker
3 Replies
2. Shell Programming and Scripting
I have a file and need to only select users that have a shell of “/bin/bash” in the line using awk or sed please help (4 Replies)
Discussion started by: boyboy1212
4 Replies
3. UNIX for Dummies Questions & Answers
file1:
Toronto:12439755:1076359:July 1, 1867:6
Quebec City:7560592:1542056:July 1, 1867:5
Halifax:938134:55284:July 1, 1867:4
Fredericton:751400:72908:July 1, 1867:3
Winnipeg:1170300:647797:July 15, 1870:7
Victoria:4168123:944735:July 20, 1871:10
Charlottetown:137900:5660:July 1, 1873:2... (2 Replies)
Discussion started by: mindfreak
2 Replies
4. UNIX for Dummies Questions & Answers
Hi,
I have 20 tab delimited text files that have a common column (column 1). The files are named GSM1.txt through GSM20.txt. Each file has 3 columns (2 other columns in addition to the first common column).
I want to write a script to join the files by the first common column so that in the... (5 Replies)
Discussion started by: evelibertine
5 Replies
5. Shell Programming and Scripting
Is it possible to join all the values after sorting them based on 1st column key and replace empty rows with 0 like below ?
input
a1 0 a1 1 a1 1 a3 1 b2 1
a2 1 a4 1 a2 1 a4 1 c4 1
a3 1 d1 1 a3 1 b1 1 d1 1
a4 1 c4 1 b2 1
b1 1
b2 1
c4 1
d1 1
output... (8 Replies)
Discussion started by: quincyjones
8 Replies
6. Shell Programming and Scripting
I have a file with two fields in it delimited by a comma. Some of the first fields are duplicates. I am trying to eliminate any duplicate records in the first field, and combine the second fields in the output file.
For example, if the input is:
Jane,group=A
Bob,group=A
Bob,group=D... (3 Replies)
Discussion started by: DJR
3 Replies
7. Shell Programming and Scripting
Hi,
I am trying to join 2 csv files, to create a 3rd output file with the joined data.
Below is an example of my Input Data:
Input File 1
NAME, FAV_FOOD, FAV_DRINK, ID, GENDER
Bob, Fish, Coke, 1, M
Lisa, Rice, Water, 2, F
Jenny, Noodle, Tea, 3, F
Ken, Pizza, Coffee, 4, M
Lisa,... (7 Replies)
Discussion started by: RichZR
7 Replies
8. Shell Programming and Scripting
Hi,
I'm an absolute beginner in shell programming.
I would need a script for a NAS that makes the csv files sorted by date and always monthly a zip.
In the current month, the data should be integrated into this folder, so there are only monthly files.
Thanks for your help (1 Reply)
Discussion started by: Pipo
1 Replies
9. Shell Programming and Scripting
Hello,
This post is already here but want to do this with another way
Merge multiples files with multiples duplicates keys by filling "NULL" the void columns for anothers joinning files
file1.csv:
1|abc
1|def
2|ghi
2|jkl
3|mno
3|pqr
file2.csv:
1|123|jojo
1|NULL|bibi... (2 Replies)
Discussion started by: yjacknewton
2 Replies
LEARN ABOUT DEBIAN
rec2csv
REC2CSV(1) User Commands REC2CSV(1)
NAME
rec2csv - rec to csv converter
SYNOPSIS
rec2csv [OPTIONS]... [REC_FILE]
DESCRIPTION
Convert rec data into csv data.
-t, --type=TYPE
record set to convert to csv; if this parameter is omitted then the default record set is used
-S, --sort=FIELD
sort the output by the specified field.
--help print a help message and exit.
--version
show version and exit.
AUTHOR
Written by Jose E. Marchesi.
REPORTING BUGS
Report bugs to: bug-recutils@gnu.org
GNU recutils home page: <http://www.gnu.org/software/recutils/>
General help using GNU software: <http://www.gnu.org/gethelp/>
COPYRIGHT
Copyright (C) 2010, 2011, 2012 Jose E. Marchesi. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.
SEE ALSO
The full documentation for rec2csv is maintained as a Texinfo manual. If the info and rec2csv programs are properly installed at your
site, the command
info rec2csv
should give you access to the complete manual.
rec2csv 1.4.93 January 2012 REC2CSV(1)