09-29-2011
Sort and join all .csv files
Hi ,
I have a dump of .csv files in a folder, I need to sort all files by the first 3 columns and merge them all in one big csv file.
I am using a cat command to join them, but how can i sort before appending all the files as one big file,
Regards,
Shruthi
9 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hello,
My apologies if this has been posted elsewhere, I have had a look at several threads but I am still confused how to use these functions. I have two files, each with 5 columns:
File A: (tab-delimited)
PDB CHAIN Start End Fragment
1avq A 171 176 awyfan
1avq A 172 177 wyfany
1c7k A 2 7... (3 Replies)
Discussion started by: InfoSeeker
3 Replies
2. Shell Programming and Scripting
I have a file and need to only select users that have a shell of “/bin/bash” in the line using awk or sed please help (4 Replies)
Discussion started by: boyboy1212
4 Replies
3. UNIX for Dummies Questions & Answers
file1:
Toronto:12439755:1076359:July 1, 1867:6
Quebec City:7560592:1542056:July 1, 1867:5
Halifax:938134:55284:July 1, 1867:4
Fredericton:751400:72908:July 1, 1867:3
Winnipeg:1170300:647797:July 15, 1870:7
Victoria:4168123:944735:July 20, 1871:10
Charlottetown:137900:5660:July 1, 1873:2... (2 Replies)
Discussion started by: mindfreak
2 Replies
4. UNIX for Dummies Questions & Answers
Hi,
I have 20 tab delimited text files that have a common column (column 1). The files are named GSM1.txt through GSM20.txt. Each file has 3 columns (2 other columns in addition to the first common column).
I want to write a script to join the files by the first common column so that in the... (5 Replies)
Discussion started by: evelibertine
5 Replies
5. Shell Programming and Scripting
Is it possible to join all the values after sorting them based on 1st column key and replace empty rows with 0 like below ?
input
a1 0 a1 1 a1 1 a3 1 b2 1
a2 1 a4 1 a2 1 a4 1 c4 1
a3 1 d1 1 a3 1 b1 1 d1 1
a4 1 c4 1 b2 1
b1 1
b2 1
c4 1
d1 1
output... (8 Replies)
Discussion started by: quincyjones
8 Replies
6. Shell Programming and Scripting
I have a file with two fields in it delimited by a comma. Some of the first fields are duplicates. I am trying to eliminate any duplicate records in the first field, and combine the second fields in the output file.
For example, if the input is:
Jane,group=A
Bob,group=A
Bob,group=D... (3 Replies)
Discussion started by: DJR
3 Replies
7. Shell Programming and Scripting
Hi,
I am trying to join 2 csv files, to create a 3rd output file with the joined data.
Below is an example of my Input Data:
Input File 1
NAME, FAV_FOOD, FAV_DRINK, ID, GENDER
Bob, Fish, Coke, 1, M
Lisa, Rice, Water, 2, F
Jenny, Noodle, Tea, 3, F
Ken, Pizza, Coffee, 4, M
Lisa,... (7 Replies)
Discussion started by: RichZR
7 Replies
8. Shell Programming and Scripting
Hi,
I'm an absolute beginner in shell programming.
I would need a script for a NAS that makes the csv files sorted by date and always monthly a zip.
In the current month, the data should be integrated into this folder, so there are only monthly files.
Thanks for your help (1 Reply)
Discussion started by: Pipo
1 Replies
9. Shell Programming and Scripting
Hello,
This post is already here but want to do this with another way
Merge multiples files with multiples duplicates keys by filling "NULL" the void columns for anothers joinning files
file1.csv:
1|abc
1|def
2|ghi
2|jkl
3|mno
3|pqr
file2.csv:
1|123|jojo
1|NULL|bibi... (2 Replies)
Discussion started by: yjacknewton
2 Replies
LEARN ABOUT DEBIAN
oggz-merge
oggz-merge(1) General Commands Manual oggz-merge(1)
NAME
oggz-merge -- Merge Ogg files together, interleaving pages in order of presentation time.
SYNOPSIS
oggz-merge [-o filename | --output filename ] filename ...
oggz-merge [-h | --help ] [-v | --version ]
Description
oggz-merge merges Ogg files together, interleaving pages in order of presentation time. It correctly interprets the granulepos timestamps
of Ogg CELT, CMML, Dirac, FLAC, Kate, PCM, Speex, Theora and Vorbis bitstreams. Run oggz-known-codecs(1) for a full list of codecs known
by the installed version of oggz.
For example, if you have an Ogg Theora video file, and its soundtrack stored separately as an Ogg Speex audio file, and you can use oggz-
merge to create a single Ogg file containing the video and audio, interleaved together in parallel.
Similarly, using oggz-merge on a collection of Ogg Vorbis audio files will create a big Ogg file with all the songs in parallel, ie. inter-
leaved for simultaneous playback. Such a file is proper Ogg, but not "Ogg Vorbis I" -- the Ogg Vorbis I specification defines an Ogg Vorbis
file as an Ogg file containing only one Vorbis track at a time (ie. no parallel multiplexing). Many music players (which use libvorbisfile)
aren't designed to play multitrack Ogg files. In general however, video players, and anything built on a multimedia framework (like
GStreamer, DirectShow etc.) will probably be able to handle such files.
If you want to create a file containing some Ogg files sequenced one after another, then you should simply concatenate them together using
cat. In Ogg this is called "chaining". If you cat Ogg Vorbis I audio files together, then the result will also be a compliant Ogg Vorbis
file.
Options
oggz-merge accepts the following options:
Miscellaneous options
-o filename, --output filename
Write output to the specified filename instead of printing it to standard output.
-h, --help
Display usage information and exit.
-v, --version
Output version information and exit.
EXAMPLES
Merge pages of audio.oga and video.ogv:
oggz merge -o output.ogv audio.oga video.ogv
AUTHOR
Conrad Parker September 21, 2004;
COPYRIGHT
Copyright (C) 2004 CSIRO Australia
SEE ALSO
cat(1), oggz-rip(1), oggz-dump(1), oggz-diff(1), hogg(1)
oggz-merge(1)