Sponsored Content
Top Forums Shell Programming and Scripting Read multiple text files and copy data to csv Post 302969960 by lp.descamps on Wednesday 30th of March 2016 03:45:26 PM
Old 03-30-2016
the final idea is
i have 12 millions call recorded files. each file got a header with details of the call. files are in folders. for example, a file created at 20hr25min36sec on the 2nd of march 2010 will be in d:\2010\03\02\202536.55254.audio

i m hoping to run awk to find details like caller/called/date and create a csv file for my 12 millions files.

once i got the csv, i will need to categories the calls per department then copy files per department to a specific folder

thanks for reading
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read the data from multiple files and sum the value

Hi all, I have a requirement where i have to read multiple files using Shell Script in Korn Shell. each file will have the 3rd line as the amount field, i have to read this amount field and sum it for all the files. any idea on how to achieve this?? (i think i can achieve it using a loop,... (9 Replies)
Discussion started by: nvuradi
9 Replies

2. Shell Programming and Scripting

Combine Multiple text or csv files column-wise

Hi All I am trying to combine columns from multiple text files into a single file using paste command but the record length being unequal in the different files the data is running over to the closest empty cell on the left. Please see below. What can i do to resolve this ? File 1 File... (15 Replies)
Discussion started by: venky_ibm
15 Replies

3. Shell Programming and Scripting

Read multiple files, parse data and append to a file

Hi..Can anyone suggest a simple way of achieving this. I have several files which ends with extension .vcf . I will give example with two files In the below files, we are interested in File 1: 38 107 C 3 T 6 C/T 38 241 C 4 T 5 C/T 38 247 T 4 C 5 T/C 38 259 T 3 C 6 T/C... (8 Replies)
Discussion started by: empyrean
8 Replies

4. UNIX for Dummies Questions & Answers

Need help combining txt files w/ multiple lines into csv single cell - also need data merge

:confused:Hello -- i just joined the forums. I am a complete noob -- only about 1 week into learning how to program anything... and starting with linux. I am working in Linux terminal. I have a folder with a bunch of txt files. Each file has several lines of html code. I want to combine... (2 Replies)
Discussion started by: jetsetter
2 Replies

5. Shell Programming and Scripting

Extracting data from specific rows and columns from multiple csv files

I have a series of csv files in the following format eg file1 Experiment Name,XYZ_07/28/15, Specimen Name,Specimen_001, Tube Name, Control, Record Date,7/28/2015 14:50, $OP,XYZYZ, GUID,abc, Population,#Events,%Parent All Events,10500, P1,10071,95.9 Early Apoptosis,1113,11.1 Late... (6 Replies)
Discussion started by: pawannoel
6 Replies

6. UNIX for Beginners Questions & Answers

awk GSUB read field values from multiple text files

My program run without error. The problem I am having. The program isn't outputting field values with the column headers to file.txt. Each of the column headers in file.txt has no data. MEMSIZE SECOND SASFoundation Filename The output results in file.txt should show: ... (1 Reply)
Discussion started by: dellanicholson
1 Replies

7. Shell Programming and Scripting

Read csv file, convert the data and make one text file in UNIX shell scripting

I have input data looks like this which is a part of a csv file 7,1265,76548,"0102:04" 8,1266,76545,"0112:04" I need to make the output data should look like this and the output data will be part of text file: 7|1265000 |7654899 |A| 8|12660000 |76545999 |B| The logic behind the... (6 Replies)
Discussion started by: RJG
6 Replies

8. Shell Programming and Scripting

In PErl script: need to read the data one file and generate multiple files based on the data

We have the data looks like below in a log file. I want to generat files based on the string between two hash(#) symbol like below Source: #ext1#test1.tale2 drop #ext1#test11.tale21 drop #ext1#test123.tale21 drop #ext2#test1.tale21 drop #ext2#test12.tale21 drop #ext3#test11.tale21 drop... (5 Replies)
Discussion started by: Sanjeev G
5 Replies

9. UNIX for Beginners Questions & Answers

Copy data at specified location from multiple files

Hello everyone, Im super new to coding but increasingly in need of it at work. Im have task stacked because of this problems, that I cannot figure out how to solve looking on the internet after trying many many things that looked similar to me. I have multiple data files of the form (see below).... (2 Replies)
Discussion started by: Xfiles_fan
2 Replies

10. UNIX for Beginners Questions & Answers

Generate files and use csv data to replace multiple variables in a template

I have a source csv file consists of first field as variable name, and the rest are site-specific information (converted from excel file, where site -specific values in columns). I am trying to create a file for every site using a template and replace the multiple variables with values from the... (3 Replies)
Discussion started by: apalex
3 Replies
fadecut(1)						      General Commands Manual							fadecut(1)

NAME
fadecut - Toolset to rip audiostreams, cut, fade in/out and tag the resulting audiofiles SYNOPSIS
fadecut -p <profile> [ OPTIONS ] DESCRIPTION
fadecut is a script to rip audio files from a livestream (using streamripper) and to process them automatically. Beginning and ending fo the audio files will be cut and faded in/out. So logos and advertising of radio stations will be automatically removed. In streaming mode fadecut is ripping audio files using streamripper. The downloaded audio files are cutted using silence detection and then faded in and out. Subsequently, the files are encoded to either ogg or mp3 and tagged with tags (title, artist, genre and comment pro- vided). In file mode fadecut is just processing already ripped audio files. An audio file which has already been processed is detected and will not be processed again. Not desired songs can be stored in a separate directory. This files are not processed anymore too. FOLDERS
fadecut is working with some standard folders. You may change them in your profile or fadecutrc done/ here you put all your songs which were already processed by fadecut and which you want to keep. See also new/ folder. dontlike/ in this folder you may put songs which you don't like. Fadecut is checking this folder before it is processing new files in the working folder. Null size files are ok. error/ whenever an error occurs while fadecut is processing a file, that file is moved to the error folder for later examining. incomplete/ this folder is created by streamripper. All not fully ripped songs are saved here. new/ processed songs are going here. Usually you may rip and process files with fadecut, they are going in to new/ folder, you listen to them and put good songs to the done/ folder. orig/ if you want to keep the original file (which is ripped by streamripper), you may use the -k option. fadecut is putting the ripped files untouched into that folder. OPTIONS
-c Create a new profile <profilename> -e Edit an existing profile <profilename> -i optional input <directory> -o optional output <directory> -k optional to keep the untouched original song in the /orig folder -d Debug: -d 0|1|2|3 (level 0 is standard, -d without number is like 1) -h Show this message -p Profile <profilename> -q Quiet -r Stream (and rip), start streamripper -v Verbose VARIABLES
STREAM_URL="http://streamurl" test ENCODING=ogg preferred destination fileformat. (ogg/mp3) GENRE="SwissPop" Processed files will get the above genre. COMMENT="Radio Swiss Pop" Processed files will get the above comment. TRIM_BEGIN=0 cut <n> seconds off the file in the beginning. TRIM_END=0 cut <n> seconds off the file at the end. FADE_IN=1 Fade in for <n> seconds. FADE_OUT=4 Fade out for <n> seconds. EXAMPLES
Create a new ripping profile fadecut -c test Edit/update profile test fadecut -e test Rip, cut and fade in-/out with profile test fadecut -p test -r Only cut and fade in-/out without ripping from livestream fadecut -p test SEE ALSO
id3v2(1), oggenc(1), sox(1), streamripper(1), lame(1) FILES
~/.fadecut/fadecutrc The main fadecut configuration file, executed with every start of fadecut ~/.fadecut/statslog.csv The statistics file ~/.fadecut/profiles The folder where all profiles are located RESOURCES
fadecut git website https://github.com/micressor/fadecut 0.1.0 fadecut(1)
All times are GMT -4. The time now is 11:30 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy