Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk with tsv & csv
Top Forums Shell Programming and Scripting awk with tsv & csv Post 302452328 by calitiggr on Friday 10th of September 2010 03:16:38 AM
Old 09-10-2010
Sorry! I'm a newbie.

Using script:
Code:
awk -F, '{print $1, ","$4}' in_bits.csv > out.csv

Sample input:
Code:
time,binary time,bytes,bits,accum,num packets,resolution 1.0
8/12/10 20:49,1281646165,24006,192048,24006,102,
8/12/10 20:49,1281646166,1752,14016,25758,22,
8/12/10 20:49,1281646167,494,3952,26252,8,

output after running script:
Code:
time ,bits

what I wanted:
Code:
time, bits
8/12/10 20:49,192048
8/12/10 20:49,14016
8/12/10 20:49,3952

Script:
Code:
awk -F"\t" '{print $1, "\t"$4, "\t"$4*8}' infile.tsv > out.tsv

Here's a sample input file.
Code:
time	binary time	bytes	accum	num packets	resolution 1.0
8/12/10 8:49 PM	1281646165	24006	24006	102	
8/12/10 8:49 PM	1281646166	1752	25758	22	
8/12/10 8:49 PM	1281646167	494	26252	8	
8/12/10 8:49 PM	1281646168	60	26312	1

script output:
Code:
time 	accum

what I wanted:
Code:
time   bytes     bytes
8/12/10 8:49 PM	124006  992048
8/12/10 8:49 PM	1752     14016
8/12/10 8:49 PM	494       3952
8/12/10 8:49 PM	60         480

then i wanted to take all values matching 8/12/10 and copy to another csv/tsv file

Hopefully this clarifies my problem Smilie



Moderator's Comments:
Mod Comment Please use code tags, thank you!
Last edited by Franklin52; 09-10-2010 at 04:35 AM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Converting csv to tsv and back

Anyone have a simple UNIX script to look at for doing this? I'm interested in how to convert from csv to tsv, and then back again, if I want to. Thanks! (13 Replies)
Discussion started by: doubleminus
13 Replies

2. Shell Programming and Scripting

creating & sending formatted (with bolds & colors) CSV

Hi , I have a situation. Need is to create & send a formatted file with header in BOLD & colored & some sequel results as a content. I know echo -e \033 command, but its scope is limited in PUTTY. How to retain the formatting out of Putty; say after someone opens a email attachment... (2 Replies)
Discussion started by: infaWorld
2 Replies

3. UNIX for Dummies Questions & Answers

tsv file comparison

Hi Guys, I have to write a script to compare the tsv files headers with the values stored in the variable in bash. I have declared variables as HEADER_VERSION="All Versions\tVersion Type\tVersion\tLevel" now file contains data as follows: All Versions Version Type Version Level... (0 Replies)
Discussion started by: Swapna173
0 Replies

4. Shell Programming and Scripting

pattern grep using Perl in .TSV file

Hi All, I have a .TSV extension file having ~1 Gig data and I need to grep a pattern in that file using perl. I am not able to read the file using perl any suggestions on this/ If I Change the format my data gets mismangled so I am bothered about using specific format as well. #!... (3 Replies)
Discussion started by: vmsenthil
3 Replies

5. Shell Programming and Scripting

CSV to SQL insert: Awk for strings with multiple lines in csv

Hi Fellows, I have been struggling to fix an issue in csv records to compose sql statements and have been really losing sleep over it. Here is the problem: I have csv files in the following pipe-delimited format: Column1|Column2|Column3|Column4|NEWLINE Address Type|some descriptive... (4 Replies)
Discussion started by: khayal
4 Replies

6. Shell Programming and Scripting

awk read column csv and search in other csv

hi, someone to know how can i read a specific column of csv file and search the value in other csv columns if exist the value in the second csv copy entire row with all field in a new csv file. i suppose that its possible using awk but i m not expertise thanks in advance (8 Replies)
Discussion started by: giankan
8 Replies

7. UNIX for Dummies Questions & Answers

Help with changing header of tsv with 30 million lines

Hi My 30 million line file has a header chr start end strand ref_context repeat_masked s1_smpl_context s1_c_count s1_ct_count s1_non_ct_count s1_m% s1_score s1_snp s1_indels s2_smpl_context s2_c_count s2_ct_count s2_non_ct_count s2_m% s2_score s2_snp s2_indels ... (2 Replies)
Discussion started by: plumb_r
2 Replies

8. Shell Programming and Scripting

Replacing FQDN by hostnames in a CSV file with sed & awk

Hello, Beginning with shell scipting, I'm trying to find in a csv file, the lines where the field related to hostname is displayed as an FQDN intead the hostname. (some lines are correct) and the to correct that inside the file: Novell,11.0,UNIX Server,bscpsiws02,TxffnX1tX1HiDoyBerrzWA==... (2 Replies)
Discussion started by: Wonto
2 Replies

9. Shell Programming and Scripting

Split each column in TSV file to be new line?

My TSV looks like: Hello my name is John \t Hello world \t Have a good day! \t See you later! Is there a simple bash script that splits the tsv on tab to: Hello my name is John Hello world Have a good day! See you later! I'm really stuck, would appreciate any help! (5 Replies)
Discussion started by: pxalpine
5 Replies

10. Shell Programming and Scripting

awk Help: quick and easy question may be: How to use &&

Hi Guru's. I am trying to use to check if $5 is greater than 80 & if not 100, then to print $0 : awk '{ if ($5>80) && if ($5 != 100) print $0} But getting error: >bdf1|sed 's/%//g'|awk '{ if ($5>80) && if ($5 != 100) print $0}' syntax error The source line is 1. The error... (6 Replies)
Discussion started by: rveri
6 Replies
All times are GMT -4. The time now is 01:55 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy