Need to modify csv-file with bash script


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need to modify csv-file with bash script
# 8  
Old 02-12-2010
@Franklin52
I already saw that the fieldseparator was missing...

But, even if I use the fieldseparator, there's still the probleme which i tried to translate. It seems that there's a problem with the date syntax, or something like that.

BTW:
If I write this at the commandline

echo "1265911223 www.google.com"|awk '{str="date -d @"$1; print system(str)}'
this is the result
Code:
Do 11. Feb 19:00:23 CET 2010
0





@pludi

Hey pludi,

also an interesting way. But also in your example there's a problem modifying the date. If I try your code, the result is this

Code:
date: ungültiges Datum „@126364422;http://www.google.de/“

date: ungültiges Datum „@126364535;http://www.google.de/“

date: ungültiges Datum „@126364535;http://www.google.de/#hl=de&source=hp&q=unix+forum&btnG=Google-Suche&meta=&aq=f&oq=unix+forum&fp=749e75dee4f1c52f“

date: ungültiges Datum „@126364536;https://www.unix.com/“

date: ungültiges Datum „@126364538;https://www.unix.com/shell-programming-scripting/“

date: ungültiges Datum „@126364547;http://www.google.de/“

date: ungültiges Datum „@126364556;http://www.google.de/“

By the way. It seems that you know the firefox databases. Do you know where exactly the visit date is stored. I've searched a long time, but I didn't get the right answer. In my moz_places in places.sqlite is a value called last_visit_date. In your example, you used the visit_date from the moz_historyvisit table. Is there an difference between these two values? The problem is, that I didn't found any information about last_visit_date at all, but I found information about the value you used (visit_date in moz_historyvisit). If yours is the right one, I would prefer your way to extract the date and URL...
# 9  
Old 02-12-2010
Quote:
Originally Posted by Sebi0815
@Franklin52
I already saw that the fieldseparator was missing...

But, even if I use the fieldseparator, there's still the probleme which i tried to translate. It seems that there's a problem with the date syntax, or something like that.

BTW:
If I write this at the commandline

echo "1265911223 www.google.com"|awk '{str="date -d @"$1; print system(str)}'
this is the result
Code:
Do 11. Feb 19:00:23 CET 2010
0

Unfortunely I can't test it out at the moment without the GNU date....

I'll take a look again if you don't have the solution till tonight (EU).
# 10  
Old 02-12-2010
It's important to define a single space as a separator in SQLite, as that's the easiest way to use it with the while read-loop. If you need a different separator, add it in the echo instead.

And no, I don't really know the databases, I just used a table that seemed right. Better check if the values you get are/could be correct.
# 11  
Old 02-12-2010
@Franklin52

Hey Franklin,

thanks for your help. I found the mistake... In your post, there's a blank between @ "substr($10,1,10), so the timestamp did not stand right behind the @-Symbol... Again, thanks for your help... Smilie

@pludi

I also wanna thank you, maybe I can use your version somehow... Smilie
# 12  
Old 02-12-2010
Quote:
Originally Posted by Sebi0815
@Franklin52

Hey Franklin,

thanks for your help. I found the mistake... In your post, there's a blank between @ "substr($10,1,10), so the timestamp did not stand right behind the @-Symbol... Again, thanks for your help... Smilie
I couldn't test the command, but glad to know you get it working now. Smilie

Regards
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Sed, awk or another bash command to modify string with the content of another file

Hello everybody, I would like modify some strings using sed or another command line with the content file. For example: - {fqdn: "server-01" , ip: "server-01"} - {fqdn: "server-02" , ip: "server-02"} - {fqdn: "server-03" , ip: "server-03"} - {fqdn: "server-04" , ip: "server-04"} My... (4 Replies)
Discussion started by: dco
4 Replies

2. Shell Programming and Scripting

Modify csv-files with awk

Hello everyone! I have thousands of csv files I have to import into a Database table. As usually the files aren't perfect. For example they have a different number of columns and some weird columns. The second problem is, that I have to add 3 parts of the filename into 3 rows in the... (6 Replies)
Discussion started by: elRonaldo
6 Replies

3. Shell Programming and Scripting

Modify CSV file

Hi, I would like to change my CSV file by adding " and : and moving some of the information around. the CSV file looks as follows: 501254424;500440257;PE PACKS;300467279;PREP;;276476070;655031001867176;Two Block;Olga;25/12/2015 00:00:00;Olga I would like to move the field 7 to the front "... (13 Replies)
Discussion started by: omuhans123
13 Replies

4. Shell Programming and Scripting

Csv download in a bash script

I am attempting to download a url in csv format. When I download this url in a browser excel opens up and automatically populates with comma separated values. When I try to use curl or wget I get nothing or garbage. This on the command line just hangs wget -b... (2 Replies)
Discussion started by: bash_in_my_head
2 Replies

5. Shell Programming and Scripting

Perl script to modify csv file

Hi Friends, I want to convert a csv file into a ordinary .txt file. I am able to convert but I want the output to look as shown below in the .txt file table findhost= { {"xyz","abc"}, {"rxz","mmz"}, {"vrr","nnz"}, } default={"NONE"} My current perl script #!/usr/bin/env perl... (12 Replies)
Discussion started by: dbashyam
12 Replies

6. Shell Programming and Scripting

Bash script help - removing certain rows from .csv file

Hello Everyone, I am trying to find a way to take a .csv file with 7 columns and a ton of rows (over 600,000) and remove the entire row if the cell in forth column is blank. Just to give you a little background on why I am doing this (just in case there is an easier way), I am pulling... (3 Replies)
Discussion started by: MrTuxor
3 Replies

7. Shell Programming and Scripting

Calling Pl/sql function in shell script to modify csv

I need to 1.Open a csv 2.Process the csv i.e. Modify 2 column in the csv. To modify the column the value needs to be passed to a pl/sql function and the return value should be updated For eg: If column 2 E,then E will be passed in database function which will return Employee. 3. Write a... (5 Replies)
Discussion started by: Chinky23
5 Replies

8. Shell Programming and Scripting

Read data from .csv file through shell script & modify

I need to read data from a file called "test.csv" through shell script where the file contains values like name,price,descriptor etc. There are rows where descriptor (& in some rows name) are written as string & other characters like "car_+" OR "bike*" etc where it should contains strings like... (3 Replies)
Discussion started by: raj100
3 Replies

9. Shell Programming and Scripting

Bash script to reorder csv

hi guys, im fairly new to unix and bash scripts and therefore your help would really be appreciated. i need to write a bash script that will take a csv file, and reorder the data and output to another csv file. The source csv file will look something like this: HEAD,671061,Add,SS... (3 Replies)
Discussion started by: daz_20
3 Replies

10. Shell Programming and Scripting

Bash Script: modify bash

Hey guys, i'm having trouble complete one of my bash scripts I'm hoping to --- 1. Modify bash so that then the user types "ls" the command that is executed is "ls -al" 2. Modify the point of entry in bash when the user accesses it, moving the initial location to /var I've somewhat done #2,... (9 Replies)
Discussion started by: LibRid
9 Replies
Login or Register to Ask a Question