Updating a line in a large csv file, with sed/awk?
I have an extremely large csv file that I need to search the second field, and upon matches update the last field...
I can pull the line with awk.. but apparently you cant use awk to directly update the file? So im curious if I can use sed to do this... The good news is the field I want to update is the last field, so I can just do a right to left search for "," and update to the right.
anyways, the details.
Code:
...
field1,X.X.X.X,feild3,...,field13
field1,X.X.X.X,feild3,...,field13
field1,X.X.X.X,feild3,...,field14 <This is the field I need to change
field1,X.X.X.X,feild3,...,field13
field1,X.X.X.X,feild3,...,field13
field1,X.X.X.X,feild3,...,field13
field1,X.X.X.X,feild3,...,field13
field1,X.X.X.X,feild3,...,field13
field1,X.X.X.X,feild3,...,field13
...
Hello,
I read and search through this wonderful forum and tried different approaches but it seems I lack some knowledge and neurones ^^
Here is what I'm trying to achieve :
file1:
test filea 3495;
test fileb 4578;
test filec 7689;
test filey 9978;
test filez 12300;
file2:
test filea... (11 Replies)
I have a large CSV files (e.g. 2 million records) and am hoping to do one of two things. I have been trying to use awk and sed but am a newbie and can't figure out how to get it to work. Any help you could offer would be greatly appreciated - I'm stuck trying to remove the colon and wildcards in... (6 Replies)
I get a CSV file every day with 2 columns and multiple rows
ex:
date1,date2 ( both the fields are varchar fields)
This data has to be updated in a table which is being done manually and i want to automate that.
1. I have to select all the data from the prod table( 2 columns { date1,date2}) into... (4 Replies)
Hello guys,
I have one .csv file with all the file names(.c,.h,.sm,.txt etc).....
Now i have compared two baseline in UCM and got a report in .txt file,which looks like this......
DIFFBL INT_1029_Rel6.0.0.90@\DIR_PVOB STD_6.0.0.50_UCM@\DIR_PVOB (COMPONENT TEXT)
Comparing the following:
... (14 Replies)
Hi,
I have a filename.csv in which there are 3 colums, ie:
Name ; prefixnumber ; number
root ; 020 ; 1234567
user1,2,3 ; 070 ; 7654321
What I want is to merge colum 2 and 3 that it becomes 0201234567 or even better +31201234567 so the country number is used and drop the leading 0.... (9 Replies)
Hello folks
I have a txt file of information about journal articles from different fields. I need to convert this information into a format that is easier for computers to manipulate for some research that I'm doing on how articles are cited. The file has some header information and then details... (8 Replies)
Hi All,
I have a very large single record file.
abc;date||bcd;efg|......... pqr;stu||record_count;date
when i do wc -l on this file it gives me "0" records, coz of missing line feed.
my problem is there is an extra pipe that is coming at the end of this record
like... (6 Replies)
I have a script that builds a database ~30 million lines, ~3.7 GB .cvs file. After multiple optimzations It takes about 62 min to bring in and parse all the files and used to take 10 min to remove duplicates until I was requested to add another column. I am using the highly optimized awk code:
awk... (34 Replies)
Dear Users,
Appreciate your help if you could help me with splitting a large file > 1 million lines with sed or awk. below is the text in the file
input file.txt
scaffold1 928 929 C/T +
scaffold1 942 943 G/C +
scaffold1 959 960 C/T +... (6 Replies)
Discussion started by: kapr0001
6 Replies
LEARN ABOUT PHP
yaz_sort
YAZ_SORT(3) 1 YAZ_SORT(3)yaz_sort - Sets sorting criteriaSYNOPSIS
void yaz_sort (resource $id, string $criteria)
DESCRIPTION
This function sets sorting criteria and enables Z39.50 Sort.
Call this function beforeyaz_search(3). Using this function alone does not have any effect. When used in conjunction with yaz_search(3), a
Z39.50 Sort will be sent after a search response has been received and before any records are retrieved with Z39.50 Present
(yaz_present(3).
PARAMETERS
o $id
- The connection resource returned by yaz_connect(3).
o $criteria
- A string that takes the form field1 flags1 field2 flags2 where field1 specifies the primary attributes for sort, field2 seconds,
etc.. The field specifies either a numerical attribute combinations consisting of type=value pairs separated by comma (e.g.
1=4,2=1) ; or the field may specify a plain string criteria (e.g. title. The flags is a sequence of the following characters
which may not be separated by any white space.
Sort Flags
o a - Sort ascending
o d - Sort descending
o i - Case insensitive sorting
o s - Case sensitive sorting
RETURN VALUES
No value is returned.
EXAMPLES
Example #1
Sort Criterias
To sort on Bib1 attribute title, case insensitive, and ascending you would use the following sort criteria:
1=4 ia
If the secondary sorting criteria should be author, case sensitive and ascending you would use:
1=4 ia 1=1003 sa
PHP Documentation Group YAZ_SORT(3)
09-17-2009
