Sponsored Content
Full Discussion: Merge 2 CSV files using sed
Top Forums Shell Programming and Scripting Merge 2 CSV files using sed Post 302515124 by NewToSed on Tuesday 19th of April 2011 06:23:09 AM
Old 04-19-2011
Merge 2 CSV files using sed

Help in writing a script using sed which updates fileOne with the contents from fileTwo

Example:
Contents of fileOne
Code:
1,111111
2,897823
3,235473
4,222222

Contents of fileTwo
Code:
1,111111,A,1,2
4,222222,A,2,2
5,374632,A,3,2
6,374654,A,4,2

Final File should be:
Code:
1,111111,A,1,2
2,897823
3,235473
4,222222,A,2,2
5,374632,A,3,2
6,374654,A,4,2

Thanks in advance...
Moderator's Comments:
Mod Comment
Please use code tags when posting data and code samples!

Last edited by vgersh99; 04-19-2011 at 07:30 AM.. Reason: code tags, please!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merge 2 csv files with awk

I have 2 files pipe delimted and want to merge them based on a key e.g file 1 123$aaa$yyy$zzz 345$xab$yzy$zyz 456$sss$ttt$foo 799$aaa$ggg$dee file 2 123$hhh 345$ddd 456$xxx 888$zzz so if the key is the first field, and the result should be the common key between file 1 and 2 (6 Replies)
Discussion started by: loloAix
6 Replies

2. Shell Programming and Scripting

Merge CSV files and create a column with the filename from the original file

Hello everyone!! I am not completely new to shell script but I havent been able to find the answer to my problem and I'm sure there are some smart brains here up for the challenge :D. I have several CSV files that I need to combine into one, but I also need to know where each row came from.... (7 Replies)
Discussion started by: fransanchezoria
7 Replies

3. Shell Programming and Scripting

Merge *.csv files, each in separate sheets

Does anyone know how to Merge *.csv files, each in seperate sheets? (7 Replies)
Discussion started by: frhling
7 Replies

4. UNIX for Dummies Questions & Answers

Need help combining txt files w/ multiple lines into csv single cell - also need data merge

:confused:Hello -- i just joined the forums. I am a complete noob -- only about 1 week into learning how to program anything... and starting with linux. I am working in Linux terminal. I have a folder with a bunch of txt files. Each file has several lines of html code. I want to combine... (2 Replies)
Discussion started by: jetsetter
2 Replies

5. Shell Programming and Scripting

Merge 2 last columns in a csv file using sed or perl

Hello everyone, want to merge 2 last columns 3rd and 4rd (if it exists). I have this 1;2;1;1 2;3;1;1 1;1;2 1;2;3;4 1;1;2 1;2;3;1 Desired output: 1;2;1 1 2;3;1 1 1;1;2 1;2;3 4 1;1;2 1;2;3 1 (3 Replies)
Discussion started by: satir
3 Replies

6. Shell Programming and Scripting

Merge CSV files

I have lot of csv file collected from script like below : Name of files (some examples) there are thousands of it: 192.168.0.123_251_18796_1433144473.csv 192.168.0.123_251_18796_1433144772.csv 192.168.0.123_251_18796_1433145073.csv 192.168.0.123_251_18796_1433145372.csvContent of each... (5 Replies)
Discussion started by: rk4k
5 Replies

7. UNIX for Dummies Questions & Answers

Merge two csv files using column name

Hi all, I have two separate csv files(comma delimited) file 1 and file 2. File 1 contains PAN,NAME,Salary AAAAA5467D,Raj,50000 AAFAC5467D,Ram,60000 BDCFA5677D,Kumar,90000 File 2 contains PAN,NAME,Dept,Salary ASDFG6756T,Karthik,ABC,450000 QWERT8765Y,JAX,CDR,780000... (5 Replies)
Discussion started by: Nivas
5 Replies

8. Shell Programming and Scripting

I am trying to merge all csv files from source path into 1 file

I am trying to merge all csv files from source path into one single csv file in target. but getting error message: hadoop fs -cat /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/TCH-charge_*.csv > /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/final/TCH_pb_charge.csv getting error message:... (0 Replies)
Discussion started by: cplusplus1
0 Replies

9. Shell Programming and Scripting

Compare and merge two big CSV files

Hi all, i need help. I have two csv files with a huge amount of data. I need the first column of the first file, to be compared with the data of the second, to have at the end a file with the data not present in the second file. Example File1: (only one column) profile_id 57036226... (11 Replies)
Discussion started by: SirMannu
11 Replies

10. UNIX for Beginners Questions & Answers

Merge the three csv files as one according to first coloumn.

I have three files with similar pattern i need to merge all the coloumns side by side from all three files according to the first coloumn example as shown below I mentioned 5 coloumns only in example but i have around 15 coloumns in each file. file1: Name,Samples,Error,95RT,90RT... (4 Replies)
Discussion started by: Raghuram717
4 Replies
sed(1)							      General Commands Manual							    sed(1)

Name
       sed - stream text editor

Syntax
       sed [-n] [-e script] [-f sfile] [file...]

Description
       The  command  copies  the  named  files	(standard input default) to the standard output, edited according to a script of commands.  The -f
       option causes the script to be taken from file sfile; these options accumulate.	If there is just one -e option and no -f's,  the  flag	-e
       may  be omitted.  The -n option suppresses the default output; inclusion in the script of a comment command of the form also suppresses the
       default output.	(See the description of the `#' command.)

       A script consists of editing commands of the following form:

	      [address [, address] ] function [arguments]

       Nominally, there is one command per line; but commands can be concatenated on a line by being separated with semicolons

       In normal operation cyclically copies a line of input into a pattern space (unless there is something left after a `D' command), applies in
       sequence all commands whose addresses select that pattern space, and at the end of the script copies the pattern space to the standard out-
       put (except under -n) and deletes the pattern space.

       An address is either a decimal number that counts input lines cumulatively across files, a `$' that addresses the last line of input, or  a
       context address, `/regular expression/', in the style of ed(1) modified thus:

	  o    In  a  context  address, the construction ?regular expression?, where ? is any character, is identical to regular expression. Note
	       that in the context address xabcxdefx, the second x stands for itself, so that the regular expression is abcxdef.

	  o    The escape sequence `
' matches a new line embedded in the pattern space.

	  o    A command line with no addresses selects every pattern space.

	  o    A command line with one address selects each pattern space that matches the address.

	  o    A command line with two addresses selects the inclusive range from the first pattern space that matches the first  address  through
	       the  next  pattern  space  that matches the second.  (If the second address is a number less than or equal to the line number first
	       selected, only one line is selected.)  Thereafter the process is repeated, looking again for the first address.

       Editing commands can be applied only to non-selected pattern spaces by use of the negation function `!' (below).

       In the following list of functions the maximum number of permissible addresses for each function is indicated in parentheses.

       An argument denoted text consists of one or more lines, all but the last of which end with `' to hide the new line.  Backslashes  in  text
       are  treated  like  backslashes in the replacement string of an `s' command, and may be used to protect initial blanks and tabs against the
       stripping that is done on every script line.

       An argument denoted rfile or wfile must terminate the command line and must be preceded by exactly one blank.  Each wfile is created before
       processing begins.  There can be at most 10 distinct wfile arguments.

       (1)a
       text
	       Append.	Place text on the output before reading the next input line.

       (2)b label
	       Branch to the `:' command bearing the label.  If label is empty, branch to the end of the script.

       (2)c
       text
	       Change.	 Delete  the  pattern space.  With 0 or 1 address or at the end of a 2-address range, place text on the output.  Start the
	       next cycle.

       (2)d    Delete the pattern space.  Start the next cycle.

       (2)D    Delete the initial segment of the pattern space through the first new line.  Start the next cycle.

       (2)g    Replace the contents of the pattern space by the contents of the hold space.

       (2)G    Append the contents of the hold space to the pattern space.

       (2)h    Replace the contents of the hold space by the contents of the pattern space.

       (2)H    Append the contents of the pattern space to the hold space.

       (1)i
       text
	       Insert.	Place text on the standard output.

       (2)n    Copy the pattern space to the standard output.  Replace the pattern space with the next line of input.

       (2)N    Append the next line of input to the pattern space with an embedded new line.  (The current line number changes.)

       (2)p    Print.  Copy the pattern space to the standard output.

       (2)P    Copy the initial segment of the pattern space through the first new line to the standard output.

       (1)q    Quit.  Branch to the end of the script.	Do not start a new cycle.

       (2)r rfile
	       Read the contents of rfile.  Place them on the output before reading the next input line.

       (2)s/regular expression/replacement/flags
	       Substitute the replacement string for instances of the regular expression in the pattern space.	Any character may be used  instead
	       of `/'.	For a more complete description see The flags is zero or more of

	       g       Global.	Substitute for all nonoverlapping instances of the regular expression rather than just the first one.

	       p       Print the pattern space if a replacement was made.

	       w wfile Write.  Append the pattern space to wfile if a replacement was made.

       (2)t label
	       Test.   Branch  to  the `:' command bearing the label if any substitutions have been made since the most recent reading of an input
	       line or execution of a `t'.  If label is empty, branch to the end of the script.

       (2)w wfile
	       Write.  Append the pattern space to wfile.

       (2)x    Exchange the contents of the pattern and hold spaces.

       (2)y/string1/string2/
	       Transform.  Replace all occurrences of characters in string1 with the corresponding character in string2.  The lengths  of  string1
	       and string2 must be equal.

       (2)! function
	       Don't.  Apply the function (or group, if function is `{') only to lines not selected by the address(es).

       (0): label
	       This command does nothing; it bears a label for `b' and `t' commands to branch to.

       (1)=    Place the current line number on the standard output as a line.

       (2){    Execute the following commands through a matching `}' only when the pattern space is selected.

       (0)     An empty command is ignored.

       (0)#    With one exception, any line whose first nonblank character is a number sign is a comment and is ignored.  The exception is that if
	       the first such line encountered contains only the number sign followed by the letter `n' the default output is suppressed as if the
	       -n option were in force.

Options
       -e 'command;command...'
	       Uses command;command...	as the editing script.	If no -f option is given, the -e keyword can be omitted.  For example, the follow-
	       ing two command are functionally identical:
	       % sed -e 's/DIGITAL/Digital/g' summary > summary.out
	       % sed 's/DIGITAL/Digital/g' summary > summary.out

       -f sfile
	       Uses specified file as input file of commands to be executed.  Can be used with -e option to apply both	explicit  commands  and  a
	       separate script file.

       -n      Suppresses  all	normal	output, writing only lines explicitly written by the `p' or `P' commands or by an `s' command with the `p'
	       flag.

See Also
       awk(1), ed(1), grep(1), lex(1)

																	    sed(1)
All times are GMT -4. The time now is 01:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy