09-04-2012
Converting a list to a row delimited
Hello,
I have a large database with the following structure:
set of clustered names followed by a hard return and followed by a second set of clustered names and so on. Sometimes the clusters can be as many as 150.
Since the data is in an Indian language, a theoretical example will make this clear.
Quote:
john
jon
jhon
mary
marry
meri
mari
What I need is to convert the series of lists to a single row so that the desired output is as under:
Quote:
john=jon=jhon
mary=merry=meri=mari
I have been using a simple macro to do the job, but given the size of the file which runs to over 300 thousand names, the macro is too slow and takes time.
A perl or awk script would be most helpful.
Many thanks in advance
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
Can anyone let me know on how to convert a Tab delimited file to Comma delimited file in Unix
Thanks!! (22 Replies)
Discussion started by: charan81
22 Replies
2. UNIX for Dummies Questions & Answers
Hi all,
I have a file with single white space delimited values, I want to convert them to a tab delimited file.
I tried sed, tr ... but nothing is working.
Thanks,
Rajeevan D (16 Replies)
Discussion started by: jeevs81
16 Replies
3. Shell Programming and Scripting
Hi,
I came across a very good script to convert a comma seperated to pipe delimited file in this forum. the script serves most of the requirement but looks like it does not handle embedded double quotes and commas i.e if the input is like
1234, "value","first,second", "LDC5"monitor",... (15 Replies)
Discussion started by: anijan
15 Replies
4. UNIX for Advanced & Expert Users
Hi all I have a file as below :
Development
System
User
Production
i want to convert the file to below format:
"Development","System","User","Production"
Is it possible with UNIX ? if so can you please give me some direction on it ?
Thanks,
Satya
Use code tags please, ty. (10 Replies)
Discussion started by: satyaranjon
10 Replies
5. Shell Programming and Scripting
I have a file which was pipe delimited, I need to make it tab delimited. I tried with sed but no use
cat file | sed 's/|//t/g'
The above command substituted "/t" not tab in the place of pipe.
Sample file:
abc|123|2012-01-30|2012-04-28|xyz
have to convert to:
abc 123... (6 Replies)
Discussion started by: karumudi7
6 Replies
6. Shell Programming and Scripting
Hi everyone..
I have a list of values in a file...
1.2345e-1
2.282828e+
3.2341e-1
1.1223445e-1
I am interested in converting this column to a row..
1.2345e-1 2.282828e+ 3.2341e-1 1.1223445e-1
can anyone pls help?? I am a liunx newbie..
Thanks.. (7 Replies)
Discussion started by: kjha
7 Replies
7. Shell Programming and Scripting
Hello.
I have a long list of data which has the following structure
The number shows the unique identity of the word. And all homophones are clustered with the same number ID.
An example will make this clear
The awk script I have allows conversion of a list to row but on condition that each... (4 Replies)
Discussion started by: gimley
4 Replies
8. Shell Programming and Scripting
Hi all,
I have source file, data looks like
12345 abc def 01 / 001200 C 2000
12345 abc def 01 / 001200 C 2500
12345 abcd def 01 / 001200 C 3500
18945 xyz pqr 01 / 009900 D 4000 5000 2800 9900
Expected ouput... (3 Replies)
Discussion started by: srk409
3 Replies
9. Shell Programming and Scripting
Hi,
I am wanting to create a script that will construct a SQL statement based on a a space delimited string that it read from a config file.
Example of the SQL will be
For example, it will read a string like "AAA BBB CCC" and assign to a variable named IN_STRING.
I then concatenate... (2 Replies)
Discussion started by: newbie_01
2 Replies
10. UNIX for Beginners Questions & Answers
I have a sample text file like this.
CampaignId|^CampaignCd|^InsertionOrderCd|^OwningAdvertiserCd|^CampaignName
998201|^T15-06|^T15|^|^GTA 160x160
998277|^T15-07|^T15|^TEST|^GTA 160x160
998297|^T15-07|^T15|^TEST2|^GTA 160x160
I want to delete the line only when the 4th field is empty. ... (2 Replies)
Discussion started by: Tuxidow
2 Replies
LEARN ABOUT LINUX
shtool-subst
SHTOOL-SUBST.TMP(1) GNU Portable Shell Tool SHTOOL-SUBST.TMP(1)
NAME
shtool-subst - GNU shtool sed(1) substitution operations
SYNOPSIS
shtool subst [-v|--verbose] [-t|--trace] [-n|--nop] [-w|--warning] [-q|--quiet] [-s|--stealth] [-i|--interactive] [-b|--backup ext]
[-e|--exec cmd] [-f|--file cmd-file] [file] [file ...]
DESCRIPTION
This command applies one or more sed(1) substitution operations to stdin or any number of files.
OPTIONS
The following command line options are available.
-v, --verbose
Display some processing information.
-t, --trace
Enable the output of the essential shell commands which are executed.
-n, --nop
No operation mode. Actual execution of the essential shell commands which would be executed is suppressed.
-w, --warning
Show warning on substitution operation resulting in no content change on every file. The default is to show a warning on substitution
operations resulted in no content change on all files.
-q, --quiet
Suppress warning on substitution operation resulting in no content change.
-s, --stealth
Stealth operation. Preserve timestamp on file.
-i, --interactive
Enter interactive mode where the user has to approve each operation.
-b, --backup ext
Preserve backup of original file using file name extension ext. Default is to overwrite the original file.
-e, --exec cmd
Specify sed(1) command directly.
-f, --file cmd-file
Read sed(1) command from file.
EXAMPLE
# shell script
shtool subst -i -e 's;(c) ([0-9]*)-2000;(c) 1-2001;' *.[ch]
# RPM spec-file
%install
shtool subst -v -n
-e 's;^(prefix=).*;1 $RPM_BUILD_ROOT%{_prefix};g'
-e 's;^(sysconfdir=).*;1 $RPM_BUILD_ROOT%{_prefix}/etc;g'
`find . -name Makefile -print`
make install
HISTORY
The GNU shtool subst command was originally written by Ralf S. Engelschall <rse@engelschall.com> in 2001 for GNU shtool. It was prompted
by the need to have a uniform and convenient patching frontend to sed(1) operations in the OpenPKG package specifications.
SEE ALSO
shtool(1), sed(1).
18-Jul-2008 shtool 2.0.8 SHTOOL-SUBST.TMP(1)