Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Problems concatenating data using UNIX?
Top Forums UNIX for Dummies Questions & Answers Problems concatenating data using UNIX? Post 302917603 by brialp on Wednesday 17th of September 2014 05:23:57 PM
Old 09-17-2014
Problems concatenating data using UNIX?
Hello,
Can somebody help me to solve this inconsistent data issue. I have a pipe delimiter file and one of the column is a comment. I am trying to concatenate into one single sentence. For instance, I have a file actually with 2 records but the way it considers the first record is as different rows and hence loads into the table as different records. In the sample below, 123 and 789 are two different records.


Code:
123|efg|"Try to solve.
This is a unix script. Trying to concatenate.

It seems to be simple but not as simple once I start scripting.
Sincerly,
XYZ
ABC"|5|3|6 months
789|def|"Better way to solve this issue."|4|6|7 years

This is how it has to look.
Code:
abc|efg|"Try to solve. This is a unix script. Trying to concatenate. It seems to be simple but not as simple once I start scripting. Sincerly, XYZ ABC"|5|3|6 months
789|def|"Better way to solve this issue."|4|6|7 years

I first tried to remove the blank space using
Code:
sed '/^$/d' t1.txt > t2.txt

Then I couldn't figure out how to remove spaces after a period and concatenate the next sentence.

I would really appreciate any input on resolving this.
Last edited by Scrutinizer; 09-17-2014 at 06:52 PM.. Reason: CODE tags
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

concatenating static string to records in data file

I just need to add a static ID to each output record so the users will be able to tell which group records in combined flatfiles come from I have the static ID in a bourne variable. I tried awk '{print "${GroupID}" $0}' infile > outfile But I ended up with the string ${GroupID} instead of... (5 Replies)
Discussion started by: gillbates
5 Replies

2. UNIX for Advanced & Expert Users

how to read the data from an excel sheet and use those data as variable in the unix c

I have 3 columns in an excel sheet. c1 c2 c3 EIP_ACCOUNT SMALL_TS_01 select A.* from acc; All the above 3 col shoud be passed a variable in the unix code. 1.How to read an excel file 2.How to pass these data as variable to the unic script (1 Reply)
Discussion started by: Anne Grace
1 Replies

3. Shell Programming and Scripting

problems with a script that outputs data to a file

First of all, im a total newbie to the point that i do not know what are the terms to search for my problem. I did however spend the rest of the day today trying to figure out what is wrong with my bash script. ive always thought that the best way to learn is to tackle a problem heads on. but at... (1 Reply)
Discussion started by: joeribut
1 Replies

4. UNIX for Dummies Questions & Answers

Validating XSL sheet data in Unix Data file

Dear All, Need your help. In my day to day activities I have to validate/search Excel Sheet data (eg.say Application No. 0066782345) data into the Unix environment file whether the same data is present in that file or not. There are hundreds of records coming in excel file and I am doing grep... (1 Reply)
Discussion started by: ravijunghare
1 Replies

5. Shell Programming and Scripting

Excution Problems with loading huge data content and convert it

Hi, I got long list of referred file content: CGTGCFTGCGTFREDG PEOGDKGJDGKLJGKL DFGDSFIODUFIODSUF FSDOFJSODIFJSIODFJ DSFSDFDFSDOFJFOSF SDFOSDJFOJFPPIPIOP . . . Input file content: >sample_1 SDFDSKLFKDSLSDFSDFDFGDSFIODUFIODSUFSDDSFDSSDFDSFAS (14 Replies)
Discussion started by: patrick87
14 Replies

6. Shell Programming and Scripting

Execution Problems with scan and change file data content

Input file >Read_1 XXXXXXXXXXSDFXXXXXDS ASDRXXXXXTGAGTXXXXXT TGTGATXXXXXAXXXXGXXA . . Desired output file >Read_1 XXXXXXXXXXXXXXXXXXDS ASDRXXXXXTGAGTXXXXXT TGTGATXXXXXXXXXXXXXA . . (5 Replies)
Discussion started by: patrick87
5 Replies

7. Shell Programming and Scripting

Concatenating the lines of a data

I have a data of 1 lac lines with the following format abcde,1,2,3,4, ,ee ,ff ,gg ,hh ,mm abcde,3,4,5,6, ,we ,qw ,as ,zx ,cf abcde,1,5,6,7, ,dd ,aa ,er .... .... (6 Replies)
Discussion started by: aravindj80
6 Replies

8. Shell Programming and Scripting

Problems with fetching data from Oracle database

Here's a database query which looks up the NAME column of PRODUCT table SELECT NAME FROM PRODUCT ; And this query retrieves me the following output SUGAR COCOA HONEY WHEAT CABBAGE CAULI FLOWER Please note the last record CAULI FLOWER contains TWO blank spaces between the two words. ... (4 Replies)
Discussion started by: kumarjt
4 Replies

9. Red Hat

Problems with EURO symbol in a data flat file

Hi, I'm creating a flat file with various deimiters in Linux RHEL. the content for the flat file will be extracted from an oracle database. delimiters also stored in a seperate table in oracle databasae. when i use extended ASCII characters like cedilla or EURO (€) symbols, the actual character is... (9 Replies)
Discussion started by: Fakru.y
9 Replies

LEARN ABOUT PHP

ppmquantall

ppmquantall(1)						      General Commands Manual						    ppmquantall(1)

NAME

       ppmquantall - run ppmquant on a bunch of files all at once, so they share a common colormap

SYNOPSIS

       ppmquantall [-ext extension] ncolors ppmfile ...

DESCRIPTION

       Takes a bunch of portable pixmap as input.  Chooses ncolors colors to best represent all of the images, maps the existing colors to the new
       ones, and overwrites the input files with the new quantized versions.

       If you don't want to overwrite your input files, use the -ext option.  The output files are then named the same as the input files, plus  a
       period and the extension text you specify.

       Verbose	explanation:  Let's  say  you've got a dozen pixmaps that you want to display on the screen all at the same time.  Your screen can
       only display 256 different colors, but the pixmaps have a total of a thousand or so different colors.  For a single pixmap you  solve  this
       problem	with  ppmquant;  this  script  solves  it for multiple pixmaps.  All it does is concatenate them together into one big pixmap, run
       ppmquant on that, and then split it up into little pixmaps again.

       (Note that another way to solve this problem is to pre-select a set of colors and then use ppmquant's -map option  to  separately  quantize
       each pixmap to that set.)

SEE ALSO

       ppmquant(1), ppm(5)

AUTHOR

       Copyright (C) 1991 by Jef Poskanzer.

								   27 July 1990 						    ppmquantall(1)
All times are GMT -4. The time now is 08:05 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy