Sponsored Content
Full Discussion: line feeds in csv
Top Forums Shell Programming and Scripting line feeds in csv Post 82484 by vgersh99 on Thursday 1st of September 2005 02:20:04 PM
Old 09-01-2005
Quote:
Originally Posted by Rakesh Ranjan
Just change the pattern that vgersh99 said try something like
sed 's/\\n/\"^["]*\"'
\" for checking starting quotes ^["] for checking anything other than " (inside [] no metachr except '-' means anything so no need for \") and lastly \\n for newline. g as suggested by vgersh stands for globaly and so should not be used here.
I haven't run this (away from any Linux box) so in case of problem just fiddle with above pattern & if u still have problem plz. do tell me.
I think you're confusing the syntax of 's':
Code:
s/regular expression/replacement/flags
                   Substitute   the   replacement  string   for
                  instances  of  the  regular  expression in the
                  pattern  space.   Any  character  other   than
                  backslash  or newline can be used instead of a
                  slash to delimit the RE and  the  replacement.
                  Within the RE and the replacement, the RE del-
                  imiter itself can be used as a literal charac-
                  ter if it is preceded by a backslash.
                  An ampersand (&) appearing in the  replacement
                  will  be  replaced  by the string matching the
                  RE.  The special meaning of & in this  context
                  can   be   suppressed   by   preceding  it  by
                  backslash.  The characters \n, where  n  is  a
                  digit, will be replaced by the text matched by
                  the  corresponding  backreference  expression.
                  For each backslash (\) encountered in scanning
                  replacement from beginning to end, the follow-
                  ing  character  loses  its special meaning (if
                  any).  It is unspecified what special  meaning
                  is  given  to any character other than &, \ or
                  digits.

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

carriage return/line feeds

Hello, I have a file that has got carriage returns in it and I want to take them out. Anyone know how I can do this in a ksh? thanks (4 Replies)
Discussion started by: pitstop
4 Replies

2. Shell Programming and Scripting

Remove line feeds

Hi, I have a fixed width flat file which has 1 as the first char and E as the last character. Some of the records have a carriage return /line feeds . how do I remove them? Let me know. Thanks VSK (8 Replies)
Discussion started by: vsk
8 Replies

3. Shell Programming and Scripting

Spurious line feeds

Hi all, I know this is **awfully** general but..... I have a script which does, basically... for file in `find command`; do some stuff more stuff echo '.\c' done I want to output the '.' char just to give an idea of progress. However, it works fine for a while and then I... (2 Replies)
Discussion started by: ajcannon
2 Replies

4. Shell Programming and Scripting

supressing carrige returns/line feeds

Hi gurus I am stripping lots of email addresses from a file with this grep "^To" file.log |awk '{print "1,"$2}' > recipients.out file.log looks something like this: oasndfoasnosf To: person@email.co.uk lsdfjosd sdlfnmsopdfwer dtlghodrgn To: person2@emailsss.com sldfnsdf I... (5 Replies)
Discussion started by: terry2009
5 Replies

5. UNIX for Dummies Questions & Answers

.properties file and new line feeds

Hi, I have a .properties file that a read in some values in an .sh file but everytime I put it out on the server it fails. If I copy and paste the values of the .properties file on my local machine to the .properties file on the server it works just fine. Someone mentioned to see if it has dos... (3 Replies)
Discussion started by: vsekvsek
3 Replies

6. Shell Programming and Scripting

Delimited data contains line feeds where they shouldn't be

I have some data, each record (line) ends with a line feed (\n). Each field is pipe (|) delimited. 1|short desc|long text|2001-01-01 01:01 2|short desc| long text |2002-02-02 02:02 3|short desc| long text | 2003-03-03 03:03 4|short desc | long text | 2004-04-04 04:04 ... (10 Replies)
Discussion started by: ericdp63
10 Replies

7. Shell Programming and Scripting

remove line feeds followed by character

Hi everyone, I'm very new to using sed, run through some tutorials and everything but I've hit a problem that I'm unable to solve by myself. I need to remove all linefeeds that are followed by a particular character (in this case a semicolon). So basically, all lines starting with a semicolon... (5 Replies)
Discussion started by: fluffdasheep
5 Replies

8. Shell Programming and Scripting

useless line feeds in ldapsearch output. Howto remove with shell script?

Hi $ cat ad.sh ldapsearorg -x -LLL -h sb1131z.testbadbigcorp.org -D "CN=ADMINZZ,OU=AdminRoles,DC=testbadbigcorp,DC=org" -w "UT3w4f57lll--4...4" -b "OU=Test,DC=testbadbigcorp,DC=org" "(&(&(&(&(objectCategory=person)(objectClass=user)(lockoutTime:1.2.840.113556.1.4.804:=4294967295)))))" dn$... (3 Replies)
Discussion started by: slashdotweenie
3 Replies

9. Shell Programming and Scripting

Removing carriage return/line feeds on multiple lines

I would like to remove carriage returns/line feeds in a text file, but in a specific cadence: Read first line (Header Line 1), remove cr/lf at the end (replace it with a space ideally); Read the next line (Line of Text 2), leave the cr/lf intact; Read the next line, remove the cr/lf; Read... (14 Replies)
Discussion started by: tomr2012
14 Replies

10. Shell Programming and Scripting

Extract Line and Column from CSV Line in ksh or bash format

Hi, I was doing some research and can't seem to find anything. I'm trying to automate a process by creating a script to read a csv line and column and assigning that value to a variable for the script to process it. Also if you could tell me the line and column if it's on another work ... (3 Replies)
Discussion started by: vpundit
3 Replies
sed(1)							      General Commands Manual							    sed(1)

NAME
sed - stream text editor SYNOPSIS
script [file]... script]... script_file]... [file]... DESCRIPTION
copies the named text files (standard input default) to the standard output, edited according to a script containing up to 100 commands. Only complete input lines are processed. Any input text at the end of a file that is not terminated by a new-line character is ignored. Options recognizes the following options: Take script from file script_file. Edit according to script. If there is just one option and no options, the flag can be omitted. Suppress the default output. interprets all and arguments in the order given. Use caution, if mixing and options, to avoid unpredictable or incorrect results. Command Scripts A script consists of editor commands, one per line, of the following form: [address address]] function [arguments] In normal operation, cyclically copies a line of input into a pattern space (unless there is something left after a command), applies in sequence all commands whose addresses select that pattern space, and, at the end of the script, copies the pattern space to the standard output (except under and deletes the pattern space. Some of the commands use a hold space to save all or part of the pattern space for subsequent retrieval. Command Addresses An address is either a decimal number that counts input lines cumulatively across files, a which addresses the last line of input, or a context address; that is, a in the style of ed(1) modified thus: o In a context address, the construction where ? is any character, is identical to Note that in the context address the second stands for itself, so that the regular expression is o The escape sequence matches a new-line character embedded in the pattern space. o A period matches any character except the terminal new-line of the pattern space. o A command line with no addresses selects every pattern space. o A command line with one address selects each pattern space that matches the address. o A command line with two addresses selects the inclusive range from the first pattern space that matches the first address through the next pattern space that matches the second (if the second address is a number less than or equal to the line number first selected, only one line is selected). Thereafter the process is repeated, looking again for the first address. supports Basic Regular Expression syntax (see regexp(5)). Editing commands can also be applied to only non-selected pattern spaces by use of the negation function (described below). Command Functions In the following list of functions, the maximum number of permissible addresses for each function is indicated in parentheses. Other func- tion elements are interpreted as follows: text One or more lines, all but the last of which end with to hide the new-line. Backslashes in text are treated like back- slashes in the replacement string of an command, and can be used to protect initial blanks and tabs against the strip- ping that is done on every script line. rfile Must terminate the command line, and must be preceded by exactly one blank. wfile Must terminate the command line, and must be preceded by exactly one blank. Each wfile is created before processing begins. There can be at most 10 distinct wfile arguments. recognizes the following functions: text Append. Place text on the output before reading next input line. Branch to the command bearing label. If no label is specified, branch to the end of the script. text Change. Delete the pattern space. With 0 or 1 address or at the end of a 2-address range, place text on the output. Start the next cycle. Delete pattern space and start the next cycle. Delete initial segment of pattern space through first new-line and start the next cycle. Replace contents of the pattern space with contents of the hold space. Append contents of hold space to the pattern space. Replace contents of the hold space with contents of the pattern space. Append the contents of the pattern space to the hold space. text Insert. Place text on the standard output. List the pattern space on the standard output in an unambiguous form. Non-printing characters are spelled in three-digit octal number format (with a preceding backslash), and long lines are folded. Copy the pattern space to the standard output if the default output has not been suppressed (by the option on the command line or the command in the script file). Replace the pattern space with the next line of input. Append the next line of input to the pattern space with an embedded new-line. (The current line number changes.) Print. Copy the pattern space to the standard output. Copy the initial segment of the pattern space through the first new-line to the standard output. Quit. Branch to the end of the script. Do not start a new cycle. Read contents of rfile and place on output before reading the next input line. Substitute replacement string for instances of regular expression in the pattern space. Any character can be used instead of For a fuller description see ed(1). flags is zero or more of: n n=1-2048 Substitute for just the nth occurrence of regular expression in the pattern space. Global. Substitute for all non-overlapping instances of regular expression rather than just the first one. Print the pattern space if a replacement was made and the default output has been suppressed (by the option on the command line or the command in the script file). Under the environment (see standards(5)), the pattern space is printed twice, if the option is not specified on the command line. Write. Append the pattern space to wfile if a replacement was made. Test. Branch to the command bearing the label if any substitutions have been made since the most recent reading of an input line or execution of a If label is empty, branch to the end of the script. Write. Append the pattern space to wfile. Exchange the contents of the pattern and hold spaces. Transform. Replace all occurrences of characters in string1 with the corresponding character in string2. The lengths of string1 and string2 must be equal. Any character other than backslash or newline can be used instead of slash to delimit the two strings. If a backslash character is immediately followed by another backslash character in string1 or string2, the two backslash char- acters will be handled as a single literal backslash character. The delimiter itself can be used as a literal character in string1 and string2 if it is preceded by a backslash. The only exception is character "n" as the delimiter, because backslash-n, " ", will be interpreted as a newline. The meaning of a backslash is undefined if it is followed by any character that is not "n", a backslash, or the delimiter char- acter. Don't. Apply the function (or group, if function is only to lines selected by the address or addresses. This command does nothing; it bears a label for and commands to branch to. Place the current line number on the standard output as a line. Execute the following commands through a matching only when the pattern space is selected. The syntax is: (0) An empty command is ignored. If a appears as the first character on the first line of a script file, that entire line is treated as a comment with one exception: If the character after the is an the default output is suppressed. The rest of the line after is also ignored. A script file must contain at least one non-comment line. EXTERNAL INFLUENCES
For information about the UNIX Standard environment, see standards(5). Environment Variables provides a default value for the internationalization variables that are unset or null. If is unset or null, the default value of "C" (see lang(5)) is used. If any of the internationalization variables contains an invalid setting, will behave as if all internationalization variables are set to "C". See environ(5). If set to a non-empty string value, overrides the values of all the other internationalization variables. determines the interpretation of text as single and/or multi-byte characters, the classification of characters as printable, and the char- acters matched by character class expressions in regular expressions. determines the locale that should be used to affect the format and contents of diagnostic messages written to standard error and informa- tive messages written to standard output. determines the location of message catalogues for the processing of International Code Set Support Single- and multi-byte character code sets are supported. EXAMPLES
Make a simple substitution in a file from the command line or from a shell script, changing to Same as above but use shell or environment variables and in search and replacement strings: or Multiple substitutions in a single command: or WARNINGS
limits command scripts to a total of not more than 100 commands. The hold space is limited to 8192 characters. processes only text files. See the glossary for a definition of text files and their limitations. AUTHOR
was developed by OSF and HP. SEE ALSO
awk(1), ed(1), grep(1), environ(5), lang(5), regexp(5), standards(5). tutorial in the STANDARDS CONFORMANCE
sed(1)
All times are GMT -4. The time now is 10:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy