Remove specific strings from certain fields


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Remove specific strings from certain fields
Prev   Next
# 1  
Old 05-26-2009
Remove specific strings from certain fields

I'm working with a set of files where I'm trying to remove a set of characters from specific fields. The files are comma-delimited, and the characters I want to remove include:
- open parentheses - (
- close parentheses - )
- space followed by a dollar sign - $

I don't want to remove every occurrence of these characters as they may occur in fields that I don't want to remove the data from.

How can I remove specific strings from specific fields, like the 4th or 5th fields in a .csv per the information provided above? Thanks much!
 
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Bash to remove find and remove specific extension

The bash below executes and does find all the .bam files in each R_2019 folder. However set -x shows that the .bam extension only gets removed from one .bam file in each folder (appears to be the last in each). Why is it not removing the extension from each (this is $SAMPLE)? Thank you :). set... (4 Replies)
Discussion started by: cmccabe
4 Replies

2. Shell Programming and Scripting

Bash - Comparing 2 xml strings masking certain fields

Would like to compare 2 XML Strings which has certain known fields changed. For example, Date field will always have differences. When comparing both strings, skip/mask all the occurring Date Field's `DtField1` and `DtField2` Note: these are not formatted xml format. File1: ... (1 Reply)
Discussion started by: Sajjadmehdi
1 Replies

3. Shell Programming and Scripting

How to extract fields containing specific strings?

Hello I have a log file with thousands of lines like below Sep 21 13:02:52 lnxtst01 kernel: New TCP in: IN=eth0 OUT= MAC=00:1a:4b:50:b7:32:00:08:e3:ff:fc:04:08:00 SRC=10.184.46.4 DST=10.162.139.21 LEN=60 TOS=0x00 PREC=0x00 TTL=59 ID=52961 DF PROTO=TCP SPT=55688 DPT=22 WINDOW=5840 RES=0x00 SYN... (3 Replies)
Discussion started by: magnus29
3 Replies

4. UNIX for Dummies Questions & Answers

Printing lines with specific strings at specific columns

Hi I have a file which is tab-delimited. Now, I'd like to print the lines which have "chr6" string in both first and second columns. Could anybody help? (3 Replies)
Discussion started by: a_bahreini
3 Replies

5. Shell Programming and Scripting

Print only lines where fields concatenated match strings

Hello everyone, Maybe somebody could help me with an awk script. I have this input (field separator is comma ","): 547894982,M|N|J,U|Q|P,98,101,0,1,1 234900027,M|N|J,U|Q|P,98,101,0,1,1 234900023,M|N|J,U|Q|P,98,54,3,1,1 234900028,M|H|J,S|Q|P,98,101,0,1,1 234900030,M|N|J,U|F|P,98,101,0,1,1... (2 Replies)
Discussion started by: Ophiuchus
2 Replies

6. Shell Programming and Scripting

How to fetch specific fields

Dear Friends, Please provide some commands to fecth specific filed (data yellow color) from below data.. Input data 2648: 1;20120707;3591|4;20290107;90|5;20290107;3|9;20120705;0|10;20120705;0|16;20290113;15|29;20120705;0 2658: 1;20120722;0|4;20290422;1200|9;20120705;0|10;20120705;0 2646:... (4 Replies)
Discussion started by: suresh3566
4 Replies

7. Shell Programming and Scripting

mappin strings of two different file and finding the mapped string and then map other fields.

As i am new to unix so facing some problems in scripting: here is my question: i m having two files. 1st file say a.txt contain 3 column like SPECIALITY|UMP_CODE|SPECIALTY_CODE Addictive Diseases|25ADD|ADD Addictive Diseases/Family Practice|25ADD|ADD/FP Aerospace Medicine|1.041666667|AM... (4 Replies)
Discussion started by: dsh007
4 Replies

8. Shell Programming and Scripting

AWK- delimiting the strings and matching the fields

Hello, I am newbie in awk. I have just started learning it. 1) I have input file which looks like: {4812 4009 1602 2756 306} {4814 4010 1603 2757 309} {8116 9362 10779 } {10779 10121 9193 10963 10908} {1602 2756 306 957 1025} {1603 2757 307} and so on..... 2) In output: a)... (10 Replies)
Discussion started by: kajolo
10 Replies

9. Shell Programming and Scripting

Parse apart strings of comma separated data with varying number of fields

I have a situation where I am reading a text file line-by-line. Those lines of data contain comma separated fields of data. However, each line can vary in the number of fields it can contain. What I need to do is parse apart each line and write each field of data found (left to right) into a file.... (7 Replies)
Discussion started by: 2reperry
7 Replies
Login or Register to Ask a Question
GIT-RM(1)							    Git Manual								 GIT-RM(1)

NAME
       git-rm - Remove files from the working tree and from the index

SYNOPSIS
       git rm [-f | --force] [-n] [-r] [--cached] [--ignore-unmatch] [--quiet] [--] <file>...

DESCRIPTION
       Remove files from the index, or from the working tree and the index. git rm will not remove a file from just your working directory. (There
       is no option to remove a file only from the working tree and yet keep it in the index; use /bin/rm if you want to do that.) The files being
       removed have to be identical to the tip of the branch, and no updates to their contents can be staged in the index, though that default
       behavior can be overridden with the -f option. When --cached is given, the staged content has to match either the tip of the branch or the
       file on disk, allowing the file to be removed from just the index.

OPTIONS
       <file>...
	   Files to remove. Fileglobs (e.g.  *.c) can be given to remove all matching files. If you want Git to expand file glob characters, you
	   may need to shell-escape them. A leading directory name (e.g.  dir to remove dir/file1 and dir/file2) can be given to remove all files
	   in the directory, and recursively all sub-directories, but this requires the -r option to be explicitly given.

       -f, --force
	   Override the up-to-date check.

       -n, --dry-run
	   Don't actually remove any file(s). Instead, just show if they exist in the index and would otherwise be removed by the command.

       -r
	   Allow recursive removal when a leading directory name is given.

       --
	   This option can be used to separate command-line options from the list of files, (useful when filenames might be mistaken for
	   command-line options).

       --cached
	   Use this option to unstage and remove paths only from the index. Working tree files, whether modified or not, will be left alone.

       --ignore-unmatch
	   Exit with a zero status even if no files matched.

       -q, --quiet
	   git rm normally outputs one line (in the form of an rm command) for each file removed. This option suppresses that output.

DISCUSSION
       The <file> list given to the command can be exact pathnames, file glob patterns, or leading directory names. The command removes only the
       paths that are known to Git. Giving the name of a file that you have not told Git about does not remove that file.

       File globbing matches across directory boundaries. Thus, given two directories d and d2, there is a difference between using git rm 'd*'
       and git rm 'd/*', as the former will also remove all of directory d2.

REMOVING FILES THAT HAVE DISAPPEARED FROM THE FILESYSTEM
       There is no option for git rm to remove from the index only the paths that have disappeared from the filesystem. However, depending on the
       use case, there are several ways that can be done.

   Using "git commit -a"
       If you intend that your next commit should record all modifications of tracked files in the working tree and record all removals of files
       that have been removed from the working tree with rm (as opposed to git rm), use git commit -a, as it will automatically notice and record
       all removals. You can also have a similar effect without committing by using git add -u.

   Using "git add -A"
       When accepting a new code drop for a vendor branch, you probably want to record both the removal of paths and additions of new paths as
       well as modifications of existing paths.

       Typically you would first remove all tracked files from the working tree using this command:

	   git ls-files -z | xargs -0 rm -f

       and then untar the new code in the working tree. Alternately you could rsync the changes into the working tree.

       After that, the easiest way to record all removals, additions, and modifications in the working tree is:

	   git add -A

       See git-add(1).

   Other ways
       If all you really want to do is to remove from the index the files that are no longer present in the working tree (perhaps because your
       working tree is dirty so that you cannot use git commit -a), use the following command:

	   git diff --name-only --diff-filter=D -z | xargs -0 git rm --cached

SUBMODULES
       Only submodules using a gitfile (which means they were cloned with a Git version 1.7.8 or newer) will be removed from the work tree, as
       their repository lives inside the .git directory of the superproject. If a submodule (or one of those nested inside it) still uses a .git
       directory, git rm will move the submodules git directory into the superprojects git directory to protect the submodule's history. If it
       exists the submodule.<name> section in the gitmodules(5) file will also be removed and that file will be staged (unless --cached or -n are
       used).

       A submodule is considered up to date when the HEAD is the same as recorded in the index, no tracked files are modified and no untracked
       files that aren't ignored are present in the submodules work tree. Ignored files are deemed expendable and won't stop a submodule's work
       tree from being removed.

       If you only want to remove the local checkout of a submodule from your work tree without committing the removal, use git-submodule(1)
       deinit instead. Also see gitsubmodules(7) for details on submodule removal.

EXAMPLES
       git rm Documentation/*.txt
	   Removes all *.txt files from the index that are under the Documentation directory and any of its subdirectories.

	   Note that the asterisk * is quoted from the shell in this example; this lets Git, and not the shell, expand the pathnames of files and
	   subdirectories under the Documentation/ directory.

       git rm -f git-*.sh
	   Because this example lets the shell expand the asterisk (i.e. you are listing the files explicitly), it does not remove
	   subdir/git-foo.sh.

BUGS
       Each time a superproject update removes a populated submodule (e.g. when switching between commits before and after the removal) a stale
       submodule checkout will remain in the old location. Removing the old directory is only safe when it uses a gitfile, as otherwise the
       history of the submodule will be deleted too. This step will be obsolete when recursive submodule update has been implemented.

SEE ALSO
       git-add(1)

GIT
       Part of the git(1) suite

Git 2.17.1							    10/05/2018								 GIT-RM(1)