To search distinct special char in file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting To search distinct special char in file
# 8  
Old 09-03-2013
Code:
awk -F\| '{gsub(/[a-zA-Z0-9]/,"",$4)}!c[$4]++{print $4}' infile

--ahamed
# 9  
Old 09-03-2013
hi,

i am getting
sed: illegal option -- r
error if u use
Code:
sed -r 's/([^|]*\|){26}//;s/^[[:alnum:]]*//;s/[[:alnum:]]*$//' file.txt

# 10  
Old 09-03-2013
With the following input file:
file.txt
Code:
aa|bb|cc|$aab$c#
aa|XX|ZZ|NothingSpecialHere0123456789
aa|bb|ccc|$$abc.c=
bb|xss|ddd|!xyz
nn|yyy|qqq|qq qq
abe|qqq|yyy|=a,(){}aa
aaa|yyy|zzzz|#aaaa

The awk script:
Code:
awk -F'|' '
{       gsub(/[[:alnum:]]/, "", $4)
        for(i = 1; i <= length($4); i++) {
                if((c = substr($4, i, 1)) in s) continue
                s[c]
                printf("%s", c)
        }
}
END {   print ""
}' file.txt

seems to produce the unique set of non-numeric, non-alphabetic characters found in any position in field 4, producing the output in the format shown in message #5 in this thread:
Code:
$#.=! ,(){}

# 11  
Old 09-03-2013
Another one
Code:
awk -F\| '{gsub(/[[:alnum:]]| /,"",$4)}$4{gsub(".","&\n",$4);print $4}' infile | sort -u

You can strip off the new lines from the output

--ahamed
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To search null and char in file

Hi guys, I want to know how i can search null value and character value in a feed file. my file has Pipe delimted records. for eg: 1|12|xxx|yyy . . . N records I know the the which column null and char occurs does it has for eg 3rd column which i can obtain by awk $3 and (7 Replies)
Discussion started by: rohit_shinez
7 Replies

2. Programming

Special char in a buffer

Hello, Please ,how can verify, if a case of buffer contains a special char ? (in C) Thank you. (3 Replies)
Discussion started by: chercheur857
3 Replies

3. Shell Programming and Scripting

Split a special char

Hello, I have some data in output file.In that i need to split the special char "(" and ")" and store it. This is example of o/p file. (OHC12345) (OHC12415) (OHC12765) (OHC12545) I need like OHC12345 OHC12415 OHC12765 OHC12545 --Thanks (5 Replies)
Discussion started by: rasingraj
5 Replies

4. Shell Programming and Scripting

Search distinct files

Hello , Can anyone help me with my below query I am trying to find a text in directory of files via below command grep -i cmps_cgs_crs_rfnc_id * But it returns multiple times same file name i.e if the text found in a file 4 times the file name shown 4 times in the o/p Is... (1 Reply)
Discussion started by: Pratik4891
1 Replies

5. Shell Programming and Scripting

Remove special char from end of the file

Hi I am working on a bash script and would know how to use cut or sed to remove (F/.M/d h) from a text file. Before 1 text to save (F/.M/d h) after 1 text to save Thanks in advance (5 Replies)
Discussion started by: pelle
5 Replies

6. Shell Programming and Scripting

Special Char in Data file

Hi All, I have a data file in UNIX which i am trying to load into Oracle table using Oracle SQL Loader. The problem is, one of the filed contains special character (ex: Square). And due to this reason, my script fails. Could you please let me know, how to identify which character is... (1 Reply)
Discussion started by: Amit.Sagpariya
1 Replies

7. UNIX for Dummies Questions & Answers

How to copy/move to a file with a special character as the 1st char in the filename?

I am trying to create files with special characters in its filenames for testing purposes. This is on a Linux RHEL4 but this should also be applicable on a Unix shell. I am able to create files with special characters in the filenames...e.g. cp -pv foo.gif \*special.gif cp -pv foo.gif \... (6 Replies)
Discussion started by: sqa777
6 Replies

8. Shell Programming and Scripting

Special Char in Multiple Files

We develop a file in windows and move to unix box as a part of deployment. When we do this, we get ctrl-M(^M) character added to the file. So we need to remove ctrl-M(^M) character from all the files from deployment folder and all subfolders folder. Currently we move to individual folders and... (5 Replies)
Discussion started by: thinakarmani
5 Replies

9. UNIX for Advanced & Expert Users

Using egrep to search for Text and special char

Anyone is well-versed to use egrep to search a file for a line containing both: 1) AAA 2) $ I am having problem escaping the dollar sign when using egrep in conjunction with satisfying AAA as well. E.g. Text file Line 1 AAA Line 2 $$$ Line 3 AAA BBB $ Line 4 $$$ BBB AA will return me... (2 Replies)
Discussion started by: izy100
2 Replies

10. UNIX for Dummies Questions & Answers

search special characters in a file

Hello I am new to shell scripting and can anyone tell me how to check if there are any special characters in a file. Can i use grep ? thanks susie (2 Replies)
Discussion started by: cramya80
2 Replies
Login or Register to Ask a Question