To check Blank Lines, Blank Records and Junk Characters in a File Post: 302943371

Sponsored Content

Top Forums Shell Programming and Scripting To check Blank Lines, Blank Records and Junk Characters in a File Post 302943371 by Don Cragun on Thursday 7th of May 2015 09:44:22 PM

05-07-2015

Registered User

Quote:

Originally Posted by chatwithsaurav

Hi All

Need Help

I have a file with the below format (ABC.TXT) :

Code:

���ABCDHEJJSJJ|XCBJSKK01|M|7348974982790
HDFLJDKJSKJ|KJALKSD02|M|7378439274898
KJHSAJKHHJJ|LJDSAJKK03|F|9898982039999
(cont......)

I need to write a script where it will check for : blank lines (between rows,before first line and after last line) and remove them. Also if there are any blank records between the "|" delimeter it will identify the row number and send a mail. Finally in case there are "junk characters" it will identify and remove them. How should I go about it?

I know what a blank line is. What is a ": blank line"? Is it a blank line that can contain colons in addition to <space>s and <tab>s?

By definition, a blank line only contains characters in the character class blank and the character | is never a member of that character class. So, what do you really mean by "blank records between the "|" delimiter"?

All of the characters in the 1st two fields of the 1st three lines of your sample ABC.TXT look like "junk characters" to me. What is your definition of a junk character? If " KJHSAJKHHJJ" isn't junk, what is it?

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Deleting the blank line in a file and counting the characters....

Hi, I am trying to do two things in my script. I will really appreciate any help in this regards. Is there a way to delete a last line from a pipe delimited flat file if the last line is blank. If the line is not blank then do nothing..... Is there a way to count a word that are starting...

2. Shell Programming and Scripting

how to check weather file is blank or not?

Dear All I want to do following task. Kindly suggest. In my script every hour one file is genarated. say xyz.txt. Now if this file contain some data then i want to do task A and if file is blank then i want to do nothing. Kindly help me to do this. regards jaydeep

3. Shell Programming and Scripting

Can't remove blank lines from a file

Hi Guys, I have been trying to remove blank lines from a file with no success. I tried using all the following options on the file: tr -s '\n' < abc.txt grep -v "^$" abc.txt sed '/^$/d' abc.txt sed '/./!d' abc.txt awk '/./' abc.txt The file is a text file.

4. Shell Programming and Scripting

Delete blank lines, if blank lines are more than one using shell

Hi, Consider a file named "testfile" The contents of file are as below first line added for test second line added for test third line added for test fourth line added for test fifth line added for test

5. Shell Programming and Scripting

Delete blank lines in a file

Hi All, I have a file and I need to delete the lines that are blank and is starting with some characters below. Something like below: Regular Ascii File: Line1: AGODA1 BUSAN||SK Lord Beach 4/6/2012 4/7/2012 68060 Line2: AGODA2 BUSAN||SK Beach Hotel 4/6/2012 4/7/2012 610200 Line3: ...

6. Shell Programming and Scripting

Reform Lines in File without blank lines and spaces

Hello All, I have a file with data as below. Each line consists of 21 fields. I am not able to load them back to the database. 50733339,"834","834 ","005010X279A1","N","Y","007977163","0001 ",30,"2110D ","EB ","EB007 ","2 ","Conditional Required Data Element Miss ing...

7. Shell Programming and Scripting

Removing blank lines from a file

Hi All, How do i remove continuos blank lines from a file. I have a file with data: abc; def; ghi; jkl; mno; pqr; In the above file, there are two blank lines. I want to remove, one out of them. My output should look like:

8. Shell Programming and Scripting

How to check if the file is empty or has blank space.?

Hi, I am using KSH. I am trying to check if the output file is empty or not. I tried with ] but what i see is my file is empty but still manages to have a size of 1 instead of 0. But my file doesnot have anything its empty. I am not sure how to check this. can any one help?

9. UNIX for Advanced & Expert Users

Delete blank spaces and blank lines in a file

Hi Gurus, Somebody can say me how to delete blank spaces and blank lines in a file unix, please. Thank you for advanced.

10. Shell Programming and Scripting

Script to find blank records in a file except for few columns

I have a file with the following format: X|High|2|GIC|DM||XHM|||6 Months X|Moderate|2|GIC|DM||XHM|||6 Months X|High|2|GCM|DM||XSF|||6 Months X|Med|2|GCM|DM||XSF|||6 Here there are ten columns but I need to print rows having blank records in any of the rows (except for 6th,8th and 9th...

LEARN ABOUT CENTOS

iswblank

ISWBLANK(3)						     Linux Programmer's Manual						       ISWBLANK(3)

NAME

       iswblank - test for whitespace wide character

SYNOPSIS

       #include <wctype.h>

       int iswblank(wint_t wc);

   Feature Test Macro Requirements for glibc (see feature_test_macros(7)):

       iswblank():
	      _XOPEN_SOURCE >= 600 || _ISOC99_SOURCE || _POSIX_C_SOURCE >= 200112L;
	      or cc -std=c99

DESCRIPTION

       The  iswblank() function is the wide-character equivalent of the isblank(3) function.  It tests whether wc is a wide character belonging to
       the wide-character class "blank".

       The wide-character class "blank" is a subclass of the wide-character class "space".

       Being a subclass of the wide-character class "space", the wide-character class "blank" is disjoint from the  wide-character  class  "graph"
       and therefore also disjoint from its subclasses "alnum", "alpha", "upper", "lower", "digit", "xdigit", "punct".

       The wide-character class "blank" always contains at least the space character and the control character '	'.

RETURN VALUE

       The  iswblank()	function  returns  nonzero  if wc is a wide character belonging to the wide-character class "blank".  Otherwise it returns
       zero.

CONFORMING TO

       POSIX.1-2001.

NOTES

       The behavior of iswblank() depends on the LC_CTYPE category of the current locale.

SEE ALSO

       isblank(3), iswctype(3)

COLOPHON

       This page is part of release 3.53 of the Linux man-pages project.  A description of the project, and information about reporting bugs,  can
       be found at http://www.kernel.org/doc/man-pages/.

GNU
								    2010-09-20							       ISWBLANK(3)