The awk is more than adequate for the task. You can utilize ORS feature - output record separator, to re-place usual line feed with ^ character to string the log lines together. Another built-in NF - number of fields - will tell you when the new section is coming. Yet another built-in NR - record number - will help to bypass firts 5 lines.
I have a file with 14million lines and I would like to extract all the unique lines from the file into another text file.
For example:
Contents of file1
happy
sad
smile
happy
funny
sad
I want to run a command against file one that only returns the unique lines (ie 1 line for happy... (3 Replies)
I need a script to process a huge single line text file:
The sample of the text is:
"forward_inline_item": "Inline", "options_region_Australia": "Australia", "server_event_err_msg": "There was an error attempting to save", "Token": "Yes", "family": "Family","pwd_login_tab": "Enter Your... (1 Reply)
This is related to one of my previous post but now with a slight difference: I need the "Updated:" to be in one line as well as the "Information:" on one line as well. These are in multiple lines right now as seen below. These can have 2 or more lines that needs to be in one line.
System name:... (8 Replies)
Hi,
I have an issue to combine multiple lines of a file. I have records as below.
Fields are delimited by TAB. Each lines are ending with a new line char (\n)
Input
--------
ABC 123456 abcde 987
890456 7890 xyz
ght gtuv
ABC 5tyin 1234 789
ghty kuio
ABC ghty jind 1234
678 ght
... (8 Replies)
Good morning all,
I have a problem that is one step beyond a standard awk compare.
I would like to compare three files which have several thousand records against a fourth file. All of them have a value in each row that is identical, and one value in each of those rows which may be duplicated... (1 Reply)
If a file has following kind of data, comma delimited
1,2,3,4
1
1
1,2,3,4
1,2
2
2,3,4
My required output must have only 4 columns with comma delimited
1,2,3,4
111,2,3,4
1,222,3,4
I have tried many awk command using ORS="" but couldnt progress (10 Replies)
I am trying to combine lines with these conditions:
1. First line starts with text of "libname VALUE db2 datasrc" where VALUE can be any text.
2. If condition1 is met then continue to combine lines through a line that ends with a semicolon.
3. Ignore case when matching patterns and remove any... (5 Replies)
I have been searching and trying to come up with an awk that will perform the following on a
converted text file (original is a pdf).
1. Since the first two lines are (begin with) text they are removed
2. if $1 is a number then all text is merged (combined) into one line until the next... (3 Replies)
In the awk piped to sed below I am trying to format file by removing the odd xxxx_digits and whitespace after, then move the even xxxx_digit to the line above it and add a space between them. There may be multiple lines in file but they are in the same format. The Filename_ID line is the last line... (4 Replies)
Discussion started by: cmccabe
4 Replies
LEARN ABOUT XFREE86
urlcoding
URLCODING(3) libbash urlcoding Library Manual URLCODING(3)NAME
urlcoding -- a Libbash library for encoding and decoding URL's.
SYNOPSIS
urlEncodeString [-l] <STRING>
urlEncodeFile [-l] <FILE>
urlEncodeStream [-l]
urlDecodeString <STRING>
urlDecodeFile <FILENAME>
urlDecodeStream
DESCRIPTION
urlcoding is a collection of functions that convert ASCII-text to standard URL's and vice-versa. The AWK code used is based on code by Heiner
Steven <heiner.steven@odn.de>
The function list:
urlEncodeString Creates a URL from an ASCII string
urlEncodeFile Converts a file into URL-valid text
urlEncodeStream Converts standard input into URL-valid text
urlDecodeString Converts a URL-encoded text back to a plain-text form
urlDecodeFile Coverts URL-encoded text in a file back to plain text
urlDecodeStream Converts URL-encoded standard input to text
Detailed interface description follows.
The [-l] option for the encoding functions should be used when line-feed characters ('
') are to be encoded as well.
All functions print the results of their conversions to standard output.
The exit status of all functions is that of the command 'awk', with '0' for success
FUNCTIONS DESCRIPTIONS
urlEncodeString [-l] <STRING>
Converts STRING - a string of ASCII characters - to URL.
urlEncodeFile [-l] <FILE>
Coverts FILE of URL-encoded text to plain text
urlEncodeStream [-l]
Converts text from standard input to URL-text.
urlDecodeString <STRING>
Converts URL-encoded string STRING back to text.
urlDecodeFile <FILENAME>
Converts the URL-encoded text in FILE to plain text.
urlDecodeStream
Converts the URL-encoded text from standard input to plain-text
AUTHORS
Alon Keren <alon.keren@gmail.com>
SEE ALSO ldbash(1), libbash(1)Linux Epoch Linux