Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Base64 conversion in awk overlaps
Top Forums Shell Programming and Scripting Base64 conversion in awk overlaps Post 303021996 by busyboy on Wednesday 22nd of August 2018 08:26:15 AM
Old 08-22-2018
Base64 conversion in awk overlaps
hi,

problem:
output is not consistent as expected using external command in AWK

description:

I'm trying to convert $2 into a base64 string for later decoding, and for this when I use [g]awk , I'm getting overlapped results , or say it results are not 100% correct.

my code is:

Code:
gawk -F\" ' { print $2;  cmd="echo "$2" | base64";cmd| getline x;close(cmd); print x }' /var/log/apache2/other_vhosts_access.log


and the output is given below, not all lines are encoded using base64.

Code:
UE9TVCAvaXBsaWZ0L2dldF9pcF9saXN0LnBocD92PTQgSFRUUC8xLjEK
GET / HTTP/1.1
R0VUIC8gSFRUUC8xLjEK ---------> sample encoded
GET /action=detail,pid=1044 HTTP/1.1
R0VUIC9wcm9wZXJ0eS1zZWFyY2h+YWN0aW9uPWRldGFpbCxwaWQ9MTA0NCBIVFRQLzEuMQo=  ---------> sample encoded
GET /?load=css&file=master/styles/details.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=com_master/styles/text.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/boxes.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/quick-search.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/results.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/style.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/myarea.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/form.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/template.css HTTP/1.1


input is simply an apache2 log file.

REgards,
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

I'm looking for someone who have Base64 binary

I need to install the base64 encryption method on a UNIX machine under AIX5.2. I've received a tar file but it is only C source , can you help me please. (sending me a binary base64 or to compile my source) Thanks by advance (3 Replies)
Discussion started by: Bruno_LAMOUR
3 Replies

2. Shell Programming and Scripting

String Conversion in awk

I am porting a awk script from Windows to unix I_SALE_MEDIA=$67 if ((I_VOID_FLAG == "Y") && (I_SALE_MEDIA == 0)) NOW consider the case where I_SALE_MEDIA i.e $67 is "000" The above comparison works fine in Windows , but to make it work in Unix , I had to change the above as follows : ... (3 Replies)
Discussion started by: rohanrege
3 Replies

3. Shell Programming and Scripting

Determining number of overlaps between two files using Hashes?

Hi there, I have a doubt about how to set this up. This is the situation. I have two files, one that is ~31,000 in length and has the following information (7 fields): file1 1 + 100208127 100261594 6 100208127,100231680,100237404,100245177,100249508,100260529, ... (35 Replies)
Discussion started by: labrazil
35 Replies

4. Shell Programming and Scripting

AWK Currency Conversion

How can I use awk command to convert values to currency. For example I have a database like follows John:200 smith:300 kim:405 and want it to out put like this John $200.00 (3 Replies)
Discussion started by: 3junior
3 Replies

5. Shell Programming and Scripting

File conversion and awk

Hi Everyone, I am confused with the output of the input file and I am using below command in script to get the expected output. Also I want to add another condition using logical AND (&&) in place of $2=="L"{$4=0-$4} as $2=="L" && $3=="L" {$4=0-$4} but I am getting some awk error. Can someone... (6 Replies)
Discussion started by: gehlnar
6 Replies

6. UNIX for Dummies Questions & Answers

Why are there LFs in my base64?

And is there a good way of taking them out? I've been playing around a bit with using b64 to embed images in HTML (and trying to stay within the spec). I've noticed that with openssl's base64 encoder, the output files have newline characters @ every 65th column or so. This renders them useless,... (2 Replies)
Discussion started by: SilversleevesX
2 Replies

7. Shell Programming and Scripting

awk? create similarity matrix by calculating overlaps between sets comprising of individual parts

Hi everyone I am very new at awk and to me the task I need to get done is very very challenging... Nevertheless, after admiring how fast and elegant issues are being solved here I am sure this is my best chance. I have a 2D data file (input file is a plain tab-delimited text file). The first... (1 Reply)
Discussion started by: stonemonkey
1 Replies

8. Red Hat

Crontab: overlaps

I'm using CentOS 6.3 and I use a crontab entries like this: 0 23 2-31 * 1-6 root weekdayscript 0 23 1 * 7 root weekendscript this 2 entries always overlaps... but I don't know how... :wall: thanks (10 Replies)
Discussion started by: ionral
10 Replies

9. Shell Programming and Scripting

Conversion of line via awk or etc

Hello friends, could you help me about problem with my data lines. I suppose a simple awk code may help me. I have following data lines: (first line including 3 numbers and then a matrices of 4x10) 500 40 9 1 A B 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22... (6 Replies)
Discussion started by: rpf
6 Replies

10. Shell Programming and Scripting

Numeral conversion in awk

I am running into conversion of string to numbers in awk that I can't understand and don't know how to deal with properly My script checks for numeric only field, I use this approach to do that: $1 + 0 == $1 It works most of the time, but in some cases it does not behave how I expect it to... (5 Replies)
Discussion started by: migurus
5 Replies

LEARN ABOUT DEBIAN

dancer

DANCER(1p)						User Contributed Perl Documentation						DANCER(1p)

NAME

       dancer - helper script to create new Dancer applications

SYNOPSIS

       dancer [options] -a <appname>

OPTIONS

	   -h, --help		 : print what you are currently reading
	   -a, --application	 : the name of your application
	   -p, --path		 : the path where to create your application
				     (current directory if not specified)
	   -x, --no-check	 : don't check for the latest version of Dancer
				     (checking version implies internet connection)
	   -v, --version	 : print the version of dancer being used

DESCRIPTION

       Helper script for providing a bootstrapping method to quickly and easily create the framework for a new Dancer application.

EXAMPLE

       Here is an application created with dancer:

	   $ dancer -a mywebapp
	   + mywebapp
	   + mywebapp/bin
	   + mywebapp/bin/app.pl
	   + mywebapp/config.yml
	   + mywebapp/environments
	   + mywebapp/environments/development.yml
	   + mywebapp/environments/production.yml
	   + mywebapp/views
	   + mywebapp/views/index.tt
	   + mywebapp/views/layouts
	   + mywebapp/views/layouts/main.tt
	   + mywebapp/lib
	   + mywebapp/lib/mywebapp.pm
	   + mywebapp/public
	   + mywebapp/public/css
	   + mywebapp/public/css/style.css
	   + mywebapp/public/css/error.css
	   + mywebapp/public/images
	   + mywebapp/public/500.html
	   + mywebapp/public/404.html
	   + mywebapp/public/dispatch.fcgi
	   + mywebapp/public/dispatch.cgi
	   + mywebapp/public/javascripts
	   + mywebapp/public/javascripts/jquery.js
	   + mywebapp/Makefile.PL
	   + mywebapp/t
	   + mywebapp/t/002_index_route.t
	   + mywebapp/t/001_base.t

       The application is ready to serve:

	   $ cd mywebapp
	   $ ./mywebapp.pl
	   >> Listening on 127.0.0.1:3000
	   == Entering the development dance floor ...

AUTHOR

       This script has been written by Sebastien Deseille <sebastien.deseille@gmail.com> and Alexis Sukrieh <sukria@cpan.org>.

SOURCE CODE

       See Dancer for more information.

LICENSE

       This module is free software and is published under the same terms as Perl itself.

perl v5.14.2							    2012-04-03								DANCER(1p)
All times are GMT -4. The time now is 01:18 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy