Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Base64 conversion in awk overlaps
Top Forums Shell Programming and Scripting Base64 conversion in awk overlaps Post 303021996 by busyboy on Wednesday 22nd of August 2018 08:26:15 AM
Old 08-22-2018
Base64 conversion in awk overlaps
hi,

problem:
output is not consistent as expected using external command in AWK

description:

I'm trying to convert $2 into a base64 string for later decoding, and for this when I use [g]awk , I'm getting overlapped results , or say it results are not 100% correct.

my code is:

Code:
gawk -F\" ' { print $2;  cmd="echo "$2" | base64";cmd| getline x;close(cmd); print x }' /var/log/apache2/other_vhosts_access.log


and the output is given below, not all lines are encoded using base64.

Code:
UE9TVCAvaXBsaWZ0L2dldF9pcF9saXN0LnBocD92PTQgSFRUUC8xLjEK
GET / HTTP/1.1
R0VUIC8gSFRUUC8xLjEK ---------> sample encoded
GET /action=detail,pid=1044 HTTP/1.1
R0VUIC9wcm9wZXJ0eS1zZWFyY2h+YWN0aW9uPWRldGFpbCxwaWQ9MTA0NCBIVFRQLzEuMQo=  ---------> sample encoded
GET /?load=css&file=master/styles/details.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=com_master/styles/text.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/boxes.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/quick-search.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/results.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/style.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/myarea.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/form.css HTTP/1.1
sh: 1: HTTP/1.1: not found
GET /?load=css
GET /?load=css&file=master/styles/template.css HTTP/1.1


input is simply an apache2 log file.

REgards,
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

I'm looking for someone who have Base64 binary

I need to install the base64 encryption method on a UNIX machine under AIX5.2. I've received a tar file but it is only C source , can you help me please. (sending me a binary base64 or to compile my source) Thanks by advance (3 Replies)
Discussion started by: Bruno_LAMOUR
3 Replies

2. Shell Programming and Scripting

String Conversion in awk

I am porting a awk script from Windows to unix I_SALE_MEDIA=$67 if ((I_VOID_FLAG == "Y") && (I_SALE_MEDIA == 0)) NOW consider the case where I_SALE_MEDIA i.e $67 is "000" The above comparison works fine in Windows , but to make it work in Unix , I had to change the above as follows : ... (3 Replies)
Discussion started by: rohanrege
3 Replies

3. Shell Programming and Scripting

Determining number of overlaps between two files using Hashes?

Hi there, I have a doubt about how to set this up. This is the situation. I have two files, one that is ~31,000 in length and has the following information (7 fields): file1 1 + 100208127 100261594 6 100208127,100231680,100237404,100245177,100249508,100260529, ... (35 Replies)
Discussion started by: labrazil
35 Replies

4. Shell Programming and Scripting

AWK Currency Conversion

How can I use awk command to convert values to currency. For example I have a database like follows John:200 smith:300 kim:405 and want it to out put like this John $200.00 (3 Replies)
Discussion started by: 3junior
3 Replies

5. Shell Programming and Scripting

File conversion and awk

Hi Everyone, I am confused with the output of the input file and I am using below command in script to get the expected output. Also I want to add another condition using logical AND (&&) in place of $2=="L"{$4=0-$4} as $2=="L" && $3=="L" {$4=0-$4} but I am getting some awk error. Can someone... (6 Replies)
Discussion started by: gehlnar
6 Replies

6. UNIX for Dummies Questions & Answers

Why are there LFs in my base64?

And is there a good way of taking them out? I've been playing around a bit with using b64 to embed images in HTML (and trying to stay within the spec). I've noticed that with openssl's base64 encoder, the output files have newline characters @ every 65th column or so. This renders them useless,... (2 Replies)
Discussion started by: SilversleevesX
2 Replies

7. Shell Programming and Scripting

awk? create similarity matrix by calculating overlaps between sets comprising of individual parts

Hi everyone I am very new at awk and to me the task I need to get done is very very challenging... Nevertheless, after admiring how fast and elegant issues are being solved here I am sure this is my best chance. I have a 2D data file (input file is a plain tab-delimited text file). The first... (1 Reply)
Discussion started by: stonemonkey
1 Replies

8. Red Hat

Crontab: overlaps

I'm using CentOS 6.3 and I use a crontab entries like this: 0 23 2-31 * 1-6 root weekdayscript 0 23 1 * 7 root weekendscript this 2 entries always overlaps... but I don't know how... :wall: thanks (10 Replies)
Discussion started by: ionral
10 Replies

9. Shell Programming and Scripting

Conversion of line via awk or etc

Hello friends, could you help me about problem with my data lines. I suppose a simple awk code may help me. I have following data lines: (first line including 3 numbers and then a matrices of 4x10) 500 40 9 1 A B 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22... (6 Replies)
Discussion started by: rpf
6 Replies

10. Shell Programming and Scripting

Numeral conversion in awk

I am running into conversion of string to numbers in awk that I can't understand and don't know how to deal with properly My script checks for numeric only field, I use this approach to do that: $1 + 0 == $1 It works most of the time, but in some cases it does not behave how I expect it to... (5 Replies)
Discussion started by: migurus
5 Replies

LEARN ABOUT BSD

css

CSS(4)							     Kernel Interfaces Manual							    CSS(4)

NAME

       css - DEC IMP-11A LH/DH IMP interface

SYNOPSIS

       /sys/conf/SYSTEM:
	    NCSS css_controllers     # DEC/CSS IMP11-A ARPAnet IMP interface

DESCRIPTION

       The  css device provides a Local Host/Distant Host interface to an IMP.	It is normally used when participating in the DARPA Internet.  The
       controller itself is not accessible to users, but instead provides the hardware support to the IMP interface  described	in  imp(4).   When
       configuring, the imp(NIMP) pseudo-device is also included.

DIAGNOSTICS

       css%d:  not  alive.  The initialization routine was entered even though the device did not autoconfigure.  This is indicates a system prob-
       lem.

       css%d: can't initialize.  Insufficient UNIBUS resources existed to initialize the device.  This is likely to occur when the device  is  run
       on  a buffered data path on an 11/750 and other network interfaces are also configured to use buffered data paths, or when it is configured
       to use buffered data paths on an 11/730 (which has none).

       css%d: imp doesn't respond, icsr=%b.  The driver attempted to initialize the device, but the IMP failed to respond after 500 tries.   Check
       the cabling.

       css%d: stray output interrupt csr=%b.  An interrupt occurred when no output had previously been started.

       css%d: output error, ocsr=%b icsr=%b.  The device indicated a problem sending data on output.

       css%d: recv error, csr=%b.  The device indicated a problem receiving data on input.

       css%d: bad length=%d.  An input operation resulted in a data transfer of less than 0 or more than 1008 bytes of data into memory (according
       to the word count register).  This should never happen as the maximum size of a host-IMP message is 1008 bytes.

3rd Berkeley Distribution					  August 20, 1987							    CSS(4)
All times are GMT -4. The time now is 10:50 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy