Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Fresh Grasshopper Seeking Knowledge on inputing awk scripts and working with them?
Top Forums UNIX for Beginners Questions & Answers Fresh Grasshopper Seeking Knowledge on inputing awk scripts and working with them? Post 303030714 by sub terra on Thursday 14th of February 2019 01:55:07 PM
Old 02-14-2019
Fresh Grasshopper Seeking Knowledge on inputing awk scripts and working with them?
Hey people people,


I am a new grasshopper willing to learn from the masters. I type a lot when I am nervous!



I have pulled tons of info off here in the last week concerning awk. I know nothing about awk, I mean nuthin. I have started work as the guy below the lowest man on the totumpole as a cyber security tech. I have a LOT to learn. I need to get a grip on awk. I decided after it was suggested to make me a cheatsheet with some commands. I found this forum and started working pulling what I saw and playing with it. Some of the things I need to be able to do concerns Nmap and wordlists.



I grabbed some info I tried but I don't even know how to use them in a terminal. If I could get someone to help me out some. I need to know how to take a text document, something like a short story that was copied and pasted into a text file and make it into a wordlist (one word per line) then remove the duplicates and be able to run it in any password cracker. I have to be able to do each one as a step.


Here is what my boss gave me. He copied a short story and put it in a text file. He has a test server that I must crack. He said not to bruteforce it (I wasn't ready for that) but he gave me a short story on a text file. He said the password for the server was in this story. I have to break the story down into a wordlist with no duplicates and get into the server where he has a file with my name on it and inside this file is an email address where I have to email it before a certain date and time.


I searched out a lot on here because I want to get it on my own. But I need help.



The last thing is, where is a site or a book title where I can read up on awk at it's most basic level. I would like to take what you help me with and break it down to get a much better understanding.

--- Post updated at 06:55 PM ---

I'm sorry. I read the response and thought it was something in general about posting code. So I overlooked it.


I have this
Code:
cat file1.txt file2.txt | sort | uniq > output.txt



Code:
awk '{ while(++i<=NF) printf (!a[$i]++) ? $i FS : ","; i=split("",a); print ""}' data

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Why passwd isnt working in shell scripts?

I had to write a script to change my login password, and the script wasnt working fine. When I searched through the previous postings in this forum, I got the solution (using 'expect' tool). But I would like to know why passwd command isnt working in scripts? (1 Reply)
Discussion started by: Deepa
1 Replies

2. Shell Programming and Scripting

how to use ssh without inputing a password

hi, i am writing a script ssh root@192.168.0.200 ls -l , ssh always prompts me to enter a password, how to suppress it ,just like using rsh thanks (3 Replies)
Discussion started by: bugbugbug
3 Replies

3. Shell Programming and Scripting

awk: seeking to bytes

can I seek to a particular byte in a file and replace it using awk? if so, how? (8 Replies)
Discussion started by: karyn1617
8 Replies

4. UNIX for Dummies Questions & Answers

alias not working in scripts

Hi All, PF below details, > cat run.sh #!/usr/bin/ksh alias ll="ls -l" > ./run.sh > ll ksh: ll: not found. Pls help on this? Thanks in Advance, Naga :cool: (2 Replies)
Discussion started by: Nagapandi
2 Replies

5. Red Hat

Linux - scripts not working in cron

hi all, i have scripts executable in manully, but not working in cron. any ideas? thanks a lot? * * * * * /home/dir/dir/file.sh #! /bin/sh alarmPath="/home/dir/monitoringAlarm" alarmDateTime="$(date +%Y%m%d) $(date +%H%M%S)" tomcatPID=`pidof /usr/local/jdk1.6.0_13/bin/java` echo "tomcat... (1 Reply)
Discussion started by: maxlee24
1 Replies

6. Shell Programming and Scripting

Linux - scripts not working in cron

hi all, i have scripts executable in manully, but not working in cron. any ideas? thanks a lot? * * * * * /home/dir/dir/file.sh #! /bin/sh alarmPath="/home/dir/monitoringAlarm" alarmDateTime="$(date +%Y%m%d) $(date +%H%M%S)" tomcatPID=`pidof /usr/local/jdk1.6.0_13/bin/java` echo "tomcat... (3 Replies)
Discussion started by: maxlee24
3 Replies

7. Shell Programming and Scripting

cron job is not working for two scripts

Hi Gurus, I have a test unix server in which currently some unix cronjob are running. I have written two script one is a shell script in which env variable are there (in that i am exporting those variables). I have also written a perl script . when i am running at the shell manually like... (5 Replies)
Discussion started by: sanjay.login
5 Replies

8. UNIX for Advanced & Expert Users

Awk expressions working & not working

Hi, Putting across a few awk expressions. Apart from the last, all of them are working. echo a/b/c | awk -F'/b/c$' '{print $1}' a echo a/b/c++ | awk -F'/b/c++' '{print $1}' a echo a/b/c++ | awk -F'/b/c++$' '{print $1}' a/b/c++ Request thoughts on why putting a '$' post double ++... (12 Replies)
Discussion started by: vibhor_agarwali
12 Replies

9. Shell Programming and Scripting

Inputing info from a CSV file and filling a template file

Hi, I have a .csv file that contains a variety of fields for 60 clients: USERNAME, PASSWORD, and COMMENTS. I have a template file which contains a great deal of data for each client and has the fields USERNAME, PASSWORD, and COMMENTS that has to be filled with the values of USERNAME,... (1 Reply)
Discussion started by: mojoman
1 Replies

10. Shell Programming and Scripting

Scripts imported from UNIX to Linux are not working

Hi, Recently we migrated our app from Unix to Linux platform. All our shell scripts which use to work in Unix platform are not working in Linux now. below is such sample script. I tried removing trailing spaces, but no luck. dear experts kindly help.. #############BEGIN############### split... (7 Replies)
Discussion started by: laxman_bly
7 Replies

LEARN ABOUT CENTOS

word-list-compress

WORD-LIST-COMPRESS(1)					 Aspell Abbreviated User's Manual				     WORD-LIST-COMPRESS(1)

NAME

       word-list-compress - word list compressor/decompressor for GNU Aspell

SYNOPSIS

       word-list-compress c[ompress] | d[ecompress]

DESCRIPTION

       word-list-compress compresses or decompresses sorted word lists for use with the GNU Aspell spell checker.

COMMANDS

       -c, c, compress
	      compress the plain text word list read from standard input.

       -d, d, decompress
	      decompress the compressed word list read from standard input.

EXAMPLES

       Here are a few examples of how you can use word-list-compress

       word-list-compress d <wordlist.cwl >wordlist.txt
	      Decompress file wordlist.cwl to text file wordlist.txt

       word-list-compress c <wordlist.wl >wordlist.cwl 2>errors.txt
	      Compress wordlist.wl to wordlist.cwl and send any error messages to a text file named errors.txt

       LC_COLLATE=C sort -u <wordlist.txt | word-list-compress c >wordlist.cwl
	      Sort a word list, then pipe it to word-list-compress to create a compressed binary wordlist.cwl file.

       word-list-compress d <words.cwl | aspell create master ./words.rws
	      Decompress a wordlist, then pipe it to aspell(1) to create a spelling list.  Please check the aspell(1) info manual for proper usage
	      and options.

TIPS

       Word-list-compress is best used with sorted word list type files.  It is not a general purpose  compression  program  since  the  resulting
       files may actually increase in size.

       Word-list-compress  accepts  up to 255 text characters in the range of {0x21...0xFF}. If your word list requires a larger character set for
       certain languages or longer length for multi-word, scientific, medical, technical or other use, then it is recommended  that  you  compress
       your word list using prezip-bin(1)

DIAGNOSTICS

       Word-list-compress  normally exits with a return code of 0. If it encounters an error, a message is sent to standard error output (stderr),
       and word-list-compress exits with a non-zero return value.  Error messages are listed below:

       (display help/usage message)
	      Unknown command given on the command line so word-list-compress displays a usage message to standard error output.

       Corrupt Input
	      This is only for the decompression command d.  The input file is of an unknown format or the input file/stream  is  corrupted.   You
	      may  have  some valid output, but word-list-compress could not complete the process.  If the input file is a compressed wordlist but
	      you have no output file, then it may be a newer prezip-bin(1) version of compressed file, if so, try  decompressing  the	file  with
	      prezip-bin(1) instead.

       Output Data Error
	      The output is full, write protected, or has an error and can no longer be written to.

SEE ALSO

       aspell(1), prezip-bin(1), run-with-aspell(1)

       Aspell is fully documented in its Texinfo manual.  See the `aspell' entry in info for more complete documentation.

REPORTING BUGS

       For help, see the Aspell homepage at <http://aspell.net> and send bug reports/comments to the Aspell user list at the above address.

AUTHOR

       This manual page was written by Aaron Lehmann <aaronl@vitelus.com>, Brian Nelson <pyro@debian.org> and Jose Da Silva <digital@joescat.com>.

GNU
								    2005-09-05						     WORD-LIST-COMPRESS(1)
All times are GMT -4. The time now is 12:46 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy