Sponsored Content
Top Forums Shell Programming and Scripting 100 interesting shell scripting problems Post 302849409 by nickednamed on Sunday 1st of September 2013 09:57:27 AM
Old 09-01-2013
100 interesting shell scripting problems

Hi all,

I'm just learning to write shell scripts (new to the whole UNIX thing) and I'm wondering if anyone would like to help me create a resource to help me, and others like me, learn scripting. It would be something like "100 interesting shell scripting problems".

All I need are suggestions for interesting problems to solve using shell scripting.

My motivation / reasoning is this: I've been learning for a while, but as I'm doing it for pleasure (not for work), I don't really need to write a lot of shell scripts. I've already written a few simple scripts to automate some of my daily tasks, but I want to take my scripting to the next level.

I've got a lot of great books, tutorials, web pages, etc. to help me learn, but they are mostly used for reference, as the examples they include are rather general / trivial, and they don't have many exercises.

Basically, I have a lack of "interesting problems to solve" and therefore a lack of real learning opportunities and practice. I know that others have the same problem too.

So, I'm looking to create a list of practical, interesting, real-world problems which gradually increase in difficulty. It will be similar to thekarangoel's git repo "Projects" where you can learn Python by solving the problems given (sorry, can't post links yet).

As an example, in case I'm not making myself clear, there could be a list of categories, such as:
- Account Admin
- Backup
- Games
- Networking
- File manipulation
- etc.

Each category would contain a number of problems to solve. Some (rubbish) examples might be:
- Create a script which counts the number of users currently logged in.
- Create a script which backs up all the dotfiles for the current user.
- Create a script which converts all file names to lowercase and removes whitespaces.
- Create a script which converts Markdown formatted text into HTML files.

It will be a kind of learn-by-doing system. The learner will be responsible for finding the information and resources necessary to solve the problem, and may upload his solution for others to study. The problems could include difficulty ratings, hints / tips, suggestions or links to solutions or helpful resources to aid the learner, if need be.

I would make the resource available online as a webpage, wiki, git repo, ebook, or whatever else people want.

As I said, I'm happy to do the heavy lifting myself, but lack of knowledge / experience stops me from creating meaningful problems, or even decent categories of problems / tasks.

Any feedback, help or suggestions would be very much appreciated, but as stated at the beginning all I need to get started are suggestions for interesting problems to solve using shell scripting.

Thank you,

Nickednamed

Last edited by nickednamed; 09-01-2013 at 03:35 PM.. Reason: Grammar, style
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Scripting file permission problems...

Hello all - I have two systems. 1) Linux box running Redhat 8.0 2) Tru64 box running V4.0f From the Linux box I am remotely mounting a directory (nfs mount) that resides on the Tru64 machine. The directory that is nfs mounted contains two subdirectories: my_dir1 my_dir2 I want... (3 Replies)
Discussion started by: Heron
3 Replies

2. Shell Programming and Scripting

Scripting problems

Hello, Im trying to write a script where it will only execute on a certain day. What would the script look like? if then do this is this correct?? (13 Replies)
Discussion started by: lewisoco
13 Replies

3. Shell Programming and Scripting

difference between AIX shell scripting and Unix shell scripting.

please give the difference between AIX shell scripting and Unix shell scripting. (2 Replies)
Discussion started by: haroonec
2 Replies

4. Shell Programming and Scripting

shell scripting on unix/mysql problems

Hi, I have written a shell script for oracle on unix that does a df for specific files, and then will display the size, Avail, % used and the difference from yesterday to today. I have been asked to place it on some MySql databases that run onn unix and linux also, but when I try to run them I... (2 Replies)
Discussion started by: cat55
2 Replies

5. Shell Programming and Scripting

Beginner bash scripting - a few problems

Hey Guys, I am creating a bash script on my freeBSD box, the script should basically ask the user to enter a username and domain. The script will take this information and basically append alot of information to config files so the user can receive email from that domain and create a web site at... (1 Reply)
Discussion started by: traxy
1 Replies

6. Shell Programming and Scripting

Shell scripting problems - Commands not on local machine

Hello all- I have done a lot of searching tonight, but all leads seem to be dead ends. Forgive me if this has been covered, but I've searched the forum and the internet. I am having trouble building a shell script which uses SSH to login to our schools 1024 cluster grid. The issue that I am... (1 Reply)
Discussion started by: Sagan
1 Replies

7. Programming

shell scripting problems involving operations with remote machine

Hi, i have been developing a shell script to transfer a set of files from one ubuntu system to another. Task: while executing the script the files ( ls, dir, cat) in the source machine should transfer to destination machine(at /home/mac/mac/bin) While the script is executed once again, It... (0 Replies)
Discussion started by: srijith
0 Replies

8. Shell Programming and Scripting

Unix scripting problems

Hi, In my unix server, i received a file in /usr/data/xmit location. i want to write a unix script after file reached. So how can i write a one line code which chceks the presence of the file? and second line line should take the status of the prevous line. like below. Line 1: checks for the... (16 Replies)
Discussion started by: JSKOBS
16 Replies

9. Shell Programming and Scripting

Execution problems with scripting

Hi, I am new to scripting.I had one problem infront of me.I tried in many ways with minimal knowledge........Kindly help me. Description: I want a shell script where it has to read an input.txt file and need to remove duplicate lines and the result need to kept in output.txt file. input... (5 Replies)
Discussion started by: bhas
5 Replies

10. UNIX for Dummies Questions & Answers

Code commenting Problems in shell scripting

Hi Friends, I Want to comment one line of code from below code. DBA_ORACLE_USER=`DB.sh -u -a User` DBA_ORACLE_PWORD=`DB.sh -p -a User` sqlplus /nolog <<-END > ${logfile} 2>&1 WHENEVER OSERROR EXIT 9 WHENEVER SQLERROR EXIT SQL.SQLCODE connect... (3 Replies)
Discussion started by: as234301
3 Replies
AUTOEXPECT(1)						      General Commands Manual						     AUTOEXPECT(1)

NAME
autoexpect - generate an Expect script from watching a session SYNOPSIS
autoexpect [ args ] [ program args... ] INTRODUCTION
autoexpect watches you interacting with another program and creates an Expect script that reproduces your interactions. For straightline scripts, autoexpect saves substantial time over writing scripts by hand. Even if you are an Expect expert, you will find it convenient to use autoexpect to automate the more mindless parts of interactions. It is much easier to cut/paste hunks of autoexpect scripts together than to write them from scratch. And if you are a beginner, you may be able to get away with learning nothing more about Expect than how to call autoexpect. The simplest way to use autoexpect is to call it from the command line with no arguments. For example: % autoexpect By default, autoexpect spawns a shell for you. Given a program name and arguments, autoexpect spawns that program. For example: % autoexpect ftp ftp.cme.nist.gov Once your spawned program is running, interact normally. When you have exited the shell (or program that you specified), autoexpect will create a new script for you. By default, autoexpect writes the new script to "script.exp". You can override this with the -f flag fol- lowed by a new script name. The following example runs "ftp ftp.cme.nist.gov" and stores the resulting Expect script in the file "nist". % autoexpect -f nist ftp ftp.cme.nist.gov It is important to understand that autoexpect does not guarantee a working script because it necessarily has to guess about certain things - and occasionally it guesses wrong. However, it is usually very easy to identify and fix these problems. The typical problems are: o Timing. A surprisingly large number of programs (rn, ksh, zsh, telnet, etc.) and devices (e.g., modems) ignore keystrokes that arrive "too quickly" after prompts. If you find your new script hanging up at one spot, try adding a short sleep just before the previous send. You can force this behavior throughout by overriding the variable "force_conservative" near the beginning of the generated script. This "conservative" mode makes autoexpect automatically pause briefly (one tenth of a second) before sending each char- acter. This pacifies every program I know of. This conservative mode is useful if you just want to quickly reassure yourself that the problem is a timing one (or if you really don't care about how fast the script runs). This same mode can be forced before script generation by using the -c flag. Fortunately, these timing spots are rare. For example, telnet ignores characters only after entering its escape sequence. Modems only ignore characters immediately after connecting to them for the first time. A few programs exhibit this behavior all the time but typically have a switch to disable it. For example, rn's -T flag disables this behavior. The following example starts autoexpect in conservative mode. autoexpect -c The -C flag defines a key to toggle conservative mode. The following example starts autoexpect (in non-conservative mode) with ^L as the toggle. (Note that the ^L is entered literally - i.e., enter a real control-L). autoexpect -C ^L The following example starts autoexpect in conservative mode with ^L as the toggle. autoexpect -c -C ^L o Echoing. Many program echo characters. For example, if you type "more" to a shell, what autoexpect actually sees is: you typed 'm', computer typed 'm', you typed 'o', computer typed 'o', you typed 'r', computer typed 'r', ... Without specific knowledge of the program, it is impossible to know if you are waiting to see each character echoed before typ- ing the next. If autoexpect sees characters being echoed, it assumes that it can send them all as a group rather than inter- leaving them the way they originally appeared. This makes the script more pleasant to read. However, it could conceivably be incorrect if you really had to wait to see each character echoed. o Change. Autoexpect records every character from the interaction in the script. This is desirable because it gives you the ability to make judgements about what is important and what can be replaced with a pattern match. On the other hand, if you use commands whose output differs from run to run, the generated scripts are not going to be correct. For example, the "date" command always produces different output. So using the date command while running autoexpect is a sure way to produce a script that will require editing in order for it to work. The -p flag puts autoexpect into "prompt mode". In this mode, autoexpect will only look for the the last line of program output - which is usually the prompt. This handles the date problem (see above) and most others. The following example starts autoexpect in prompt mode. autoexpect -p The -P flag defines a key to toggle prompt mode. The following example starts autoexpect (in non-prompt mode) with ^P as the toggle. Note that the ^P is entered literally - i.e., enter a real control-P. autoexpect -P ^P The following example starts autoexpect in prompt mode with ^P as the toggle. autoexpect -p -P ^P OTHER FLAGS
The -quiet flag disables informational messages produced by autoexpect. The -Q flag names a quote character which can be used to enter characters that autoexpect would otherwise consume because they are used as toggles. The following example shows a number of flags with quote used to provide a way of entering the toggles literally. autoexpect -P ^P -C ^L -Q ^Q STYLE
I don't know if there is a "style" for Expect programs but autoexpect should definitely not be held up as any model of style. For example, autoexpect uses features of Expect that are intended specifically for computer-generated scripting. So don't try to faithfully write scripts that appear as if they were generated by autoexpect. This is not useful. On the other hand, autoexpect scripts do show some worthwhile things. For example, you can see how any string must be quoted in order to use it in a Tcl script simply by running the strings through autoexpect. SEE ALSO
"Exploring Expect: A Tcl-Based Toolkit for Automating Interactive Programs" by Don Libes, O'Reilly and Associates, January 1995. AUTHOR
Don Libes, National Institute of Standards and Technology expect and autoexpect are in the public domain. NIST and I would appreciate credit if these programs or parts of them are used. 30 June 1995 AUTOEXPECT(1)
All times are GMT -4. The time now is 10:49 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy