The UNIX and Linux Forums - Shell Programming and Scripting

do a full comparison of folder contents in script

tlarkin — Fri, 20 Nov 2009 21:34:59 GMT

Hello everyone....

I have a small issue here at work and I am trying to script out a way to automate a fix for it. I have a small number of users (I work in a 1:1 with 6,000 macbooks) that aren't really managed in my deployment. They are managed with a few policies, but the policies are broken because they never turn their laptops in or get them reimaged. I have had to wipe LDAP a few times for upgrades/maintenance/fixes and their synchronized portable home directory has a different UID than the new UID since I did fresh imports of user accounts both times I destroyed and rebuilt LDAP.

So, I have a script written which seems to be going the correct way of doing this, but I am not exactly a Unix wizard so I have some basic questions hopefully someone here can help me with.

The script's function will be to copy all local user accounts in /Users to /Users/username.bu for a full back up of the account. Then, it will initiate a log out, and a log out hook that will run the second script that will verify all data is copied to the back up folder (.bu) and then delete the account from directory services and wipe the original data out of their local user account.

This way, when the user logs in next, they will have pulled down the new account to their machine that has the exact same user/password but this time it will be the right UID. Then they will be in the proper OD groups and get group policy as normal.

I hope that makes sense. Also, only accounts that have a UID higher than 1000+ are directory accounts, so I want to ignore all accounts with an UID less than 999.

So far here is my script I wrote, and like I mentioned, I am completely self taught and have no formal education in programming.

Code:

#!/bin/bash



#

# First we need to grab the synchronnized user account

# All directory accounts will have a UID greater than 1000

# All local accounts will have a UID of 500 to 999

# We only want to move accounts with UID of greater than 1000

# This will also exclude the shared folder

#



userlist=`/bin/ls /Users | /usr/bin/grep -v "^Shared"`



checkuid=`/usr/bin/dscl . read /Users/$i UniqueID | /usr/bin/awk '/ID/ { print $2 }'`



for i in $userlist ; do



if (( $checkuid > 999 )) 



    then /bin/mkdir /Users/$i.bu ;; /bin/cp -R /Users/$i /Users/$i.bu



    else /bin/echo "$i is not a directory user"



fi



done



#

# now the tricky part we need to verify what was done, is done then delete the old account

# so the user can sync the new account with the proper UID

#



homefolder=`/bin/ls -l $userlist/`



backup="/Users/$userlist.bu"



# now compare contents



if [[ $homefolder == $backup ]]



    then /usr/sbin/dscl . -delete /Users/$userlist



    else /bin/echo "Contents do not match, exiting"



    exit 1



fi



done



#

# Now remove the contents of those user accounts by comparing what has 

# .bu on the end

#



removeuser=`/bin/ls /Users | /usr/bin/grep ".bu"



/bin/rm -rf /Users/$removeuser



exit 0

Now the second script will just copy that data back after the user logs in again and resynchronizes their PHD with the proper UID. Then the last bit will apply ownership to that new UID and exit.

A few questions....

1) Should I have used an integer comparison when comparing the current UID to it being greater than 999?

2) There are probably some issues with this script as I have not tested it out fully yet, because I was wanting some feed back to see if there was a better way to go. Is there a more efficient way to go about this?

Thanks for anyone who can help, it is greatly appreciated.

Tom

help with script

dsravan — Fri, 20 Nov 2009 21:05:29 GMT

I have a file which is comma delimited. I have around 35 fields in each row. The problem is in the 21st field I have data separated by �;� I need the data in only the 21st field separated by �;� to be replaced by �|�. This is a very big file and I need something in awk that its much faster than regular commands. Can anybody tell exactly how I can only achieve this for 21st field.

How to Pull out multiple files from DB table and redirect all those files to a differetn directory?

ss3944 — Fri, 20 Nov 2009 20:54:24 GMT

Hi everyone!!

I have a database table, which has file_name as one of its fields.
Example:

File_ID File_Name Directory Size
0001 UNO_1232 /apps/opt 234
0002 UNO_1234 /apps/opt 788
0003 UNO_1235 /apps/opt 897
0004 UNO_1236 /apps/opt 568

I have to extract all the files whose size is greater than 500 and send all those files to a different directory /apps/opt/new

How do I loop through the table and send all those file_names, which match the size criteria to a different directory?

Thanks in advance..
Please do help me out, as this is very urgent for me.

finding files with unicode chars in the filename

mshallop — Fri, 20 Nov 2009 20:00:13 GMT

I'm trying to check-in a repository to svn -- but the import is failing because some files waaaay down deep in some graphics-library folder are using unicode characters in the file name - which are masked using the ls command but picked up when piping output to more:

[root@dev-www-02 emoticons]# ls -l 1914*
-rwxrwxr-x 1 apache apache 1398 Dec 9 2008 1914OdiN_Presenta_-_o_?.bmp
[root@dev-www-02 emoticons]# ls -l 1914* | more
-rwxrwxr-x 1 apache apache 1398 Dec 9 2008 1914OdiN_Presenta_-_o_�.bmp

Optimally, I'd like to be able to search and quarantine these files into a directory out of the repository tree, but I'm brickwalling :mad: trying to figure out the search string...

I've tried variants of grep '^[A-Za-z0-9]' but can't turn up the right combination.

tia...

Insert Text Between Html Tags Sed / Awk ?

abacus — Fri, 20 Nov 2009 14:07:19 GMT

Hello, I have searched for the title stringon this post on this site as well as on google with no luck. I find similar examples, however I am truly having a tough time resolving the issue that I am faced with.
I have multiple html files that I need to change the title on. These are simple html text files that look like this:

Input File:

Code:

oldtitle



this is a test page for this example.

Desired Output:

Code:

newtitle



this is a test page for this example.

I have tried something like this. However I think that I am over thinking this.

Code:

sed -e "s/$]*>$[^<]*$<.*$/\newtitle\2/g" file1.html > newfile.html

Please Advise,

Abacus

remove last 4 characters from a string

josslate — Fri, 20 Nov 2009 13:53:18 GMT

I'm tring to remove the last 4 characters from strings in a file i.e.

cat /tmp/test
iwishicouldremovethis
icouldremovethos

so i would end up with the last 4 characters from each of the above i.e.
this
thos

I thought of using cut -c ... but I'm not sure how many characters will precede the important "Last 4 characters i need".

Thanks for your help!

Keeping " in string variable

f_o_555 — Fri, 20 Nov 2009 12:57:39 GMT

Hi again,
in my bash script I have several variable strings like in an array

Code:

STRING_NAME[1]="qqq qqq qqq"

STRING_NAME[2]="www www www"

STRING_NAME[3]="eee eee eee"

This strings are passed to another program as

Code:

${STRING_NAME[$J]}

The problem is the program doesn't recognize the whole string

Code:

"qqq qqq qqq"

but

three time

Code:

qqq

Any help? Thanks
Sarah

Shell script problem

krishntiwary — Fri, 20 Nov 2009 12:07:16 GMT

I have one shell script that is used to load data in database. Can I run same shell script to load multiples files or folders on same database.

How to check if export DISPLAY is set or not?

smarty86 — Fri, 20 Nov 2009 11:49:12 GMT

Hi All,

I use "export DISPLAY=same_host:0.0" to set my export DISPLAY and it is working fine for me..

Problem here is I have developed a script for which i should run export DISPLAY prior to running my script....

so my script should check whether export DISPLAY is set or not.. if set then it should continue else it should give error.. Please Help me

invaluable resource for shell one liners and more

h@foorsa.biz — Fri, 20 Nov 2009 11:44:04 GMT

Hi all,
This link might help whom is seeking a quick solutions for thier daily shell needs.

linkAll commands | commandlinefu.com

How to match a exact word in a variable ????

vijaysachin — Fri, 20 Nov 2009 11:40:02 GMT

Hi All,

Str="online maintenance"
if [ $str == "online" ] then perform some action

I know the above comparison is wrong ..... Actually I am very new to this solaris..

I want to check for online in a variable and perform some action based on that How can I do it?

Help to merge multiple .sql files

snvniranjanrao — Fri, 20 Nov 2009 10:37:31 GMT

Hello all,

I have a shell script that uses multiple .sql files. These .sql files mainly contain Oracle SQL queries to pull fields from the database. I want to place all the contents of these .sql files in one .sql file and have some parameter sent based on which the respective block or query would gets executed accordingly.

Please help me know if this is feasible and how this can be accomplished. Please let me know if this is not clear or further clarification is required. Thanks in advance for your help.

Thanks,
Niranjan

New page character 0x0C vs 0x0D

f_o_555 — Fri, 20 Nov 2009 10:21:48 GMT

Is there a way to substitute ina file a 0x0C (new page!) character into a 0x0D (carriage return)?

Thank you,
Sarah

Format data to columns addind spaces

old_mike — Fri, 20 Nov 2009 10:01:11 GMT

Hi all,

I have a problem to format data from different database queries into one look. The input data are as follows, every line has the same number of values but a different number of characters:

Code:

adata, bdata,     cdata,    ddata

fffdata,  gdata,      hdata,    idata

jdata,    kdata,   ldata,   mdaata

What I want is a formatted output with the same number of characters in each line:

Code:

adata,   bdata, cdata, ddata

fffdata, gdata, hdata, idata

jdata,   kdata, ldata, mdaata

I�m useing Redhat-Linux and ksh.

Thanks for your support!

Extracting N lines match number X of a pattern

f_o_555 — Fri, 20 Nov 2009 09:51:11 GMT

Hi All,
as the title says I need to extract N lines after match number X of a pattern.
e.g.
111
xxx
xxx
111
yyy
yyy
111
www
www
111
zzz
zzz

I would like to extract the two lines after the second 111 occurrence.

I tried with grep but I didn't find any options to do that.
Any help?
Thank you,
Sarah