Sponsored Content
Top Forums Shell Programming and Scripting Skipped duplicated files from log Post 302800831 by hanson44 on Tuesday 30th of April 2013 03:39:11 PM
Old 04-30-2013
Quote:
unfortunately I can't (sort, uniq) that log to skip any duplication
Here is that answer again. Smilie
Code:
for file in * ; do
  dir=$( echo $file | cut -c1-8 )
  [ -d $dir ] || mkdir -p $dir
  echo "$dir was created"
  [ -f $file ] && mv $file $dir

  log=/user/$dir.log
  echo "Move $file $dir" >> $log
  sort -u $log > /tmp/temp.x
  mv /tmp/temp.x $log
done

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Log files duplicated themselves?

Something strange happend today, I checked in /var/log has usual and I noticed that I have a "messages.1", "cron.1" "maillog.1", and so on. This has never happened before so I just want to know if this is normal? Before I always had "messages" "maillog" and "cron" but now I have 2 of each file.... (4 Replies)
Discussion started by: DISTURBED
4 Replies

2. UNIX for Advanced & Expert Users

Can root ID be duplicated

Hi, I have the root id and the uid is always 0 for the root. Can i create another user say admin with the uid as 0? If so will it have the same privilege as that of user. Will there be any effect while doing this? lorcan (6 Replies)
Discussion started by: lorcan
6 Replies

3. Shell Programming and Scripting

remove duplicated columns

hi all, i have a file contain multicolumns, this file is sorted by col2 and col3. i want to remove the duplicated columns if the col2 and col3 are the same in another line. example fileA AA BB CC DD CC XX CC DD BB CC ZZ FF DD FF HH HH the output is AA BB CC DD BB CC ZZ FF... (6 Replies)
Discussion started by: kamel.seg
6 Replies

4. Shell Programming and Scripting

Shell Script - find, recursively, all files that are duplicated

Hi. I have a problem that i can't seem to resolve. I need to create a script that list all the files, that are found recursively, with the same name. For example if a file exists in more than one directory with the same name it list all the files that he founds with all the info. Could someone... (5 Replies)
Discussion started by: KitFisto
5 Replies

5. Shell Programming and Scripting

Makefile rule being skipped

I can't seem to get a rule in my Makefile to ever run... even if I change the rule to force make to re-enter the rule, or if I change the dependent files the rule depends on. Any ideas why the second rule is being ignored here? #MAKEFILES = $(DIRS:%=$(ROOT)/%/Makefile) #$(MAKEFILES):... (0 Replies)
Discussion started by: foureightyeast
0 Replies

6. UNIX for Dummies Questions & Answers

Duplicated UID

Hi folks! I need you help to discover what's the impact of a duplicated UID in an operating system. What's the meaning when someone put in different users the same UID? (3 Replies)
Discussion started by: phcostabh
3 Replies

7. Shell Programming and Scripting

Command getting skipped

Hi All, Its been a long time!!!!!! Having one problem in our live server.... we have perl code which runs every day for almost 15 to 18hrs process and it creates almost 150 to 200 sub process (arc get) sequentially. However in which randomly one or few of the process getting skipped. But... (2 Replies)
Discussion started by: Shahul
2 Replies

8. Shell Programming and Scripting

How to remove duplicated lines?

Hi, if i have a file like this: Query=1 a a b c c c d Query=2 b b b c c e . . . (7 Replies)
Discussion started by: the_simpsons
7 Replies

9. Shell Programming and Scripting

Merge files and remove duplicated rows

In a folder I'll several times daily receive new files that I want to combine into one big file, without any duplicate rows. The file name in the folder will look like e.q: MissingData_2014-08-25_09-30-18.txt MissingData_2014-08-25_09-30-14.txt MissingData_2014-08-26_09-30-12.txt The content... (9 Replies)
Discussion started by: Bergans
9 Replies

10. Shell Programming and Scripting

Join files, omit duplicated records from one file

Hello I have 2 files, eg more file1 file2 :::::::::::::: file1 :::::::::::::: 1 fromfile1 2 fromfile1 3 fromfile1 4 fromfile1 5 fromfile1 6 fromfile1 7 fromfile1 :::::::::::::: file2 :::::::::::::: 3 fromfile2 5 fromfile2 (4 Replies)
Discussion started by: CHoggarth
4 Replies
JH_SETUPENVIRONMENT(1)						    Javahelper						    JH_SETUPENVIRONMENT(1)

NAME
jh_setupenvironment - Prepares a build environment to compile an eclipse feature. SYNOPSIS
jh_setupenvironment [debhelperoptions] [--pde-build-dir=dir] [copy[...]] DESCRIPTION
jh_setupenvironment is a javahelper program that handles creating an environment for building an eclipse feature. It does not setup an orbit dir (use jh_generateorbitdir for that). It will copy files specified in debian/eclipse.environment as well as those given on command line into the environment dir. If no files are given per command line and the environment file is not present (or is empty), it will default to "org.eclipse.*" FILES
debian/eclipse.environment List of file- and directory glob patterns to copy into the build environment. OPTIONS
--pde-build-dir=dir Specifies where the environment should be or is placed. --clean If passed, jh_setupenvironment will clean up the build environment. When cleaning jh_setupenvironment will not record itself in the debhelper log to avoid confusing dh, when it has to use the log to trace where it was. EXAMPLE
jh_setupenvironment org.eclipse.* debian/*.properties Will clone all files and folders starting with "org.eclipse." and all property files in the debian-folder and put them into the environment. SEE ALSO
debhelper(7) This program is a part of javahelper and uses debhelper as backend. There are also tutorials in /usr/share/doc/javahelper. AUTHOR
Niels Thykier <niels@thykier.net> COPYRIGHT AND LICENSE
Copyright 2010 by Niels Thykier This tool is free software; you may redistribute it and/or modify it under the terms of GNU GPL 2. 0.43 2011-02-17 JH_SETUPENVIRONMENT(1)
All times are GMT -4. The time now is 09:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy