Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Export lines that have first entry repeated 5 times or above Post 302987007 by MadeInGermany on Saturday 3rd of December 2016 11:11:23 AM
Old 12-03-2016
Simply add an And condition for print.
A commented multi-liner
Code:
awk -F, '
# first file read (NR equals FNR)
# store the number of $1 occurrences in A[ ]
(FNR==NR) { A[$1]++; next }
# second file read
# if >= 3 occurences and other conditions then print
(A[$1]>=3 && $1~/JWR|yyy|zzz/) { print $0, A[$1] }
' OFS=,   file  file

$1~/JWR|yyy|zzz/ is more compact than ($1~/JWR/ || $1~/yyy/ || $1~/zzz/)
This User Gave Thanks to MadeInGermany For This Post:
 

10 More Discussions You Might Find Interesting

1. Solaris

Huge (repeated Entry) text files

Somebody HELP! I have a huge log file (TEXT) 76298035 bytes. It's a logfile of IMEIs and IMSIS that I get from my EIR node. Here is how the contents of the file look like: 000000, 1 33016382000913 652020100423994 1 33016382002353 652020100430743 1 33017035101003 652020100441736... (4 Replies)
Discussion started by: axl
4 Replies

2. UNIX for Dummies Questions & Answers

how many times does this repeated sequence exist

need a script to determine daily how many times does the below repeated sequence exist in a log file, and if it shows failure to connect in the same file 200 PORT Command successful. 150 Opening BINARY mode data connection for rgr016.daily.0305. 226 Transfer complete. local: rgr016.daily.0306... (3 Replies)
Discussion started by: lichento
3 Replies

3. UNIX for Dummies Questions & Answers

To get the total of how many times the pattern is repeated.

Hi, I need the total of how many times the pattern is being repeated in a particular file. I tried with grep as below, but no go. grep -c best sample Contents of Sample file: ----------------------- This is the best site I have never come across. The best one indeed. Very best... (8 Replies)
Discussion started by: venkatesht
8 Replies

4. UNIX for Dummies Questions & Answers

Extracting column if above certain values and repeated over a number of times continuously

Hi I am new to the forum and would like to ask: i have a file in form with thousands of column id.1 A01 A01 A68 A68 id.2 A5 A5 A3 A3 1001 0 0 0.136 0.136 1002 0 0 0.262 0.183 1003 0 0 0.662 0.662 1004 0 0 ... (9 Replies)
Discussion started by: newbeeuk
9 Replies

5. Shell Programming and Scripting

Finding most repeated entry in a column and giving the count

Please can you help in providing the most repeated entry in the 2nd column and give its count Here is an input file 1, This , is a forum 2, This , is a forum 1, There , is a forum 2, This , is not right Here the most repeated entry is "This" and count is 3 So output... (4 Replies)
Discussion started by: necro98
4 Replies

6. Shell Programming and Scripting

remove brackets and put it in a column and remove repeated entry

Hi all, I want to remove the remove bracket sign ( ) and put in the separate column I also want to remove the repeated entry like in first row in below input (PA156) is repeated ESR1 (PA156) leflunomide (PA450192) (PA156) leflunomide (PA450192) CHST3 (PA26503) docetaxel... (2 Replies)
Discussion started by: manigrover
2 Replies

7. Shell Programming and Scripting

How to print the lines which are repeated 3 times in a file?

Hello All, I have a file which has repeated lines. I want to print the lines which are repeated three times. Please help. (3 Replies)
Discussion started by: ailnilanjan
3 Replies

8. Homework & Coursework Questions

Accepting a phrase and counting the number of times that it is repeated in a specific website

1. The problem statement, all variables and given/known data: Develop a shell script that accepts a phrase and counts the number of times that it is repeated in a specific website. Note: Im not sure if it's the whole website, or just a specific page but im guessing its thewhole website. ... (2 Replies)
Discussion started by: Zakerii
2 Replies

9. UNIX for Dummies Questions & Answers

Append no of times a column is repeated at the end

Hi folks, Iam working on a bash script, i need to print how many times column 2 repeated at the end of each line. Input.txt COL1 COL2 COL3 COL4 1 XX 45 N 2 YY 34 y 3 ZZ 44 N 4 XX 89 Y 5 XX 45 N 6 YY 84 D 7 ZZ 22 S Output.txt COL1 COL2 COL3 COL4 COL5 1 XX 45 N 3 2 YY 34... (6 Replies)
Discussion started by: tech_frk
6 Replies

10. Shell Programming and Scripting

Remove duplicate lines which has been repeated 4 times

Remove duplicate lines which has been repeated 4 times attached test.txt below command tried and not getting expect output. for i in `cat test.txt | uniq` do num=`cat test.txt | grep $i | wc -l` echo $i $num done test.txt ... (17 Replies)
Discussion started by: Kalia
17 Replies
xdg-user-dirs-update(1) 					   User Commands					   xdg-user-dirs-update(1)

NAME
xdg-user-dirs-update - Create and configure default desktop user directories. SYNOPSIS
xdg-user-dirs-update [--force] [--dummy-output path] [--set DIR path] DESCRIPTION
xdg-user-dirs-update is used to create the default desktop user directories such as : Desktop Download Templates Public Documents Music Pictures Videos In general this is run at user login to an XDG compatible desktop such as GNOME or KDE. The directories are created using the user's locale - and this information is then stored in the ${HOME}/.config/user-dirs.dirs file such that if the user then changes the locale they log in as, the directories will still be referenced correctly, but will remain in the original locale unless you run the xdg-user-dirs-update com- mand with the --force option. The default names used to create these directories are configured in the system configuration file /etc/xdg/user-dirs.defaults. Other configuration is stored in the file /etc/xdg/user-dirs.conf. In this file you can disable this functionality system-wide and define what encoding is used in the creation of the directories. By default this is UTF-8 since this is the main encoding used in the desktops. Continuous monitoring is done by the file manager - nautilus in GNOME - and if these directories are renamed or removed nautilus will update the user's configuration file to reflect this change. OPTIONS
--force Force an update of the directories to the current locale. --dummy-output path Simulate the creation of the user configuration file and write to the specified path. --set DIR path Update the user's configuration changing the DIR to point to the specified path. Valid desktop directories (DIR) are: DESKTOP DOWNLOAD TEMPLATES PUBLICSHARE DOCUMENTS MUSIC PICTURES VIDEOS FILES
The following files are used by this application: /usr/bin/xdg-user-dirs-update XDG User Directory management utility. /etc/xdg/user-dirs.conf Used to configure the operation of xdg-user-dirs-update. Can be used to totally disable the the creation of these directories and also to define what locale encoding should be used by default - by default this is UTF-8 which is the preferred encoding used by the GNOME Virtual File System layer. /etc/xdg/user-dirs.defaults Used to configure the default locations that xdg-user-dirs-update will create/manage relative to the user's ${HOME}. ${HOME}/.config/user-dirs.dirs Location of the user-specific configuration including the current list of directories and what they map to. ${HOME}/.config/user-dirs.locale Contains the name of the locale (excluding encoding) that was used to create the initial set of directories. EXAMPLES
Example 1: Determine what may happen if you force an update. % xdg-user-dirs-update --force --dummy-output /tmp/dummy.out Moving DOWNLOAD directory from Downloads to Download Also will write output like the following to /tmp/dummy.out: # This file is written by xdg-user-dirs-update # If you want to change or add directories, just edit the line you're # interested in. All local changes will be retained on the next run # Format is XDG_xxx_DIR="$HOME/yyy", where yyy is a shell-escaped # homedir-relative path, or XDG_xxx_DIR="/yyy", where /yyy is an # absolute path. No other format is supported. # XDG_DESKTOP_DIR="$HOME/Desktop" XDG_DOWNLOAD_DIR="$HOME/Download" XDG_TEMPLATES_DIR="$HOME/Templates" XDG_PUBLICSHARE_DIR="$HOME/Public" XDG_DOCUMENTS_DIR="$HOME/Documents" XDG_MUSIC_DIR="$HOME/Music" XDG_PICTURES_DIR="$HOME/Pictures" XDG_VIDEOS_DIR="$HOME/Videos" Example 2: Change location of my pictures. % xdg-user-dirs-update --set PICTURES /home/user/Documents/MyPictures Modifies the ${HOME}/.config/user-dirs.dirs file to have the line: ... XDG_PICTURES_DIR="$HOME/Documents/MyPictures" ... ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWxdg-user-dirs | +-----------------------------+-----------------------------+ |Interface stability |Uncommitted | +-----------------------------+-----------------------------+ SEE ALSO
More information can be found at: http://www.freedesktop.org/wiki/Software/xdg-user-dirs xdg-user-dirs-gtk-update(1), xdg-user-dir(1), attributes(5) NOTES
Written by Darren Kenny, Sun Microsystems Inc, 2008 SunOS 5.11 03 Apr 2008 xdg-user-dirs-update(1)
All times are GMT -4. The time now is 03:14 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy