10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi Gurus,
I need to remove duplicate line in file and update TRAILER (last line) record count. the file is comma delimited, field 2 is key to identify duplicated record.
I can use below command to remove duplicated. but don't know how to replace last line 2nd field to new count.
awk -F","... (11 Replies)
Discussion started by: green_k
11 Replies
2. Shell Programming and Scripting
Dear all,
How can I remove duplicated column in a text file?
Input:
LG10_PM_map_19_LEnd 1000560 G AA AA AA AA AA GG
LG10_PM_map_19_LEnd 1005621 G GG GG GG AA AA GG
LG10_PM_map_19_LEnd 1011214 A AA AA AA AA GG GG
LG10_PM_map_19_LEnd 1011673 T TT TT TT TT CC CC... (1 Reply)
Discussion started by: huiyee1
1 Replies
3. Shell Programming and Scripting
In a folder I'll several times daily receive new files that I want to combine into one big file, without any duplicate rows.
The file name in the folder will look like e.q:
MissingData_2014-08-25_09-30-18.txt
MissingData_2014-08-25_09-30-14.txt
MissingData_2014-08-26_09-30-12.txt
The content... (9 Replies)
Discussion started by: Bergans
9 Replies
4. Shell Programming and Scripting
Hi, if i have a file like this:
Query=1
a
a
b
c
c
c
d
Query=2
b
b
b
c
c
e
.
.
. (7 Replies)
Discussion started by: the_simpsons
7 Replies
5. Shell Programming and Scripting
Hi,
I am trying to use awk to remove all rows where the first 4 fields are duplicates. e.g. in the following data lines 6-9 would be removed, leaving one copy of the duplicated row (row 5)
Borgarhraun FH9822 ol24 FH9822_ol24_m20 ol Deformed c
Borgarhraun FH9822 ol24 ... (3 Replies)
Discussion started by: tomahawk
3 Replies
6. Shell Programming and Scripting
Input file:
hcmv-US25-2-3p hsa-3160-5
hcmv-US33 hsa-47
hcmv-UL70-3p hsa-4508
hcmv-UL70-3p hsa-4486
hcms-US25 hsa-360-5
hcms-US25 hsa-4
hcms-US25 hsa-458
hcms-US25 hsa-44812
.
.
Desired Output file:
hcmv-US25-2-3p hsa-3160-5
hcmv-US33 hsa-47
hcmv-UL70-3p hsa-4508
hsa-4486... (3 Replies)
Discussion started by: perl_beginner
3 Replies
7. UNIX for Dummies Questions & Answers
Hii i have a file with data as shown below. Here i need to remove duplicates of the rows in such a way that
it just checks for 2,3,4,5 column for duplicates.When deleting duplicates,retain largest row i.e with many columns with values should be selected.Then it must remove duplicates such that by... (11 Replies)
Discussion started by: reva
11 Replies
8. Shell Programming and Scripting
hi all,
i have a file contain multicolumns, this file is sorted by col2 and col3.
i want to remove the duplicated columns if the col2 and col3 are the same in another line.
example
fileA
AA BB CC DD
CC XX CC DD
BB CC ZZ FF
DD FF HH HH
the output is
AA BB CC DD
BB CC ZZ FF... (6 Replies)
Discussion started by: kamel.seg
6 Replies
9. Shell Programming and Scripting
Hi
Just wondering whether or not I can remove duplicated lines without sort
For example, I use the command who, which shows users who are logging on. In some cases, it shows duplicated lines of users who are logging on more than one terminal.
Normally, I would do
who | cut -d" " -f1 |... (6 Replies)
Discussion started by: lalelle
6 Replies
10. Shell Programming and Scripting
Hi,
If i have a file with xml format, i would like to remove duplicated records and save to a new file. Is it possible...to write script to do it? (8 Replies)
Discussion started by: happyv
8 Replies
scdpm(1M) System Administration Commands scdpm(1M)
NAME
scdpm - manage disk path monitoring daemon
SYNOPSIS
scdpm [-a] {node | all}
scdpm -f filename
scdpm -m {[node | all][:/dev/did/rdsk/]dN | [:/dev/rdsk/]cNtXdY | all}
scdpm -n {node | all}
scdpm -p [-F] {[node | all][:/dev/did/rdsk/]dN | [/dev/rdsk/]cNtXdY | all}
scdpm -u {[node | all][:/dev/did/rdsk/]dN | [/dev/rdsk/]cNtXdY | all}
DESCRIPTION
Note -
Beginning with the Sun Cluster 3.2 release, Sun Cluster software includes an object-oriented command set. Although Sun Cluster software
still supports the original command set, Sun Cluster procedural documentation uses only the object-oriented command set. For more infor-
mation about the object-oriented command set, see the Intro(1CL) man page.
The scdpm command manages the disk path monitoring daemon in a cluster. You use this command to monitor and unmonitor disk paths. You can
also use this command to display the status of disk paths or nodes. All of the accessible disk paths in the cluster or on a specific node
are printed on the standard output. You must run this command on a cluster node that is online and in cluster mode.
You can specify either a global disk name or a UNIX path name when you monitor a new disk path. Additionally, you can force the daemon to
reread the entire disk configuration.
You can use this command only in the global zone.
OPTIONS
The following options are supported:
-a
Enables the automatic rebooting of a node when all monitored disk paths fail, provided that the following conditions are met:
o All monitored disk paths on the node fail.
o At least one of the disks is accessible from a different node in the cluster.
You can use this option only in the global zone.
Rebooting the node restarts all resource and device groups that are mastered on that node on another node.
If all monitored disk paths on a node remain inaccessible after the node automatically reboots, the node does not automatically reboot
again. However, if any monitored disk paths become available after the node reboots but then all monitored disk paths again fail, the
node automatically reboots again.
You need solaris.cluster.device.admin role-based access control (RBAC) authorization to use this option. See rbac(5).
-F
If you specify the -F option with the -p option, scdpm also prints the faulty disk paths in the cluster. The -p option prints the cur-
rent status of a node or a specified disk path from all the nodes that are attached to the storage.
-f filename
Reads a list of disk paths to monitor or unmonitor in filename.
You can use this option only in the global zone.
The following example shows the contents of filename.
u schost-1:/dev/did/rdsk/d5
m schost-2:all
Each line in the file must specify whether to monitor or unmonitor the disk path, the node name, and the disk path name. You specify
the m option for monitor and the u option for unmonitor. You must insert a space between the command and the node name. You must also
insert a colon (:) between the node name and the disk path name.
You need solaris.cluster.device.admin RBAC authorization to use this option. See rbac(5).
-m
Monitors the new disk path that is specified by node:diskpath.
You can use this option only in the global zone.
You need solaris.cluster.device.admin RBAC authorization to use this option. See rbac(5).
-n
Disables the automatic rebooting of a node when all monitored disk paths fail.
You can use this option only in the global zone.
If all monitored disk paths on the node fail, the node is not rebooted.
You need solaris.cluster.device.admin RBAC authorization to use this option. See rbac(5).
-p
Prints the current status of a node or a specified disk path from all the nodes that are attached to the storage.
You can use this option only in the global zone.
If you also specify the -F option, scdpm prints the faulty disk paths in the cluster.
Valid status values for a disk path are Ok, Fail, Unmonitored, or Unknown.
The valid status value for a node is Reboot_on_disk_failure. See the description of the -a and the -n options for more information
about the Reboot_on_disk_failure status.
You need solaris.cluster.device.read RBAC authorization to use this option. See rbac(5).
-u
Unmonitors a disk path. The daemon on each node stops monitoring the specified path.
You can use this option only in the global zone.
You need solaris.cluster.device.admin RBAC authorization to use this option. See rbac(5).
EXAMPLES
Example 1 Monitoring All Disk Paths in the Cluster Infrastructure
The following command forces the daemon to monitor all disk paths in the cluster infrastructure.
# scdpm -m all
Example 2 Monitoring a New Disk Path
The following command monitors a new disk path.All nodes monitor /dev/did/dsk/d3 where this path is valid.
# scdpm -m /dev/did/dsk/d3
Example 3 Monitoring New Disk Paths on a Single Node
The following command monitors new paths on a single node. The daemon on the schost-2 node monitors paths to the /dev/did/dsk/d4 and
/dev/did/dsk/d5 disks.
# scdpm -m schost-2:d4 -m schost-2:d5
Example 4 Printing All Disk Paths and Their Status
The following command prints all disk paths in the cluster and their status.
# scdpm -p
schost-1:reboot_on_disk_failure enabled
schost-2:reboot_on_disk_failure disabled
schost-1:/dev/did/dsk/d4 Ok
schost-1:/dev/did/dsk/d3 Ok
schost-2:/dev/did/dsk/d4 Fail
schost-2:/dev/did/dsk/d3 Ok
schost-2:/dev/did/dsk/d5 Unmonitored
schost-2:/dev/did/dsk/d6 Ok
Example 5 Printing All Failed Disk Paths
The following command prints all of the failed disk paths on the schost-2 node.
# scdpm -p -F all
schost-2:/dev/did/dsk/d4 Fail
Example 6 Printing the Status of All Disk Paths From a Single Node
The following command prints the disk path and the status of all disks that are monitored on the schost-2 node.
# scdpm -p schost-2:all
schost-2:reboot_on_disk_failure disabled
schost-2:/dev/did/dsk/d4 Fail
schost-2:/dev/did/dsk/d3 Ok
EXIT STATUS
The following exit values are returned:
0 The command completed successfully.
1 The command failed completely.
2 The command failed partially.
Note -
The disk path is represented by a node name and a disk name. The node name must be the host name or all. The disk name must be the global
disk name, a UNIX path name, or all. The disk name can be either the full global path name or the disk name: /dev/did/dsk/d3 or d3. The
disk name can also be the full UNIX path name: /dev/rdsk/c0t0d0s0.
Disk path status changes are logged with the syslogd LOG_INFO facility level. All failures are logged with the LOG_ERR facility level.
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWsczu |
+-----------------------------+-----------------------------+
|Stability |Evolving |
+-----------------------------+-----------------------------+
SEE ALSO
Intro(1CL), cldevice(1CL), clnode(1CL), attributes(5)
Sun Cluster System Administration Guide for Solaris OS
Sun Cluster 3.2 22 Jun 2006 scdpm(1M)