Sponsored Content
Full Discussion: Move Large files
Top Forums UNIX for Dummies Questions & Answers Move Large files Post 302099901 by jim mcnamara on Thursday 14th of December 2006 02:56:48 PM
Old 12-14-2006
Code:
for i in f1 f2 f3 f4 f5 f6 f7 f8 f9 f10 f11 f12 f13 f14 f15 f16
do
   mv $i /destination/"$i"  &
done
wait

 

9 More Discussions You Might Find Interesting

1. AIX

Large file move from one server to another

I Have two AIX 5.3 servers. I want to move a 45GB file from Server B to Server A. Can I achieve this with using Tivoli? Or how could I achieve this, by mounting a directory from server B to server A? Any help apreciated! (14 Replies)
Discussion started by: tfort73
14 Replies

2. Shell Programming and Scripting

Divide large data files into smaller files

Hello everyone! I have 2 types of files in the following format: 1) *.fa >1234 ...some text... >2345 ...some text... >3456 ...some text... . . . . 2) *.info >1234 (7 Replies)
Discussion started by: ad23
7 Replies

3. Solaris

How to safely copy full filesystems with large files (10Gb files)

Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS. I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies

4. AIX

Large Data move from Win to AIX

Hi All, I have a requirement to move a large amount of data *approx 160 GB* from a windows formatted SAN to AIX. The data is made up of several hundred thousand small files. Does anyone have a recommendation for the best tool or best procedure for this? Regards, Neil (2 Replies)
Discussion started by: stewartna77
2 Replies

5. UNIX for Dummies Questions & Answers

Move same files and issue ls -al command on remaining files

I know I can use an ls -l junk1 command to get a listing of all files in the directory junk1, but I was wondering how I'd go about going through the files in junk1 in a for-in loop and issuing the ls -l command on them one by one. This is what I have so far: for file in $(ls -a $1) do ls... (1 Reply)
Discussion started by: Trinimini
1 Replies

6. Shell Programming and Scripting

Recursively move directories along with files/specific files

I would like to transfer all files ending with .log from /tmp and to /tmp/archive (using find ) The directory structure looks like :- /tmp a.log b.log c.log /abcd d.log e.log When I tried the following command , it movies all the log files... (8 Replies)
Discussion started by: frintocf
8 Replies

7. Shell Programming and Scripting

Move all files except sys date (today) files in Solaris 10

I want to move all files from one directory to another directory excluding today (sysdate files) on daily basis. file name is in pattern file_2013031801, file_2013031802 etc (2 Replies)
Discussion started by: khattak
2 Replies

8. Shell Programming and Scripting

SBATCH trinity for multiple files and rename/move the output files

Hey guys, I have wrote the following script to apply a module named "trinity" on my files. (it takes two input files and spit a trinity.fasta as output) #!/bin/bash -l #SBATCH -p node #SBATCH -A <projectID> #SBATCH -n 16 #SBATCH -t 7-00:00:00 #SBATCH --mem=128GB #SBATCH --mail-type=ALL... (1 Reply)
Discussion started by: @man
1 Replies

9. Shell Programming and Scripting

Move files with a certain suffix based on how many files are in another folder

Hello, First time poster. I am looking for a way to script or program the process of moving files from one folder to another, automatically, based on the count of files in the destination folder. I was thinking a shell script would work, but am open to the suggestions of the experts... (6 Replies)
Discussion started by: comtech
6 Replies
flow-tools-examples(1)					      General Commands Manual					    flow-tools-examples(1)

NAME
flow-tools-examples -- Example usage of flow-tools. EXAMPLE - Configuring Cisco IOS Router NetFlow is configured on each input interface, then global commands are used to specify the export destination. To ensure a consistant source address address Loopback0 is configured as the export source. ip cef distributed ip flow-export version 5 origin-as ip flow-export destination 10.0.0.100 5004 ip flow-export source Loopback0 interface Loopback0 ip address 10.1.1.1 255.255.255.255 interface FastEthernet0/1/0 ip address 10.0.0.1 255.255.255.0 no ip directed-broadcast ip route-cache flow ip route-cache distributed Many other options exist such as aggregated NetFlow and sampled NetFlow which are detailed at (link to URL http://www.cisco.com) . EXAMPLE - Configuring Cisco CatIOS Switch Some Cisco Catalyst switches support a different implementation of NetFlow that is performed on the supervisor. With the cache based for- warding model which is implemented in the Catalyst 55xx with Route Switch Module (RSM) and NetFlow Feature Card (NFFC), the RSM processes the first flow and the remaining packets in the flow are forwarded by the Supervisor. This is also implemented in the early versions of the 65xx with MSFC. The deterministic forwarding model used in the 65xx with MSFC2 do not use NetFlow to determine the forwarding path, the flow cache is only used for statistics as in the current IOS implementations. In all of of the above configurations flow exports arrive from both the RSM/MSFC and the Supervisor engines as distinct streams. In the worst cast the RSM exports in version 5 and the Supervisor exports in version 7. Fortunately flow-capture and flow-receive can sort all this out by processing flows from both sources and converting them to a common export format. The router side running IOS is configured identically to the example given above. The CatIOS NetFlow Data Export configuration follows: set mls flow full set mls nde version 7 set mls nde 10.0.0.1 9800 set mls nde enable When the 65xx is running in Native mode, from a users perspective the switch is only running IOS. More detailed examples can be found on Cisco's web site (link to URL http://www.cisco.com) . EXAMPLE - Configuring Juniper Router Juniper supports flow exports by the routing engine sampling packet headers and aggregating them into flows. Packet sampling is done by defining a firewall filter to accept and sample all traffic, applying that rule to the interface, then configuring the sampling forwarding option. interfaces { ge-0/3/0 { unit 0 { family inet { filter { input all; output all; } address 10.0.0.1/24; } } } firewall { filter all { term all { then { sample; accept; } } } } forwarding-options { sampling { input { family inet { rate 100; } } output { cflowd 10.0.0.100 { port 9800; version 5; } } } } Other options exist such as aggregated flows which are detailed at (link to URL http://www.juniper.net) . EXAMPLE - Network topology and flow.acl The network topology and flow.acl will be used for many of the examples that follow. Flows are collected and stored in /flows/R. ISP-A ISP-B + + + + IP=10.1.2.1/24 + + IP=10.1.1.1/24 ifIndex=2 + + ifIndex=1 interface=serial1/1 + + interface=serial0/0 ----- | R | Campus Router ----- + + IP=10.1.4.1/24 + + IP=10.1.3.1/24 ifIndex=4 + + ifIndex=3 interface=Ethernet1/1 + + interface=Ethernet0/0 + + Sales Marketing ip access-list standard sales permit 10.1.4.0 0.0.0.255 ip access-list standard not_sales deny 10.1.4.0 0.0.0.255 ip access-list standard marketing permit 10.1.3.0 0.0.0.255 ip access-list standard not_marketing deny 10.1.3.0 0.0.0.255 ip access-list standard campus permit 10.1.4.0 0.0.0.255 ip access-list standard campus permit 10.1.3.0 0.0.0.255 ip access-list standard not_campus deny 10.1.4.0 0.0.0.255 ip access-list standard not_campus deny 10.1.3.0 0.0.0.255 ip access-list standard evil_hacket permit host 10.6.6.6 ip access-list standard spoofer permit host 10.9.9.9 ip access-list standard multicast 224.0.0.0 15.255.255.255 EXAMPLE - Finding spoofed addresses A common problem on the Internet is the use of "spoofed" (addresses that are not assigned to an organization) for use in DoS attacks or compromising servers that rely on the source IP address for authentication. Display all flow records that originate from the campus and are sent to the Internet but are not using legal addresses. flow-cat /flows/R | flow-filter -Snot_campus -I1,2 | flow-print Summary of the destinations of the internally spoofed addresses sorted by octets. flow-cat /flows/R | flow-filter -Snot_campus -I1,2 | flow-stat -f8 -S2 Summary of the sources of the internally spoofed addresses sorted by flows. flow-cat /flows/R | flow-filter -Snot_campus -I1,2 | flow-stat -f9 -S1 Summary of the internally spoofed sources and destination pairs sorted by packets. flow-cat /flows/R | flow-filter -Snot_campus -I1,2 | flow-stat -f10 -S4 Display all flow records that originate external to the campus that have campus addresses. Many times these can be attackers trying to exploit host based authentication mechanisms like unix r* commands. Another common source is mobile clients which send packets with their campus addresses before obtaining a valid IP. flow-cat /flows/R | flow-filter -Scampus -i1,2 | flow-print Summary of the destinations of the externally spoofed addresses sorted by octets. flow-cat /flows/R | flow-filter -Scampus -i1,2 | flow-stat -f8 -S2 EXAMPLE - Locate hosts using or running services Find all SMTP servers active during the collection period that have established connections to the Internet. Summarize sorted by octets. flow-cat /flows/R | flow-filter -I1,2 -P25 | flow-stat -f9 -S2 Find all outbound NNTP connections to the Internet. Summarize with source and destination IP sorted by octets. flow-cat /flows/R | flow-filter -I1,2 -P119 | flow-stat -f10 -S3 Find all inbound NNTP connections to the Internet. Summarize with source and destination IP sorted by octets. flow-cat /flows/R | flow-filter -i1,2 -P119 | flow-stat -f10 -S3 EXAMPLE - Multicast usage Summarize Multicast S,G where sources are on campus. flow-cat /flows/R | flow-filter -Dmulticast -I1,2 | flow-stat -f10 -S3 Summarize Multicast S,G where sources are off campus. flow-cat /flows/R | flow-filter -Dmulticast -i1,2 | flow-stat -f10 -S3 EXAMPLE - Find scanners Find SMTP scanners with flow-dscan. This will also find SMTP clients which try to contact many servers. This behavior is characterized by a recent Microsoft worm. touch dscan.suppress.src dscan.suppress.dst flow-cat /flows/R | flow-filter -P25 | flow-dscan -b AUTHOR
Mark Fullmer maf@splintered.net SEE ALSO
flow-tools(1) flow-tools-examples(1)
All times are GMT -4. The time now is 01:43 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy