Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Sort file data according to a custom list of string
Top Forums Shell Programming and Scripting Sort file data according to a custom list of string Post 303042947 by mohtashims on Monday 13th of January 2020 05:04:26 AM
Old 01-13-2020
Quote:
Originally Posted by RudiC
awk OK? Try
Code:
awk -v"IPL=$iplist" '
BEGIN           {for (MX=n=split(IPL, T, ","); n; n--) IPS[T[n]] = n
                }
$1 in IPS       {SORTC = IPS[$1]
                 DONE[$1] = 1
                 CNT = 0
                }
                {print SORTC, ++CNT, $0
                }
END             {for (i in IPS) if (!DONE[i]) print IPS[i], 1, i, ORS IPS[i], 2
                }
' OFS="\t" file | sort -n | cut -f3-

awk often errors with too long string message hence would appreciate non seek solution. Also if the solution is on the lines of the code i shared it would be really great.
Last edited by mohtashims; 01-13-2020 at 07:12 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

script to sort a string of numerical data in set fields

So, I will be working with someone and basically we are trying to build a form that is submitted most likely via the web and the data is just a string of numbers. like: 19383882872201110929282821818182827349190102837364718191001932873711 Now, each number is part of a numerical value of... (4 Replies)
Discussion started by: tlarkin
4 Replies

2. Shell Programming and Scripting

Sort a big data file

Hello, I have a big data file (160 MB) full of records with pipe(|) delimited those fields. I`m sorting the file on the first field. I'm trying to sort with "sort" command and it brings me 6 minutes. I have tried with some transformation methods in perl but it results "Out of memory". I was... (2 Replies)
Discussion started by: rubber08
2 Replies

3. Shell Programming and Scripting

find string(s) in text file and nearby data, export to list help

Hi, So I'm kinda new to shell scripts and the like. I've picked up quite a bit of use from browsing the forums here but ran into a new one that I can't seem to find an answer for. I'm looking to parse/find a string AND the next 15 or so charachters that follow the string within a text file... (1 Reply)
Discussion started by: kar23me
1 Replies

4. UNIX for Dummies Questions & Answers

List directories with given string, sort by creation date

It is for HP-Unix B.11.31. Requirement: 1. List the directories, which directories name has given particular string. Example: Directories with name "Build" 2. On the output of 1. list the directories by creation date as sort order. I tried with; find . -type d -name "Build*" ... (3 Replies)
Discussion started by: Siva SQL
3 Replies

5. Shell Programming and Scripting

Populating File data with custom manipulation on file names

Hi, I am confused how to proceed firther please find the problem below: Input Files: DCIA_GEOG_DATA_OCEAN.TXT DCIA_GEOG_DATA_MCRO.TXT DCIA_GEOG_DATA_CVAS.TXT DCIA_GEOG_DATA_MCR.TXT Output File Name: MMA_RFC_GEOG_NAM_DIM_LOD.txt Sample Record(DCIA_GEOG_DATA_OCEAN.TXT):(Layout same for... (4 Replies)
Discussion started by: Arun Mishra
4 Replies

6. Shell Programming and Scripting

Sort help: How to sort collected 'file list' by date stamp :

Hi Experts, I have a filelist collected from another server , now want to sort the output using date/time stamp filed. - Filed 6, 7,8 are showing the date/time/stamp. Here is the input: #---------------------------------------------------------------------- -rw------- 1 root ... (3 Replies)
Discussion started by: rveri
3 Replies

7. UNIX for Dummies Questions & Answers

Custom sort on a column

Hello all, How do I achieve this? I have A, B and A/B in different variables in a file in col2. I want them to sort in such a way, that the variables appear together, and within a variable, the data is sorted in the order A,B and then A/B. If I sort on the second column, the order becomes A,... (6 Replies)
Discussion started by: senhia83
6 Replies

8. Shell Programming and Scripting

Sort data file by case

Hello, I'm trying to sort a large data file by the 3rd column so that all of the first words in the 3rd column that are in all uppercase appear before (or after) the non uppercase words. For example, Data file: xxx 12345 Rat in the house xxx 12345 CAT in the hat xxx 12345 Dog in the... (4 Replies)
Discussion started by: palex
4 Replies

9. Shell Programming and Scripting

Sort and Split file with header and custom name

Hi, I am using SUN SOLARIS (SunOS sun4v sparc SUNW, T5240). I have a huge data file with header and trailer. This file gets used into an ETL process. ETL skips the header record (which is the first record of the file) and loads the rest of the record. The file can be delimited (comma,... (5 Replies)
Discussion started by: Saanvi1
5 Replies

10. UNIX for Beginners Questions & Answers

How do I custom sort the files in a directory using the filenames in a text file.?

Hi all, (5 Replies)
Discussion started by: KMusunuru
5 Replies

LEARN ABOUT DEBIAN

prads2snort

PRADS2SNORT(1)							    networking							    PRADS2SNORT(1)

NAME

       prads2snort - Snort autotuning of Frag3 and Stream5

SYNOPSIS

	  prads2snort -i /var/log/prads-asset.log -o /etc/snort/host_attributes.xml -d linux -v

DESCRIPTION

       PRADS is a Passive Real-time Asset Detection System.

       It  passively  listen to network traffic and gathers information on hosts and services it sees on the network. This information can be used
       to map your network, letting you know what services and hosts are alive/used, or can be used together with your favorite IDS/IPS setup  for
       "event to host/service" correlation.

       Gathering  info about your hosts in real-time, will also let you detect assets that are just connected to the network for a short period of
       time, where a active network scan (nmap etc.) would take long time, and not common to run continually, hence missing the asset.

       The initial goal of implementing PRADS, was to make the host_attribute_table.xml for Snort (automatically).

       PRADS2SNORT is the tool that does this!

OPTIONS

       -i,--infile <file>
	      file to feed prads2snort.pl

       -o,--outfile <file>
	      file to write host_attribute data to (host_attribute.xml)

       -d,--default <os>
	      set Default OS if unknown (linux,bsd,macos,windows)

       -v, --verbose
	      prints out OS, frag, stream and confidence of asset

       -h, --help
	      this help message

       --version
	      show prads2snort.pl version

PROBLEMS

       1. Better mapping of less used apps to their correct snort attributes or drop them.

SEE ALSO

       o PRADS <http://prads.projects.linpro.no/>

       o p0f <http://lcamtuf.coredump.cx/p0f.shtml>

       o PADS <http://passive.sourceforge.net/>

       o Snort <http://snort.org>

       o Sguil <http://sguil.net>

       o Hogger <http://code.google.com/p/hogger/>

BUGS

       Report bugs here:

       o http://github.com/gamelinux/prads/issues

       For general questions:

       o http://projects.linpro.no/mailman/listinfo/prads-devel

       o http://projects.linpro.no/mailman/listinfo/prads-users

AUTHOR

       edwardfjellskaal@gmail.com

COPYRIGHT

       GPL

0.2								    2010-06-21							    PRADS2SNORT(1)
All times are GMT -4. The time now is 05:45 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy