Extract data from a file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Extract data from a file
# 1  
Old 04-14-2014
Extract data from a file

I have a text file that contains the following data. For example, aa.txt has some numbers. I need to extract the continuous numbers(minimum 3 numbers) from it.How can I do this with awk?

Code:
>aa.txt
31
35
36
37
38
39    
44
169
170
173
174
175
177
206 
>1a.txt
39
40
41
42
146
149
151

Desired output

Code:
>aa_1.txt
35
36 
37
38
39
>aa_2.txt
173
174
175
>1a.txt
39
40
41
42


Last edited by rahmanabdulla; 04-15-2014 at 07:40 AM..
# 2  
Old 04-14-2014
your example for aa_1.txt output shows more than 3 numbers.
You should be able to do something like

Code:
sort -n filename.txt | head -3

# 3  
Old 04-14-2014
Note:- 1a.txt shows 39 to 42 inclusive as consecutive.

This is 4 numbers, not 3 as you show.

Do you only want numbers beginning with 4x from 1a.txt?
If yes then this is contradiction in terms...

Please be more specific...

EDIT:
Also you have a space in the 2nd and 3rd series is this also a requirement?

Last edited by wisecracker; 04-14-2014 at 02:20 PM.. Reason: See above...
# 4  
Old 04-15-2014
Quote:
Originally Posted by wisecracker
Note:- 1a.txt shows 39 to 42 inclusive as consecutive.

This is 4 numbers, not 3 as you show.

Do you only want numbers beginning with 4x from 1a.txt?
If yes then this is contradiction in terms...

Please be more specific...

EDIT:
Also you have a space in the 2nd and 3rd series is this also a requirement?
You are right! I have corrected it. Space is not a requirement.
# 5  
Old 04-15-2014
An awk approach:
Code:
awk '
        BEGIN {
                c = 1
        }
        {
                A[NR] = $1
        }
        END {
                for ( i = 1; i < NR; i++ )
                {
                        d = A[i+1] - A[i]

                        F = FILENAME
                        sub ( /\.txt/, "_" c ".txt", F )

                        if ( d == 1 )
                        {
                                printf "%d\n", A[i] > F
                                f = 1
                        }

                        if ( f && d != 1 )
                        {
                                printf "%d\n", A[i] > F
                                f = 0
                                c += 1
                        }
                }
        }
' aa.txt

This User Gave Thanks to Yoda For This Post:
# 6  
Old 04-17-2014
python

Code:
arr=[]
with open("a.txt") as file:
 for line in file:
  line=line.replace("\n","")
  if not arr:
    arr.append(line)
  elif int(arr[-1])+1==int(line):
    arr.append(line)
  else:
    if len(arr)>=3:
        print("\n".join(arr))
        print("")
    arr=[line]        
    
if len(arr)>=3:
    print("\n".join(arr))

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract data from a file

Hi , I am having a file which is PIPE delimited like this : file.txt aus|start|10:00:00 nz|start|11:00:00 aus|end|10:10:00 us|start|10:00:00 nz|end|11:10:00 us|end|11:00:00 . . . I want to extract an output file like this based on start time and end time for each countries: (9 Replies)
Discussion started by: rohit_shinez
9 Replies

2. Shell Programming and Scripting

Extract data from a file

Hello All, I have a small xml file which looks like below: <Check:defaultval Val="crash" value="crash_report_0013&#xA;generate_check_0020 generate_check_0022&#xA;&#xA;This is where the fault is."/> <Check:defaultval Val="crash" value="crash_report_1001&#xA;generate_check_1001... (9 Replies)
Discussion started by: suvendu4urs
9 Replies

3. Shell Programming and Scripting

Extract header data from one file and combine it with data from another file

Hi, Great minds, I have some files, in fact header files, of CTD profiler, I tried a lot C programming, could not get output as I was expected, because my programming skills are very poor, finally, joined unix forum with the hope that, I may get what I want, from you people, Here I have attached... (17 Replies)
Discussion started by: nex_asp
17 Replies

4. Shell Programming and Scripting

Help with File Data Extract

Hello, Hope you are doing fine. I have been struggling with it for some time now and I would really appreciate your help. Following is file format: Currency,Name,Date, Term USD, ABC, 2011/11/11, T0, S1, S2, S3, S4 , , ,T1, 5.6, 2.3, 6.5, 4.5 , ... (5 Replies)
Discussion started by: srattani
5 Replies

5. Shell Programming and Scripting

Extract data based on match against one column data from a long list data

My input file: data_5 Ali 422 2.00E-45 102/253 140/253 24 data_3 Abu 202 60.00E-45 12/23 140/23 28 data_1 Ahmad 256 7.00E-45 120/235 140/235 22 data_4 Aman 365 8.00E-45 15/65 140/65 20 data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies

6. Shell Programming and Scripting

Extract Data from a file

I need to create a script to extract some specific data from a file. I locate the file using the find command: find . -name "rpbol*" -print | xargs grep -li Once I locate the file I need using the above command, I would like to extract some data from that file. The data is always located... (2 Replies)
Discussion started by: jevaba
2 Replies

7. Shell Programming and Scripting

extract data from file

I m new to shell scripting & i need a help.... i have file like.... Name := sachin address:=something phone:=111 ... Note: There might be or not space between Name & := and between := & sachin. I need to extract the data from each line of file as var1=Name value1=sachin same for... (13 Replies)
Discussion started by: ps_sach
13 Replies

8. Shell Programming and Scripting

extract data from file

Hello again, how do you extract data from a file? I have created a file with PID #s in it, I need to be able to take the PID from each line and kill it. How is this done? (4 Replies)
Discussion started by: raidzero
4 Replies

9. Shell Programming and Scripting

Extract data from file

Dear All , I am posting first time in this forum . Please ignore my mistakes . I am learning Unix and i need help to extract specific data from file . 1. I want to grep number of fails from log . The file contains "fails" word in line if test cases are failed . 2. The log contains... (20 Replies)
Discussion started by: getdpg
20 Replies

10. Shell Programming and Scripting

extract data from file

My file in ksh consists of message data of varying lengths (lines), separated with headers. I would like to find a string from this file, and print out the whole message data including the headers. my plan of attack is to search the strings, print the top header, and print the whole message... (2 Replies)
Discussion started by: apalex
2 Replies
Login or Register to Ask a Question