How to read file line by line in shell script?


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers How to read file line by line in shell script?
# 1  
Old 03-01-2020
How to read file line by line in shell script?

Hi Team,


I want to read a file line by line and print the data in multiple variables.


By using below script i am doing that but i want to increase the performance by using for loop Can someone let me know how to do that ?.


Below is my script:


Code:
ps aux  > /tmp/test
sed 1d  /tmp/test >  /tmp/test1

while IFS= read -r line;

do
USER=$(echo "$line"|awk  '{print $1}')

CPU_percentage=$(echo "$line"|awk  '{print $3}')


echo -e "{\"'PID'\":\"'"$PID"'\",\"'CPU_percentage'\":\"'"$CPU_percentage"'\"}"


done < /tmp/test1



How to use for loop for above script to get more performance from the shell script ?.

Moderator's Comments:
Mod Comment Please use code tags ext time, for your code and data, Thanks

Last edited by vbe; 03-01-2020 at 07:25 PM..
# 2  
Old 03-01-2020
Instead of reading the input a line at a time:
Code:
read a
while read a b c d e f
do
    echo USER= $a CPU= $c
done

run as

Code:
ps aux |script_above



You end up only reading the output of ps once instead of multiple times.
# 3  
Old 03-01-2020
Following along from jgt's suggestion you could try this all in one script:

Code:
ps aux | (
   # discard first (headings) line
   read a

   while read a b c rest
   do
       echo -e "{\"'PID'\":\"'"$a"'\",\"'CPU_percentage'\":\"'"$c"'\"}"
   done
)

# 4  
Old 03-02-2020
Hi
Try this
Code:
ps --no-headers -eo "{\"'PID'\":\"'%p'\",\"'CPU_percentage'\":\"'%C'\"}"

and so on if you need add fields

Last edited by nezabudka; 03-02-2020 at 02:02 AM..
This User Gave Thanks to nezabudka For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell script UNIX to read text file line by line

i have a text file as belows, it includes 2 columns, 1st is the column name, 2nd is the file_name data_file.txt column_name file_name col1 file1 col2 file2 col3 file1 col4 file1 col5 file2 now, i would like to... (4 Replies)
Discussion started by: tester111
4 Replies

2. Shell Programming and Scripting

With script bash, read file line per line starting at the end

Hello, I'm works on Ubuntu server My goal : I would like to read file line per line, but i want to started at the end of file. Currently, I use instructions : while read line; do COMMAND done < /var/log/apache2/access.log But, the first line, i don't want this. The file is long... (5 Replies)
Discussion started by: Fuziion
5 Replies

3. Shell Programming and Scripting

Bash script to read a file from particular line till required line and process

Hi All, Am trying to write wrapper shell/bash script on a utility tool for which i need to pass 2 files as arugment to execute utility tool. Wraper script am trying is to do with above metion 2 files. utility tool accepts : a. userinfo file : which contains username b. item file : which... (2 Replies)
Discussion started by: Optimus81
2 Replies

4. Shell Programming and Scripting

How to read a two files, line by line in UNIX script and how to assign shell variable to awk ..?

Input are file and file1 file contains store.bal product.bal category.bal admin.bal file1 contains flip.store.bal ::FFFF:BADC:CD28,::FFFF:558E:11C5,6,8,2,1,::FFFF:81C8:CA8B,::FFFF:BADC:CD28,1,0,0,0,::FFFF:81C8:11C5,2,1,0,0,::FFFF:81DC:3111,1,0,1,0 store.bal.... (2 Replies)
Discussion started by: veeruasu
2 Replies

5. Shell Programming and Scripting

HELP: Shell Script to read a Log file line by line and extract Info based on KEYWORDS matching

I have a LOG file which looks like this Import started at: Mon Jul 23 02:13:01 EDT 2012 Initialization completed in 2.146 seconds. -------------------------------------------------------------------------------- -- Import summary for Import item: PolicyInformation... (8 Replies)
Discussion started by: biztank
8 Replies

6. Shell Programming and Scripting

Shell script to read multiple options from file, line by line

Hi all I have spent half a day trying to create a shell script which reads a configuration file on a line by line basis. The idea of the file is that each will contain server information, such as IP address and various port numbers. The line could also be blank (The file is user created). Here... (1 Reply)
Discussion started by: haggismn
1 Replies

7. Shell Programming and Scripting

Shell script to read a text file line by line & process it...

Hi , I am trying to write an shell, which reads a text file (from a location) having a list of numbers of strictly 5 digits only ex: 33144 Now my script will check : 1) that each entry is only 5 digits & numeric only, no alphabets, & its not empty. 2)then it executes a shell script called... (8 Replies)
Discussion started by: new_to_shell
8 Replies

8. Shell Programming and Scripting

how can u read a file line by line in shell script ?

hello , plz help for below script req:- how can we read a file line by line in shell script ? (4 Replies)
Discussion started by: abhigrkist
4 Replies

9. UNIX for Dummies Questions & Answers

shell script to read file line by line

Hi, I need to read a text file from shell script line by line and copy the feilds of each line. Below is the complete requirement. I've text file which contains ... pgm1 file11 file12 file13 pgm2 file21 file22 pgm3 file31 file32 file33 I'll give input as... (4 Replies)
Discussion started by: ani12345
4 Replies

10. Shell Programming and Scripting

shell script to read a line in gps receiver log file and append that line to new file

Hi, I have gps receiver log..its giving readings .like below Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. GPSD,R=1 $GPGSV,3,1,11,08,16,328,40,11,36,127,00,28,33,283,39,20,11,165,00*71... (3 Replies)
Discussion started by: gudivada213
3 Replies
Login or Register to Ask a Question