01-14-2014
If that's an authorized access then you might potentially have web services with properly defined contracts for the APIs, which will give easier for accessing the link. Otherwise you will have to take the other route of using LWP, perl to access the page, scrape the contents, restructure the data.
perl and lwp
If you are saying about crawling and scraping the data from one source and providing a modified view in another source, you need to fetch the data and restructure.
Automatically updating can be dealt in two ways
1. When latency in update delay is accepted, you can configure a job that does the above and keep updating for every 'n' units of time.
2. When latency in updation has to be low latency or ~0 latency, then you need to have a listener that will listen to the changes in the source, receive them, reprocess as required and update the secondary source /destination.
Hope this gives some clarity!
This User Gave Thanks to matrixmadhan For This Post:
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Since i'm new to scripting i'm findind it difficult to code a script. The script has to be an executable with 2 paramters passed to it.The Parameters are
1. The Control file name(.ctl file)
2. The Data file name(.csv file)
Does anybody have an idea about it? :confused: (3 Replies)
Discussion started by: Csmani
3 Replies
2. Programming
hi,
iam reading the webpage using curl socket.
so iam geting the data in html format
so how can convert html data to text data ,so i can move forward.
thank u,
sree (3 Replies)
Discussion started by: phani_sree
3 Replies
3. Shell Programming and Scripting
I have a .csv file
equipment,bandtype
abc,aws
def,mmds
ghi,umts
jkl,mmds
I can get the equipment from `hostname`.
In my script i want to check what is the hostname. then see if it exists in the.csv file. if it does then i want to store the second parameter(bandtype) for the corresponding... (3 Replies)
Discussion started by: lassimanji
3 Replies
4. Linux
ID -------CODE-------DATE-------URL
I have a log file with entries like this. The file has about 6 lakhs record and the size is about 42MB. I need to covert them into a XML file like <ID></ID>
<CODE></CODE>
<DATE></DATE>
<URL></URL>
I have done a logic for this and successfully done.... (0 Replies)
Discussion started by: arunkumar.in
0 Replies
5. Shell Programming and Scripting
I have a script which has to be scheduled to run 3 times a day.
My script picks the required fields from logfile and stores the data in a.csv file.
Sample data.
my logfile contain:
0097A,0374D,100903,1519,00000606191
0097A,C88RA,100903,0724,00000606105
So the output of first execution... (3 Replies)
Discussion started by: shrima.pratima
3 Replies
6. Shell Programming and Scripting
Hello everybody,
Here is my problem, I don't know anything about shell programming and my boss is actually asking me to develop a shell script in order to get values in a csv file from a specific date.
Here is a sample of the csv file :
Date;Enchaînement;Titre;Libellé ;calendrier;Heure début;Heure... (11 Replies)
Discussion started by: freyr
11 Replies
7. Shell Programming and Scripting
Hi Experts,
I have created a table with columns as empname,empid,phone,shiftname. Now I am having a .csv file format which contains the shift datas of the employees. I have to fetch this file and compare with the table I created to send an alert to the specified user. (2 Replies)
Discussion started by: micky3112
2 Replies
8. Shell Programming and Scripting
Hallo Friends,
I need you help. My file has 5000 or so lines and currently looks like below(sample).
Service Type,Origin,Destination,Rate Per Minute,Minimum Charge,Time Based Rate,Time Based From Day,Time Based To Day,Time Based From Time,Time Based To Time,Destination Prefix List,,
VoIS... (3 Replies)
Discussion started by: kekanap
3 Replies
9. Shell Programming and Scripting
Hi
I am writing a shell script to parse a CSV file , in which i am facing a problem to separate the columns . Could some one help me with it.
IN301330/00001 pvavan kumar limited xyz@ttccpp.com
IN302148/00002 PRECIOUS SECURITIES (P) LTD viash@yahoo.co.in
IN300239/00000 CENTRE india... (8 Replies)
Discussion started by: nanduri
8 Replies
10. Shell Programming and Scripting
Hi, I am newbie in shell script.
I need your help to solve my problem.
Firstly, I have 2 files of csv and i want to compare of the contents then the output will be written in a new csv file.
File1:
SourceFile,DateTimeOriginal
/home/intannf/foto/IMG_0713.JPG,2015:02:17 11:14:07... (8 Replies)
Discussion started by: refrain
8 Replies
LEARN ABOUT CENTOS
hwloc_distances_s
hwloc_distances_s(3) Hardware Locality (hwloc) hwloc_distances_s(3)
NAME
hwloc_distances_s -
SYNOPSIS
#include <hwloc.h>
Data Fields
unsigned relative_depth
unsigned nbobjs
float * latency
float latency_max
float latency_base
Detailed Description
Distances between objects.
One object may contain a distance structure describing distances between all its descendants at a given relative depth. If the containing
object is the root object of the topology, then the distances are available for all objects in the machine.
If the latency pointer is not NULL, the pointed array contains memory latencies (non-zero values), as defined by the ACPI SLIT
specification.
In the future, some other types of distances may be considered. In these cases, latency may be NULL.
Field Documentation
float* hwloc_distances_s::latency
Matrix of latencies between objects, stored as a one-dimension array. May be NULL if the distances considered here are not latencies.
Values are normalized to get 1.0 as the minimal value in the matrix. Latency from i-th to j-th object is stored in slot i*nbobjs+j.
float hwloc_distances_s::latency_base
The multiplier that should be applied to latency matrix to retrieve the original OS-provided latencies. Usually 10 on Linux since ACPI SLIT
uses 10 for local latency.
float hwloc_distances_s::latency_max
The maximal value in the latency matrix.
unsigned hwloc_distances_s::nbobjs
Number of objects considered in the matrix. It is the number of descendant objects at relative_depth below the containing object. It
corresponds to the result of hwloc_get_nbobjs_inside_cpuset_by_depth.
unsigned hwloc_distances_s::relative_depth
Relative depth of the considered objects below the object containing this distance information.
Author
Generated automatically by Doxygen for Hardware Locality (hwloc) from the source code.
Version 1.7 Sun Apr 7 2013 hwloc_distances_s(3)