Learning scrapers, webcrawlers, search engines and CURL Post: 303019102

Sponsored Content

Operating Systems Linux Learning scrapers, webcrawlers, search engines and CURL Post 303019102 by Neo on Friday 22nd of June 2018 11:16:30 PM

06-23-2018

Administrator

Quote:

Originally Posted by TBotNik

Text only vs regular brower: which is best?
wget vs php fileopen vs CURL: Which is best?
HTML tag find/parse: Are there libraries that effectively do this?
HTML tag find/parse: Is REGEX the best way to parse these? Where are examples?
Checking for the new meta-tags of:

I think you are better off to get web page content using PHP scripts and parse the files with REGEX.

If you Google around, I am sure you can find many sample PHP scripts that do most of what you want. This is very old technology and there is no need to reinvent the wheel parsing HTML data.

Neo

View Public Profile for Neo

Visit Neo's homepage!

Find all posts by Neo

3 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

I dont want to know any search engines

I just want to know where I can download it on this website plz

2. UNIX for Dummies Questions & Answers

Using cURL to save online search results

Hi, I'm attacking this from ignorance because I am not sure how to even ask the question. Here is the mission: I have a list of about 4,000 telephone numbers for past customers. I need to determine how many of these customers are still in business. Obviously, I could call all the numbers....

3. Shell Programming and Scripting

Checking status of engines using C-shell

I am relatively new to scripting. I am trying to develop a script that will 1. Source an executable file as an argument to the script that sets up the environment 2. Run a command "stat" that gives the status of 5 Engines running on the system 3. Check the status of the 5 Engines as either...

LEARN ABOUT ULTRIX

yppasswd

yppasswd(1yp) yppasswd(1yp)

Name
yppasswd - change password in yellow pages (YP) service.

Syntax
yppasswd [ name ]

Description
The command lets you change your password in the yellow pages (YP) map, a network data base service. Only you or the superuser can change
your YP password.

When you enter the command, the program prompts you for the old password and then for the new password. Note that the passwords are not
displayed on the screen.

Next, the program asks you for the new password again, to verify that you have typed it correctly. If you do not type the passwords cor-
rectly, you will receive an error message after you enter the new password.

Your new YP password must meet one of the following requirements:

o It must be a combination of at least six alphanumeric characters, or

o It must be a minimum of four characters, with at least one being non-alphanumeric, such as a control sequence.
The command does not change the YP password. This command only changes the local password file and not the YP master password file. See
Chapter 3 of the Guide to the Yellow Pages Service for further information.

Diagnostics
Please use a longer password
Your new password does not meet the minimum length requirement.

Mismatch- password unchanged
You misspelled your new password or its verification.

couldn't change passwd
Your new password can not be activated. It must be different from your old password and your login name.

Files
Password file

Yellow Pages directory

See Also
passwd(1), passwd(5yp), ypfiles(5yp), yppasswdd(8yp)
Guide to the Yellow Pages Service

yppasswd(1yp)