General discussion

Locked

Copying content from the web page

By vinodmenonk ·
I am developing a finance portal. I have portions of my site linked to public finance companys. I want to do away with the links and yet maintain a dynamic update capability.

Is it possible to copy a specific portion of there web page and displayit on my portal.
For example if the right hand top portion of a web page displays a text message then can I copy it and display only the text message in my portal ?

This conversation is currently closed to new comments.

9 total posts (Page 1 of 1)  
| Thread display: Collapse - | Expand +

All Comments

Collapse -

Copying content from the web page

by sharpe In reply to Copying content from the ...

Hi there I want to answer your question on Tech Republic but first I need to know a few things about the web site you are working on.

1 what type of server is the site on?
2. what software are you using?
3. Are you sure that the text you want to copy is just plain text?

I build web sites and frequent Microsoft FrontPage news groups. This question and many more could be answered in that news group.

here is the name of the group.

msnew.microsoft.com is the server.

the groupname is microsoft.public.FrontPage.client
this is a great group.

As far as your question: you can copy just about any type of content from another web site.

Having FrontPage as an html editor is great.

If you do not have/use frontpage then maybe you can copy whatever it is you want from another web site using your browser with 'view source' or NS page source. copy and paste into "note pad"

Note pad is the default that comes with all MS operation systems.

LMK

DemianRevisedcode
Web Mas

Collapse -

Copying content from the web page

by vinodmenonk In reply to Copying content from the ...

The question was auto-closed by TechRepublic

Collapse -

Copying content from the web page

by steve In reply to Copying content from the ...

If you want a portion of another page to appear on your page, you can do this fairly easily with Perl (assuming you know some Perl). You need to use the Perl LWP module. There are several tutorials on the web that show you how to do this sort of thing. There is one at WebReview.com (I think its there) that shows you how to grab the latest Hockey scores from some sports news site and display them on your page.

Maybe this would work for the financial information. Just be sure you are not infringing on any copyrights...

Steve

Collapse -

Copying content from the web page

by vinodmenonk In reply to Copying content from the ...

The question was auto-closed by TechRepublic

Collapse -

Copying content from the web page

by ionFreeman In reply to Copying content from the ...

Vinod,
From an intellectual property standpoint, I think the answer is no.
As you're doing web development, I'm assuming you are using java servlets. Just create a client http socket. You can create a custom content handler, or take the page as an http string, and parse it to remove the section you are interested in. You either have to know the name of the html element that you want to take information from, or depend on the fact that your source's formatting will be consistent -- since they can change it without warning you, you'll want to supervise it.
See this API documentation:
http://java.sun.com/products/jdk/1.3/docs/api/java/net/HttpURLConnection.html
If you_are using Perl, then I'd recommend the book "Web Client Programming with Perl." The other poster is dead on; Chapter 5 covers LWP.
ion

Collapse -

Copying content from the web page

by vinodmenonk In reply to Copying content from the ...

The question was auto-closed by TechRepublic

Collapse -

Copying content from the web page

by glenndal In reply to Copying content from the ...

Please get permission from the publisher of
the page, before you go copying their work.
Please know that this could be considered a
breech of copyright, and the site you have
ripped from may seek compensation for your
activity. Of courseif your site is
non-commercial then this may protect you to
some degree.

Keep in mind also, that someone may change
the layout of their site, and that would
leave you with quite a trail of deads to pick
up.

Collapse -

Copying content from the web page

by vinodmenonk In reply to Copying content from the ...

The question was auto-closed by TechRepublic

Collapse -

Copying content from the web page

by vinodmenonk In reply to Copying content from the ...

This question was auto closed due to inactivity

Back to Web Development Forum
9 total posts (Page 1 of 1)  

Software Forums