Web Development

Ask something
Question Locked

Parsing data from a website

0 helpful
5 replies

by muirislenihan

Closed to new repliesThis discussion is closed. It stays readable, but it takes no new replies.
I am developing a website as part of a university project. I want to be able to take information from other websites (e.g. posts in forums), save them to my db and make available to view on my site. What would be the best way to do this?? My prefered language is Java. Any help would be greatly appreciated. Thanks

5 replies

by thumbsup2

Based on the little bit of information in your post, what you want to do would more than likely be a copyright infringement. You could legally post links to that information, but swiping it, storing it and posting it on your web site as "your own" would only get you into trouble.

by lvantine

I agree with ThumbsUp2, just copying the data without permission is theft. I would first contact the Web site owners, explain your purpose and ask permission to use the data for your class. If granted I would follow any conditions (like purging the data when done) so that the next person that comes along won't find web site operators with a sour taste in their mouth this will also avoid a mess of trouble for you.

Besides if you get permission and have a good story the web site owners may make the data available in much easier to use format, screen scaping a web site is a pain.

by clgan333

The iframe is much more easier if you don't want change any content and just display in your web page!

This discussion is closed to new replies.