How to prevent offline browsing webspider to download my website contents - TechRepublic
Question
October 13, 2006 at 05:37 AM
andyngcw

How to prevent offline browsing webspider to download my website contents

by andyngcw . Updated 19 years, 9 months ago

Hi,

I am concerning how to prevent the offline browsing webspdier (e.g. Teleport) to download my website content for security purpose.

I have add below content in the .htaccess file in Unix system. But I have tried to use Teleport, it still can download my website content.

****************************************
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro
RewriteRule /*$ http://www.mywebsite.com [L,R]
***************************************

Is there any thing wrong setting in .htaccess file?

Please check and give advice.

Thanks and regards,

Andy

This discussion is locked

All Comments