Deep web is autonomous, independently updating, and its data are always in a state of frequent update. However, the user always hopes to obtain the newest content in the current web database. Different from previous paper, this paper wants to emphasize the importance of updating frequency in the study of deep web information acquisition. And, an approach on incremental information acquisition based on logical reinforcement learning has been proposed. Then, the authors find in their research that under the same condition of constraint resources, the novel approach can improve the freshness of data, discovery efficiency of new data and the service quality of deep web information integration.