[Positive Technologies Research] Open Source WebEngine and Web Crawler v.0.2 is out!

[aanisimov@xxxxxxxxxxxxxx]

==============================================================

============= Positive Technologies Research Lab =============

==============================================================

         Open Source WebEngine and Web Crawler (Beta)

==============================================================


---[   Introduction

        Web Crawler is a utility designed for testing and demonstration of the 
WebEngine open source library features. This program gathers information about 
the resources of a specified web server by analyzing references in the HTML 
markup, text, and JavaScript code. Additionally, a query is sent to the Web Of 
Trust knowledge base to obtain information about the analyzed site. This check 
demonstrates analysis of web application vulnerabilities.

The main features provided by the application are listed below:

        - JavaScript analysis aimed at receiving references with simulation of 
a DOM structure
        - Access to the contents of web servers via HTTP
        - Support of the Basic, Digest, and NTLM authorization schemes
        - Operation via proxy servers with various authorization schemes
        - A wide variety of options to describe the scan target (lists of 
scanned domains, restriction of scanning to a host, a domain, or a web server 
directory, etc.)
        - Modular structure, which allows one to implement plug-ins


Download URL:
        
http://code.google.com/p/webapptools/downloads/detail?name=Crawler_v0_2.zip

WebEngine LGPL library and other projects:
        http://webapptools.googlecode.com

Blog:
        http://www.ptresearch.ru
        http://ptresearch.blogspot.com



---[ Package Structure ]

        The package consists of two main components: the crawler utility and a 
XUL-based GUI. To display the GUI, one can use the Firefox browser or a 
specialized application (e.g. xulrunner or prism).
        The application root directory contains the utility binary files and 
the XUL configuration file (application.ini). The nested-directories structure 
is defined by the rules of formation of applications based on XUL. A user may 
be interested in the chrome/skin directory, which contains files describing the 
application appearance. The package offers several pre-installed themes. To 
change the appearance, it is sufficiently to replace the contents of the 
chrome/skin/classic directory with the chosen theme. A new theme can be created 
on the basis of an existing one or by modifying themes from the site 
http://jqueryui.com/themeroller/. The themes downloaded from this site should 
be supplemented with some images and CSS descriptions by analogy with the 
existing ones.



---[ ToDo ]

The Crawler utility and WebEngine library:

        - Tests for web application vulnerabilities
        - Improve the operation stability and performance
        - Broaden the JavaScript support
        - And a number of others

GUI:
        - Broaden the settings on the Settings tab to avoid necessity of manual 
utility configuration
        - Implement the feature of viewing log files with filtering and 
highlighting of the message levels



---[ About ]

        This utility was designed by the Positive Technologies Research Lab 
team within the bounds of development of a web application analyzer for the 
MaxPatrol system. The product is developed as open-source software according to 
the terms of the GNU Lesser General Public License. You can find the source 
code of the program and its components at http://webapptools.googlecode.com/.
        You can redistribute it and/or modify it under the terms of the GNU 
Lesser General Public License as published by the Free Software Foundation, 
either version 3 of the License, or (at your option) any later version.
        WebEngine library and Crawler utility is distributed in the hope that 
it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty 
of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General 
Public License for more details.
 You should have received a copy of the GNU Lesser General Public License along 
with this software.  If not, see http://www.gnu.org/licenses/.



---[ About Positive Technologies ]

        http://www.ptsecurity.com

        Positive Technologies is one of the leading companies in information 
security in Russia. The principle company's activities are: information 
security monitoring systems development (XSpider, MaxPatrol); consulting and 
services in IT security, SecurityLab special portal development.
        Positive Technologies products are certified by Ministry of Defense of 
the Russian Federation and Federal Service for Technical and Export Control 
(FSTEK Russia). Positive Technologies clients are more than 40 state 
institutes, more than 50 banks and financial structures, 20 telecommunication 
companies, more than 40 industrial enterprises, IT companies, service and 
retail companies from Russia, CIS, Baltic states, and also from the Great 
Britain, Germany, Holland, Israel, Iran, China, Mexico, USA, Thailand, Turkey, 
Ecuador, South African Republic, Japan.
        Positive Technologies is a team of highly qualified developers, 
consultants and experts with great practical experience that have professional 
titles and certificates, are the members of international organizations and 
actively take part in industry development.