Text analyzer

From Secure Web Gateway


Text Analyzer enables you to detect and restrict the access to websites which may contain inappropriate or pornographic content based on keyword scoring system.

Text analyzer is particularly useful in detecting unclassified websites that could serve inappropriate content.

This feature can be effectively used to block websites belonging to specific category, without having to depend on any database.

When a keyword from the list of words specified in an entry is found, the page is given the score specified in that entry. The total score of the page is equal to the sum of the score of all the rules that matches.

When the total score is equal to or greater than the threshold, then the page is blocked.




Enable or Disable text analyzer section.

  • TRUE : Enable text analyzer section.
  • FALSE : Disable text analyzer section.


The number the total score must equal or exceed until the page is blocked.


Templates are used throughout Safesquid as a replacement for pages which can't be displayed due to filtering, error, or other conditions.

Specify the template name that should be displayed on a user's screen when this entry matches. The name should be selected from template section. In template section you can find template's name.

Leave this rule blank, to use default template.

Filtering policies

Here you can add the new policies to block the websites based on content type.

You can give the score to each policy and the keywords to block the inappropriate content.



Enable or Disable this Policy.

  • TRUE : Enable this entry.
  • FALSE : Disable this entry.


For documentation, and future references, explainthe relevance of this entry with your policies.

That is, by reading the policies, a future user can understand the purpose of that entry.


Specify the Profiles applicable for this entry.

This entry will be applicable only if the connection has any one of the specified profiles.

Leave it Blank, to apply for all connections irrespective of any applied profile.

To avoid application to a connection that has a profile, use negated profile (!profile).

Mime type

It's a way of identifying files on the Internet according to their nature and format.

It is highly advisable that you set this to some mime-type; otherwise all files will be checked.

A regular expression matching the mime-types this entry policy applies to.

Example : text/html, ^image/,^application/, application/x-shockwave-flash.


A regular expression matching anything in the body of the document considered inappropriate, leave blank to match everything.

We can add more than one keyword in a single policy.

Example : (sex|sexy|porn|pornography).


This entry adds to the total score when it matches, this may be a positive or negative integer.

If you mentioned keyword as adult, then every time this word found in the document the score mentioned will be added.

Example : If you mentioned score as 20, then if the word adult found once in the requested document then 20 will be added, for two times it will be 40, three times it will be 60.




I want to block webpages based on the defined keywords.

For connections with profile “TEXT ANALYZER FOR SAFESQUID’ will search for the keyword SafeSquid, proxy, swg, web proxy, squid, Perimeter security solution and secure web gateway.

For any keywords matched, the webpage is being scored and if the score reaches equal to or above the thread hold which is 100 webpage will be blocked.

Example: if the webpage consists of words SafeSquid then text analyzer will score as 60, on the next successful match of defined keyword it will now be 120 .

120 is above threshold and hence it will block the page and you’ll receive SafeSquid’s blocked_bypass template.

Text analyzer can be used in situations where uncategorized websites server inappropriate content.

Example: Articles, news etc.