Reporting on Keywords Typed Into Search Engines

WebSpy Vantage is able to report on the search words that users typed into search engines. This article will show you how to create a report that shows this information or add it to an existing report template.

When a user goes to a search engine, and types in a search term, this word(s) is recorded in the URL. For example, if I visit, and type in WebSpy Internet Monitoring, the URL with the search results looks like this:

You can see my search terms recorded in the URL, in the Query String section of the URL, which is the part after the “?”

WebSpy has researched the ways that all of the common search engines record the search terms into their query strings, and applies this knowledge automatically when importing your log files. The results can be seen in the Site Keyword summary.

To view all of the Site Keywords typed in by your users:

1. Go to Summaries in Vantage and click New Analysis on the left
2. Select the Analysis Type as ‘ad hoc’ and don’t use any filters
3. When the analysis completes, click on the Site Name summary, and then click on the Search Engines radio button in the Alias box on the left to group the sites into search engines.
4. Left click on any search engine to drilldown, or use + to highlight all of the search engines, then left click on the highlighted selection to drilldown on them all at once.
5. When the drilldown completes expand the treeview, and click on Site Keywords to view the keywords for that Search Engine or group of Search Engines. You can click on any keyword to drilldown and view the user who typed it in. You can also export the list of keywords as a report by clicking Export Current View on the left.

To add this information to any report template:

1. Go to Reports in Vantage, and right-click the template you wish to edit and choose Edit Template. The template must be a web template, for example the Organization template.
2. To add the keywords for the entire company, right-click the root node of the template and choose New Node. Alternatively, to add the keywords only for a specific item or set of items already in the report (eg Users), right-click that node and choose New Node.
3. Select the Summary as Site Keywords, leave the Alias as (none), then click the Advanced button.
4. To ensure the keywords are only displayed for sites that are Search Engines, go to the Filters page of the dialog and click Add | Field Value Filter
5. Choose the Summary as Site Name, and the Alias as Search Engines, then select the Exclude radio button, and check checkbox for “Non-Search Engine Traffic”, then click OK
6. Click OK to add this node to your report template


1. Whenever you make changes to a report template, on completion of the changes, click Return To Reports on the left, then click the Save Templates link to make a copy of your changes, before running the report.

2. When you run the report, use a test storage, with only a very small amount of data in it. This will allow the report to complete quickly, and let you see whether the changes are what you expected. If they are, then you can run the report on your entire data.

See also:

By | 2013-04-27T14:06:17+00:00 April 27th, 2013|How To, Log File Analysis, Reports, Tips and Best Practices|0 Comments

About the Author:

Leave A Comment