This is an exported version of the JIRA issue tracker. Please use the Google Code site to open new tickets or report updates to these existing tickets. Feel free to contact the mailing list with any questions.

[NRB-6] Spec bug; check user agents first and then the first wildcard
Created: Wed, 5 Oct 2005 08:01:09 -0700 (PDT)  Updated: Wed, 5 Oct 2005 10:01:16 -0700 (PDT)

Status:Closed
Project:Norbert
Component/s:
Affects Version/s:0.3.1
Fix Version/s:0.3.2

Type:BugPriority: Major
Reporter:Henri YandellAssignee:Henri Yandell
Resolution:Fixed 
Environment:


 Description   
(Thanks to Tim Patton)

User-agent: Project Kolinka Forum Search (www.kolinka.com)
Disallow:

User-agent: *
Disallow: /redir.asp
Disallow: /site_redir.asp
Disallow: /searchpro.asp
Disallow: /memberlist.asp
Disallow: /showprofile.asp
Disallow: /photosearch.asp
Disallow: /albumphoto.asp
Disallow: /photo.asp
Disallow: /printable.asp
Disallow: /post.asp
Disallow: /address.asp
Disallow: /onlineuser.asp
Disallow: /fb.asp
Disallow: /postpro.asp

I have two blocks here, if I put the Kolinka block 2nd, Norbert will seem to
only use the first block, so my robot is disallowed from visiting
"printable.asp" even though to a human reader of the file it looks allowed.
Is this correct behavior? I just wanted to clarify before I send notices to
webmasters to update their robots.txt if they want my bot to visit.
Comment by bayard [ Wed, 5 Oct 2005 10:01:16 -0700 (PDT) ]
Fixed. Create a second RulesEngine instance (for wildcards) and modified the API so that null can indicate that a rule did not match, allowing the second engine to be used.