[NRB-4] Doesn't send User-Agent in the request | |
| Status: | Closed |
| Project: | Norbert |
| Component/s: | |
| Affects Version/s: | 0.2 |
| Fix Version/s: | 0.3 |
| Type: | Bug | Priority: | Major |
| Reporter: | Henri Yandell | Assignee: | Henri Yandell |
| Resolution: | Fixed | ||
| Environment: | |||
| Description |
| When asking for the robots.txt file, it needs to use its User-Agent in the request. |
| Comment by bayard [ Tue, 29 Jun 2004 19:52:04 -0700 (PDT) ] |
| Not unit testable without a web-server, but implemented now. |