Welcome to the Crawler Trap
A test of your parsing skills
Here are your starting links:
Valid Path A (Depth 1)
Valid Path B (Depth 1)
A Broken Link (Test 404)
A Server Error (Test 500)
External Link (Should NOT be crawled)