dc-l1-tokyo-ring-orientation
Analyst notes
Description
Tests whether the agent can diagnose a polygon ring-orientation defect from symptoms alone. The prompt describes the rendering and tile-server symptoms but never names RFC 7946, never says 'ring orientation', and never gives an EPSG code. The agent has to inspect the file, notice the rings wind the wrong way (exteriors clockwise and interiors counter-clockwise, the OGC convention, which is the inverse of what GeoJSON requires), and reverse them, preserving every attribute and the exact shape.
Approach
- Read the legacy GeoJSON and inspect a sample polygon's exterior and interior rings to see how they wind.
- Recognise that web-based GeoJSON viewers and validators follow RFC 7946's right-hand rule (exterior CCW, interior CW) and that the file uses the opposite convention.
- Reverse the vertex order of every ring that is on the wrong side of the rule, leaving the coordinates themselves untouched.
- Confirm that the geometric shape, the feature count, the feature_id set, and every attribute column are unchanged.
- Write the result back as GeoJSON with the same schema, in the same CRS, under the requested filename.
Pitfalls
- Reading the file with geopandas and writing it straight back, which preserves the malformed winding because geopandas does not normalise ring orientation on round-trip, so the symptom remains and both orientation subchecks fail.
- Fixing the exterior rings but forgetting that interior rings have the opposite rule, so holes still wind the wrong way and the interior subcheck fails.
- Rebuilding each polygon from just the reversed exterior, which silently drops every interior ring; the area changes only by the tiny hole areas but the polygons-with-holes subcheck catches the structural loss.
- Calling simplify, buffer(0), or make_valid as part of the fix, which nudges vertices and trips the per-feature IoU check even though the orientation is now correct.
- Reprojecting the output into EPSG:3857 or another CRS, which costs both soft CRS subchecks even though the rest of the work is correct.
- Round-tripping through Shapefile as a staging format, which truncates long attribute names and re-flips rings to OGC convention on write.
Map
Recent runs task v3
| adapter | started | score | steps | duration | cost | status |
|---|---|---|---|---|---|---|
| openrouter-gemma4-26b-basic | 2026-06-18T07:32:32Z | pending | — | — | — | pending |
| openrouter-deepseek-v4-flash-basic | 2026-06-18T03:08:04Z | 0.00 | 7 | 1:12 | 1.87¢ | done |
| openrouter-deepseek-v4-flash-detailed | 2026-06-17T22:01:33Z | 0.00 | 9 | 0:56 | 0.31¢ | done |
| openrouter-gemma4-26b-detailed | 2026-06-17T19:47:47Z | 0.00 | 14 | 0:54 | 0.56¢ | done |
| openrouter-deepseek-v4-flash-basic | 2026-06-16T21:43:55Z | 1.00 | 11 | 2:15 | 2.46¢ | done |