Similar Jobs
See allReal estate / hospitality / events Evaluator
N/A
US
Microsoft Office
Google Workspace
Written Communication
Public-sector procurement / RFI response Evaluator
Partner Company
US
Government Contracting
Microsoft Office
Google Workspace
SWE-Bench AI Task Auditor - Freelance AI Trainer Project
Jobgether
US
Software Engineering
Debugging
Code Review
Application Processor - Energy Rebates
AdNet/AccountNet, Inc.
US
MS Office
Excel
Data Analysis
Medical Reviewer
Palmetto GBA
US
Utilization Management
Medical Review
Microsoft Office
Scope of the Role:
- Evaluate the output of an AI system performing automated building-code compliance review on architectural permit applications.
- Confirm correct determinations and correct incorrect ones; corrections become training signal.
- This is expert review work, not data entry, requiring real code expertise.
What You’ll Own:
- Review and correct pass/fail verdicts, written rationales, and citation boxes on PDF plans using the in-tool editing toolkit.
- QA and correct labeling: review AI-generated outputs, fix mislabeled data, and grade agent performance.
- Interpret permitting checklists and trace requirements to applicable model codes or jurisdiction-specific amendments.
You’ll Thrive in This Role If You Have:
- ICC certification relevant to building plan review and actual experience reviewing permit applications.
- Based in the United States with at least 2 years of hands-on permitting experience; 5+ years strongly preferred.
- Deep knowledge of US permitting processes, with preference for experience in Arizona, California, Florida, or Texas.
Innodata
Innodata is a global data engineering company focused on enabling responsible advancement of artificial intelligence by providing data, evaluation frameworks, and human expertise. With a 36+ year legacy, they deliver high-quality data and outstanding outcomes for customers.