About the job Remote | Architecture Visual Document Evaluation Consultant — Up to $70/hour
We are sharing a specialised part-time consulting opportunity for experienced architecture professionals based in the United States or Canada with backgrounds in building design, architectural documentation, construction drawings, spatial reasoning, visual document interpretation, technical review, and structured evaluation.
This role supports current and upcoming remote consulting opportunities focused on AI-assisted visual document understanding, instruction-following evaluation, architecture benchmark development, grounded task authoring, ground truth creation, objective rubric design, and high-quality project execution. Selected professionals will translate real-world building architecture expertise into complex document-grounded tasks, define accurate outputs, and provide detailed evaluation criteria based on architectural knowledge, visual reasoning, and domain-specific judgment.
Key Responsibilities
Professionals in this role may contribute to:
Architecture Task Authoring
- Author complex, domain-grounded tasks in the building architecture domain using realistic visual documents, drawings, plans, diagrams, specifications, reports, or related source materials
- Design tasks that evaluate an AI system's ability to understand architectural documents, follow precise instructions, and produce accurate structured outputs
- Translate architectural expertise into clear task prompts, expected answers, and evaluation-ready examples
- Support work across building design, floor plans, elevations, sections, site plans, construction documentation, spatial layouts, or related architecture topics depending on expertise and project needs
Visual Document Understanding & Architectural Review
- Review architectural drawings, plans, diagrams, visual materials, tables, annotations, and specifications for relevant building and design information
- Create tasks that require careful interpretation of visual document structure, spatial relationships, labels, measurements, symbols, and architectural context
- Evaluate whether task instructions are clear, complete, technically sound, and appropriately grounded in the provided materials
- Identify ambiguous prompts, missing context, incorrect assumptions, weak document grounding, or incomplete architectural reasoning
Ground Truth Development & Rubric Design
- Produce clearly defined ground truth outputs for architecture-focused tasks
- Create objective evaluation rubrics that specify correct answers, acceptable reasoning, formatting expectations, architectural requirements, and quality criteria
- Validate task outputs for accuracy, completeness, consistency, and alignment with source documents and instructions
- Identify gaps in answer keys, rubric logic, evaluation criteria, document interpretation, or instruction-following requirements
Structured Feedback & Quality Control
- Provide clear written feedback explaining architectural reasoning, visual document interpretation, task-quality issues, and suggested improvements
- Follow detailed task instructions, quality criteria, and project-specific standards accurately
- Review discrete benchmark deliverables and identify areas for improvement
- Collaborate through asynchronous project workflows to improve architecture-focused AI evaluation materials and benchmark quality
Ideal Profile
Strong candidates may have:
- Professional or academic experience in architecture, building design, architectural documentation, construction drawings, spatial planning, or a closely related field
- Strong ability to interpret visual architectural documents, plans, elevations, sections, diagrams, schedules, specifications, or building-related source materials
- Experience creating architectural explanations, structured documentation, design review notes, educational materials, evaluation rubrics, or QA review outputs
- Strong visual reasoning and ability to verify architectural information for accuracy, completeness, and practical relevance
- Ability to clearly articulate architecture-related reasoning in written form
- Strong attention to detail and ability to identify incomplete instructions, inaccurate outputs, unsupported assumptions, or document-grounding issues
- Comfort reviewing AI-generated architecture or visual document content and applying detailed evaluation criteria
- Excellent written communication skills
- Ability to work independently in a remote, asynchronous, project-based environment
- Current location in the United States or Canada
Nice to Have
- Experience with architectural plans, building layouts, construction documentation, design drawings, technical specifications, building diagrams, or project documentation
- Familiarity with benchmark datasets, visual document understanding tasks, instruction-following evaluations, or rubric-based QA workflows
- Experience creating ground truth answers, assessment materials, training datasets, technical review forms, or structured architecture tasks
- Comfort working with multi-step visual prompts, architectural source files, precise output specifications, and document-grounded reasoning
- Ability to design tasks that require careful spatial interpretation, architectural accuracy, and objective evaluation
Why This Opportunity
- Apply architecture and visual document expertise to structured remote project work
- Contribute to high-quality AI-assisted visual document understanding and instruction-following evaluation
- Use architectural judgment in a focused task-authoring, rubric-design, and quality-review environment
- Work on discrete deliverables aligned with professional background and subject-matter expertise
- Remote structure with competitive compensation
Contract Details
- Independent contractor role
- Fully remote with flexible scheduling
- Eligible professionals should be based in the United States or Canada
- Expected commitment is approximately 15–20 hours per week depending on availability, onboarding status, task quality, and project needs
- Work may be structured around architecture task authoring, visual document review, ground truth development, evaluation rubrics, or task-based assignments
- Competitive rates of up to $70 USD per hour depending on domain expertise, task quality, and project scope
- Screening may include resume or experience summary review, domain background assessment, and a brief sample task
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or adjusted depending on scope and performance
- Work will not involve access to confidential or proprietary information from any employer, client, vendor, or institution
- Please note: We are unable to support H1-B or STEM OPT candidates at this time
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.