About the job Remote | Legal Research Expert (AI Benchmarking) — $70–$95/hour
We are sharing a specialised part-time consulting opportunity for legal professionals and academic experts with advanced expertise in legal reasoning, statutory interpretation, regulatory analysis, and complex commercial or public-law domains.
This role supports an AI research initiative focused on developing rigorous legal benchmarks. Selected experts will author or verify challenging multiple-choice assessment content, evaluate legal accuracy and reasoning quality, develop authoritative reference solutions, and help establish high-quality evaluation standards for advanced AI systems.
Key Responsibilities
Legal Question Authoring
- Create original multiple-choice questions that test substantive legal reasoning rather than surface-level recall
- Develop challenging problems within relevant areas of legal expertise
- Ensure questions are self-contained, precise, unambiguous, and independently solvable
- Design questions appropriate for undergraduate, advanced undergraduate, and postgraduate difficulty levels
- Produce one correct answer alongside nine plausible and carefully constructed distractors
Question Verification & Legal Review
- Review pre-written legal questions for accuracy, clarity, rigour, and completeness
- Identify ambiguity, incorrect legal assumptions, unsupported conclusions, or solvability issues
- Edit questions and answer choices where required
- Verify that designated correct answers are legally defensible under the stated facts and applicable framework
- Document substantive changes and explain the reasoning behind them
Legal Reasoning & Reference Solutions
- Develop structured solution explanations supporting the correct answer
- Apply statutory interpretation, case-law analysis, regulatory reasoning, and jurisprudential principles where relevant
- Explain why alternative answers are legally weaker or incorrect
- Ensure reasoning is concise, technically precise, and suitable for expert review
- Translate complex legal concepts into clear assessment material
Corporate, Finance & Competition Law
- Develop or review content involving securities, capital markets, financial regulation, and compliance
- Create problems involving private equity, M&A, transaction structuring, and corporate transactions
- Apply expertise in antitrust, merger control, and competition law
- Evaluate legal and regulatory considerations affecting sophisticated commercial transactions
- Design questions requiring careful interpretation of regulatory frameworks and transactional structures
Technology, Privacy & Intellectual Property
- Develop assessment content involving intellectual property, technology law, and privacy
- Evaluate legal questions involving digital platforms, data governance, and emerging technologies
- Apply relevant statutory, regulatory, and doctrinal frameworks
- Create problems involving competing rights, obligations, and compliance requirements
- Ensure technology-related content reflects current legal reasoning and established authorities
Regulatory & Sector-Specific Law
- Develop content involving regulatory and government affairs
- Create questions covering healthcare, life sciences, and pharmaceutical regulation
- Apply expertise in environmental, energy, ESG, and climate-related legal frameworks
- Evaluate complex interactions between regulation, commercial activity, and public policy
- Develop domain-specific questions requiring advanced legal judgement
Academic Research & Benchmark Quality
- Provide 1–5 authoritative legal or academic references per question where required
- Use reputable sources such as legal repositories, statutes, judicial decisions, peer-reviewed publications, and academic institutions
- Rate question difficulty according to defined Medium, Hard, and Expert standards
- Help maintain consistent legal and academic quality across benchmark content
- Contribute to gold-standard evaluation materials used to assess advanced AI capabilities
Ideal Profile
- JD, LLM, SJD, or doctoral-level training in Law or a closely related discipline
- Master's-level candidates may be considered where they demonstrate exceptional depth in a relevant legal subdomain
- Strong command of legal reasoning, statutory interpretation, and jurisprudential analysis
- Expertise in one or more areas including Intellectual Property, Privacy, Technology Law, Regulatory Affairs, Securities, Capital Markets, Financial Regulation, Private Equity, M&A, Antitrust, Healthcare, Life Sciences, Environmental Law, Energy Law, or ESG
- Excellent written English and ability to communicate complex legal concepts clearly and precisely
- Legal academic research or publication experience is highly valued
- Experience with bar examination writing, legal assessment development, or judicial clerkships is advantageous
- Strong attention to legal accuracy, ambiguity, citation quality, and analytical rigour
Engagement Details
- Part-time independent contractor engagement
- Fully remote and asynchronous
- Expected availability of at least 10 hours per week
- Flexible scheduling based on project requirements
- Compensation: $70–$95/hour
- Contributors may be assigned either question-authoring or question-verification workstreams
- Projects may be extended, shortened, or concluded based on project needs and performance
- Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
- H1-B and STEM OPT support is unavailable for this engagement
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.