About the job Remote | Corporate Counsel (Germany) — $135–$145/hour
We are sharing a specialised part-time consulting opportunity for experienced in-house legal professionals practising in Germany with strong expertise in German commercial and contract law.
This role supports a legal AI evaluation initiative focused on assessing how accurately advanced AI systems answer real-world questions involving German law. Selected professionals will run identical legal prompts across two AI platforms, compare their responses side by side, score each answer using a standardised rubric, and provide concise written feedback grounded in professional legal judgment.
Key Responsibilities
German Legal Analysis
- Review AI-generated answers to realistic questions involving German law
- Assess legal accuracy, completeness, reasoning quality, and practical relevance
- Apply professional in-house counsel judgment to commercial and contractual matters
- Identify incorrect legal conclusions, missing considerations, or unsupported reasoning
- Evaluate whether responses appropriately reflect German legal practice
AI Response Comparison
- Run identical prompts across two AI platforms
- Compare outputs side by side using consistent evaluation criteria
- Identify meaningful differences in legal reasoning, accuracy, and usefulness
- Determine which response provides stronger support for the relevant legal question
- Flag errors or omissions that could materially affect legal decision-making
Scoring & Evaluation
- Score each response against a provided standardised rubric
- Apply evaluation criteria consistently across assignments
- Distinguish substantive legal weaknesses from minor presentation issues
- Ensure scoring reflects both doctrinal accuracy and practical legal usefulness
- Work independently while maintaining consistent evaluation standards
Written Legal Feedback
- Provide concise written justification for each evaluation
- Explain significant legal errors, omissions, or reasoning weaknesses clearly
- Document why one response performs better where relevant
- Communicate findings precisely and efficiently
- Meet agreed project deadlines and quality requirements
Ideal Profile
Strong candidates may have:
- At least 5 years of professional experience as in-house legal counsel practising in Germany
- Strong knowledge of German law
- Substantial experience with commercial and contract matters
- Experience advising businesses on practical legal issues
- Strong ability to evaluate complex legal reasoning
- Excellent written communication and attention to detail
- Ability to work independently according to structured evaluation criteria
- Current professional experience or substantial recent experience in the German legal environment
Educational Background
- A legal degree or equivalent professional legal qualification is highly relevant
- Professional qualification appropriate to legal practice in Germany may strengthen an application
- Substantial in-house legal experience involving German commercial and contract law is particularly important for this engagement
Nice to Have
- Experience reviewing or comparing legal research produced by other professionals
- Background advising multinational or complex commercial organisations
- Experience with technology, software, or AI-related legal matters
- Familiarity with legal research or legal technology platforms
- Prior experience with structured legal evaluation, benchmarking, or rubric-based review
- Experience evaluating AI-generated legal content
Why This Opportunity
- Apply German legal expertise to advanced legal AI evaluation
- Review realistic questions grounded in commercial and contract practice
- Compare the performance of multiple AI systems using professional legal judgment
- Help improve the accuracy and reliability of AI-generated legal analysis
- Participate in a focused remote engagement with competitive hourly compensation
- Potential for additional work following the initial project scope
Contract Details
- Independent contractor role
- Fully remote within Germany
- Candidates must have at least 5 years of in-house legal experience practising in Germany
- Initial project commitment of approximately 10 hours, with potential for additional work
- Competitive rates between $135–$145 per hour depending on expertise and project scope
- Work may include AI response comparison, legal analysis, rubric-based scoring, and written evaluation
- All project work is covered by confidentiality requirements and NDA
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or adjusted depending on scope and performance
- Work will not involve access to confidential or proprietary information from any employer, client, or institution
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.