Polish speaking Customer Support Representative

Position: Customer Support Representative

Location: Lisbon, Portugal

Work model: on-site

Employment type: Full-time

DUTIES AND RESPONSIBILITIES:

• Review and evaluate AI-generated responses using detailed quality and annotation guidelines
• Label and annotate language model outputs accurately and consistently
• Assess AI-generated content for quality, relevance, factual accuracy, safety and policy compliance
• Apply complex annotation guidelines across different scenarios and content types
• Identify inconsistencies, edge cases and potential quality issues and escalate them when required
• Review and analyse structured text, language data and AI-generated content
• Maintain high levels of accuracy and quality while meeting productivity targets
• Provide accurate evaluations, annotations and actionable feedback to support AI model improvement
• Maintain strict confidentiality and follow project, data security and quality standards
• Adapt to updated guidelines, processes and project requirements.

REQUIREMENTS:

• Native-level proficiency in Polish, with excellent written communication skills
• Good command of English (minimum B2 level)
• Strong understanding of Generative AI, Large Language Models (LLMs), and AI annotation or evaluation platforms
• Previous experience in AI data annotation, LLM evaluation, RLHF, SFT, Quality Assurance, Content Labeling, Trust & Safety or a similar analytical environment is highly desirable
• Excellent analytical and critical thinking skills with strong attention to detail
• Ability to make objective and evidence-based decisions
• Ability to interpret and consistently apply complex written guidelines and policies
• Strong reading comprehension and written language skills
• Ability to evaluate structured text, datasets and AI-generated content accurately
• Comfortable working in a fast-paced, quality-driven environment with productivity and accuracy targets
• Professional and reliable approach with strong integrity
• Ability to handle confidential and sensitive information with discretion.

BENEFITS:

• Modern office in a city center with open spaces, easy to access with public transportation
• Comprehensive initial training and guidance to make sure you're well prepared and comfortable at a new workplace
• Full-time employment in Lisbon
• 24/7 rotational working schedule
• 2 rotational days off
• Opportunity to work in the rapidly developing field of Generative AI and Large Language Models
• International and multicultural working environment
• Support from colleagues with coaching and mentoring opportunities
• Health and Wellbeing initiatives
• Monthly meal allowance