Data Analyst – AI Translation Quality

Job Overview

As a Data Analyst, you will investigate how AI-generated translations perform across languages, customers, content types, and AI models. You will combine information from multiple data sources, evaluate translation quality, identify patterns, and help the engineering, product, and linguistics teams make evidence-based decisions.

The role requires curiosity, critical thinking, strong analytical skills, and the ability to independently define investigative approaches for open-ended business questions.

Key Responsibilities

• Define meaningful metrics for translation quality, AI performance, and user behavior.
• Monitor data trends and identify unusual quality patterns.
• Investigate analytical questions from initial observation through final recommendation.
• Develop hypotheses and validate them using available data.
• Collect and combine information from SQL databases, NoSQL databases, APIs, system logs, and exported datasets.
• Compare translation performance across language pairs, AI models, providers, customers, traffic levels, and content categories.
• Separate statistically meaningful findings from coincidence through careful validation.
• Review translation samples to verify whether observed patterns represent genuine quality issues.
• Investigate root causes and recommend practical improvements.
• Evaluate multilingual AI-generated content for meaning, terminology, grammar, tone, consistency, formality, and pronoun usage.
• Use AI tools, dictionaries, and research resources to investigate unfamiliar languages while recognizing when specialist linguistic expertise is required.
• Review AI-generated analytical output and identify inaccurate conclusions.
• Develop repeatable scripts, monitoring processes, and analytical reports.
• Communicate findings clearly to developers, product managers, and linguists.

Required Qualifications

• Strong analytical thinking and attention to detail.
• Ability to independently identify problems worth investigating.
• Experience transforming open-ended business questions into structured analytical investigations.
• Understanding of metrics, segmentation, distributions, correlations, and the distinction between correlation and causation.
• Experience writing SQL, Python, or similar scripts for data collection, cleaning, and analysis.
• Experience working with multiple data sources including databases, APIs, logs, and exported datasets.
• Hands-on experience using AI tools while critically evaluating their output.
• Fluent English together with at least one additional language, preferably a European language.
• Ability to assess translation quality and explain language-related findings.
• Strong written communication skills for presenting analytical insights to technical and non-technical audiences.

Preferred Qualifications

• Experience evaluating translation quality or localization processes.
• Experience working with multilingual content.
• Knowledge of data visualization or business intelligence platforms.
• Background in machine translation or language technologies.

Core Technical Skills

• SQL.
• Python.
• Data analysis.
• Machine translation quality evaluation.
• Large Language Models (LLMs).
• AI evaluation.
• Multilingual data analysis.
• API data collection.
• NoSQL databases.
• Statistical reasoning.

Work Arrangement

• 100% remote position.
• Working hours aligned with European, Middle Eastern, or African time zones.
• Collaboration with globally distributed engineering, product, and linguistics teams.
• Opportunity to propose and lead independent analytical investigations.

Benefits

• Fully remote work environment.
• Body and Mind Movement wellness program.
• Computer budget to improve your home workspace.
• Kindle device with access to the company Amazon account.
• National holiday recognition based on your country.
• Career growth and advancement opportunities.
• Collaboration with an international team across multiple countries.

Hiring Process

• Two to three interviews, each lasting approximately 60 to 90 minutes.
• Meetings with recruiters, the team leader, and future teammates.
• Successful candidates may be invited to complete a paid 14-day practical assignment.
• Following the assessment, selected candidates move to an Independent Contractor agreement and a three-month trial period.