Annotator, AI Ops & Enablement
-
Annotate and evaluate complex or ambiguous AI responses, including sensitive customer journeys, using approved rubrics and reference materials.
-
Conduct assigned peer reviews and quality audits. Identify labeling errors, give evidence-based feedback, and refer unresolved disagreements to the Manager.
-
Support calibration sessions and reviewer onboarding through worked examples, coaching, and documented interpretations. Recommend guideline changes for approval.
-
Demonstrates critical thinking on being able to question whether a response is truly correct rather than just plausible, check claims against source material, and reach well-reasoned conclusions on complex or ambiguous cases.
-
Analyze recurring failures in correctness, completeness, policy alignment, context handling, and escalation quality. Separate observed failures from suspected causes.
-
Prepare reproducible issue reports with conversation context, expected behavior, supporting references, and severity under the approved taxonomy. Support remediation follow-up.
-
Curate assigned reference cases and test datasets, covering material edge cases and preserving version history, labeling rationale, and traceability.
-
Perform launch, regression, and post-remediation evaluations. Compare results against agreed criteria and escalate critical defects promptly to the Manager.
-
Identify gaps or contradictions in approved reference content during evaluation. Document their effect on AI responses and refer findings to the relevant Operations owners for resolution.
-
Identify recurring workflow friction and suggest improvements to review tools, reporting, or sampling. Follow approved data-handling controls and validate any automated evaluation support through human review.
-
2+ years of relevant experience in annotation, AI evaluation, quality assurance, content review, or customer operations, with demonstrated handling of complex review cases.
-
Practical experience applying structured review criteria to conversational AI, LLM outputs, or comparable quality workflows; understanding of hallucinations and source-grounded responses.
-
Strong judgment in ambiguous cases, with the ability to explain decisions, identify patterns, and distinguish evidence from assumptions.
-
Continuous improvement mindset: learns from feedback and calibration, and proactively suggests practical ways to improve guidelines, workflows, and tools.
-
Experience supporting peer review, calibration, coaching, or structured issue reporting. Strong written English and attention to detail.
-
Experience with RAG evaluation, multilingual reviews, or fintech, crypto, and trading products.
-
Familiarity with annotation platforms, spreadsheets, SQL, or Python for analysis. Mandarin fluency is an advantage.
Perks & Benefits
- Competitive total compensation package
- Various team building programs and company events
- Wellness and meal allowances
- Comprehensive healthcare schemes for employees and dependants
- More that we love to tell you along the process!
About OKX
OKX is a leading global Web3 technology company and cryptocurrency exchange, dedicated to building the future of decentralized finance and digital asset ownership. With a robust presence and growing operations across Colombia, Argentina, and Mexico, we provide a secure, innovative, and user-friendly platform for millions worldwide to trade, invest, and explore the vast potential of the blockchain ecosystem. We're at the forefront of developing cutting-edge solutions, from advanced trading tools and DeFi protocols to immersive metaverse experiences and NFT marketplaces, all powered by our unwavering commitment to security and transparency. Our culture at OKX is driven by innovation, collaboration, and a passion for pushing the boundaries of what's possible in Web3. We foster an environment where bright minds are empowered to contribute to a decentralized future, thrive on challenging projects, and grow alongside pioneering technology. We value diversity of thought, encourage continuous learning, and believe in building a team that is as global and interconnected as the blockchain itself. Joining OKX means being part of a dynamic, fast-paced team that is shaping the next generation of the internet. If you're a blockchain professional eager to make a tangible impact and contribute to a truly global platform, OKX offers unparalleled opportunities. We're seeking visionary talent in LATAM to join our mission of making crypto and Web3 accessible to everyone, everywhere. Come build with us and play a pivotal role in accelerating the adoption of decentralized technologies, empowering individuals, and revolutionizing financial systems around the world.
Ready to Apply?
To submit your application for this position, please visit OKX's official website and follow their application process.