Remote Data Labeling Specialist (Canada)

Remote Data Labeling Jobs in Canada (Full Time)

Rex.zone supports AI/ML training pipelines through data labeling, RLHF evaluation, prompt evaluation, and QA checks. You will apply annotation guidelines compliance to improve training data quality for large language models and computer vision systems.

Key Responsibilities

• Produce accurate labels for NLP and computer vision tasks
• Perform RLHF ranking and pairwise preference judgments for LLM training
• Execute prompt evaluation and rubric-based scoring for model outputs
• Apply named entity recognition and taxonomy tagging
• Complete content safety labeling with clear rationales
• Run QA evaluation workflows including audits, cross-checks, and error analysis
• Track annotation guidelines compliance and propose guideline improvements
• Escalate ambiguous cases and contribute to calibration sessions that improve inter-annotator agreement ...