Overview

We are looking for a Transformer Model Expert to join our AI Research team. In this role, you will lead the development and optimization of state-of-the-art transformer-based language models that power our core AI products.

Key Responsibilities

• Design, implement, and optimize transformer-based neural network architectures
• Lead research initiatives to advance the state-of-the-art in language model capabilities
• Develop novel approaches to improve model efficiency, reduce computational requirements, and enhance performance
• Implement techniques for model alignment, safety, and ethical considerations
• Collaborate with cross-functional teams to integrate research advancements into production systems
• Stay current with the latest research in transformer models and related fields
• Publish research findings in top-tier conferences and journals

Requirements

• Ph.D. or M.S. in Computer Science, Machine Learning, or related field
• 3+ years of experience working with transformer architectures (e.g., GPT, BERT, T5)
• Strong publication record or demonstrable expertise in NLP and deep learning
• Proficiency in PyTorch or TensorFlow and distributed training frameworks
• Experience with large-scale model training, fine-tuning, and optimization
• Solid understanding of attention mechanisms, positional encodings, and other transformer components
• Excellent programming skills in Python and familiarity with ML engineering best practices

Preferred Qualifications

• Experience with model compression techniques (quantization, distillation, pruning)
• Knowledge of reinforcement learning from human feedback (RLHF)
• Familiarity with multi-modal models combining text, vision, and audio
• Experience with efficient inference and deployment of large language models
• Contributions to open-source ML projects or frameworks