Twinkle DOCUMENTATION

Usage Guide

• Quick Start
• Twinkle Installation
• Server and Client
• NPU (Ascend) Quick Start Guide
• Twinkle Training Service on ModelScope
• Qwen3.5 Training Best Practices
• Embedding Training

Components

• Dataset
  • Basic Dataset Components
  • Lazy Loading Dataset
  • Fixed-Length Packing Dataset
  • Streaming Dataset
  • Streaming Fixed-Length Packing Dataset
• Data Format
  • Message
  • Trajectory
  • Model Input
  • Model Output
  • Sampling Output
  • Model Output
• Template
  • Template
  • Template mapping
  • Template
  • Template mapping
  • DeepSeek-V4 Template
  • Tool Call Parsers
• Template
  • Template
  • Template mapping
  • Template
  • Template mapping
• Preprocessor and Filter
  • Preprocessor
  • Built-in Preprocessors
  • Filter
• Data Loading
  • DataLoader
• Task Processor
  • InputProcessor
• Model
  • TwinkleModel
  • TransformersModel
  • MultiLoraTransformersModel
  • MegatronModel
  • MultiLoraMegatronModel
  • Supported Models
• Model
  • TwinkleModel
  • TransformersModel
  • MultiLoraTransformersModel
  • MegatronModel
  • MultiLoraMegatronModel
• Sampler
  • Sampler
  • vLLMSampler
  • TorchSampler
• Reward
  • Reward
  • GSM8K Reward
  • MultiModal Reward
  • OlympiadBench Reward
• Advantage
  • Advantage
  • GRPOAdvantage
  • RLOOAdvantage
• Hub
  • Hub
• Checkpoint Engine
  • CheckpointEngine
  • NCCLCheckpointEngine
  • HCCLCheckpointEngine
• Metrics
  • TrainMetric
  • LossMetric
  • Accuracy
  • CompletionRewardMetric
  • DPOMetric
  • GRPOMetric
  • EmbeddingMetric
  • Building Metrics
• Loss
  • Cross Entropy
  • Chunked Cross Entropy
  • DPO Loss
  • GKD Loss
  • GRPO Loss
  • InfoNCE Loss
  • MSE Loss
  • Building New Loss
• Loss
  • Cross Entropy
  • Chunked Cross Entropy
  • DPO Loss
  • GKD Loss
  • GRPO Loss
  • MSE Loss
  • Building New Loss
• Loss Scale
  • Loss Scale
• LRScheduler
  • CosineWarmupScheduler
  • LinearWarmupScheduler
• Patch
  • Patch
• Plugin
  • Plugin
  • Service Security
• Kernel
  • Twinkle Kernel Module
• Training Middleware
  • DeviceMesh/DeviceGroup
  • Expert Parallel (EP)
  • Sequence Parallel (SP)
  • Padding-Free Training
  • RemoteClass
  • TwinkleClient
• CLI
  • CLI
• Notifier
  • Notifier
• Agentic
  • Agentic Preprocessor
  • Protocol
  • Multi-Turn Rollout
  • Tools & ToolManager
  • Environments (Envs)
  • Multi-Turn Tool Usage Guide
• Auto
  • Auto-Research
  • SkillProvider

Indices and tables

• Index

• Module Index

• Search Page