home/categories/architecture-patterns/nvidia-nemo-megatron-bridge-skills-perf-techniques-hybrid-context-parallel-skill-md
architecture-patternsdevelopment
hybrid-context-parallel
Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification. Use when the user asks about hierarchical_context_parallel_sizes, a2a+p2p, CP scaling beyond KV heads, or multi-level context parallelism.
maintainer
NVIDIA-NeMo
Updated 3/20/2026
Stars
560
Forks
263
quick start
Installation and usage
Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification. Use when the user asks about hierarchical_context_parallel_sizes, a2a+p2p, CP scaling beyond KV heads, or multi-level context parallelism.
Installation
$ install --globalskills.sh
Usage
Once installed, you can use this skill by running the following command in your terminal:
skills use hybrid-context-parallel