Partition key (PKey) configuration for multi-tenancy: Quick Reference — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)

Partition Key (PKey) Configuration for Multi-Tenancy: Quick Reference

In NVIDIA InfiniBand Networking, Partition Keys (PKeys) are essential for enabling multi-tenancy by logically isolating traffic within the same physical fabric. Proper PKey configuration ensures secure, efficient, and segregated communication between different tenants or workloads.

Key Facts and Definitions

• PKey: A 16-bit identifier used to partition the InfiniBand fabric into isolated segments.
• Partition: A logical grouping of nodes that share the same PKey, enabling communication only within that group.
• Multi-Tenancy: The ability to support multiple independent users or workloads on a shared physical InfiniBand network.
• Full Membership: Nodes with the exact PKey value can communicate freely.
• Limited Membership: Nodes with the PKey value having the 0x8000 bit set (high-order bit) can communicate in a limited manner, typically for management or restricted access.

Configuration Rules

• PKey Format: 16 bits total; lower 15 bits define the partition ID, highest bit defines membership type (full or limited).
• Default PKey: 0xFFFF (full membership) is the default partition allowing all nodes to communicate.
• Unique PKeys: Each tenant or workload must be assigned a unique PKey to isolate traffic.
• Consistency: All nodes in a partition must have the same PKey value configured on their ports.
• Port-Level Configuration: PKeys are configured per port and must be synchronized across switches and hosts.

Best Practices for Multi-Tenancy

• Segregate Tenants: Assign distinct PKeys to each tenant to prevent cross-tenant traffic leakage.
• Use Limited Membership: For management or monitoring partitions, use limited membership PKeys to restrict access.
• Synchronize PKey Tables: Ensure all switches and hosts have updated and consistent PKey tables to avoid communication failures.
• Automate Provisioning: Use uFM or other management tools to automate PKey assignment and verification.

Common Commands and Monitoring

• Show PKeys on a Port: ibv_devinfo -v or ibstat to view PKey tables.
• Configure PKey: Use ibportstate or switch management interfaces to add or modify PKeys.
• Validate Multi-Tenancy: Test communication isolation by verifying that nodes with different PKeys cannot communicate.

Summary

Partition Key (PKey) configuration is a foundational task for enabling multi-tenancy in NVIDIA InfiniBand Networking. By assigning unique PKeys and adhering to configuration rules, network administrators can ensure secure, isolated communication channels for multiple tenants sharing the same physical infrastructure.

More in this topic

Partition key (PKey) configuration for multi-tenancy — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)NVIDIA InfiniBand Networking — NVIDIA-Certified Professional: AI NetworkingInitial provisioning and high availability setup: Worked Example — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)QoS and adaptive routing implementation — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)Partition key (PKey) configuration for multi-tenancy: Worked Example — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)Initial provisioning and high availability setup: Common Mistakes — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)UFM-based monitoring of link status and bandwidth — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)Partition key (PKey) configuration for multi-tenancy: Common Mistakes — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)Initial provisioning and high availability setup — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)Initial provisioning and high availability setup: Quick Reference — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)Partition key (PKey) configuration for multi-tenancy: Practice Questions — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)QoS and adaptive routing implementation: Practice Questions — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)Initial provisioning and high availability setup: Practice Questions — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)QoS and adaptive routing implementation: Common Mistakes — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)QoS and adaptive routing implementation: Worked Example — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)QoS and adaptive routing implementation: Quick Reference — NVIDIA InfiniBand Networking (NVIDIA-Certified Professional: AI Networking)