文稿說(shuō)明案例mod03packet forwarding

Nexus9000StandaloneMode

PacketForwarding

ThenextgenerationofdatacenterswitchingForwardingBehavior

OverviewThismodulewillexplore:UnicastForwardingMulticastForwardingAccessControlListsQualityofServiceBufferManagementForwardingBehaviorUnicastForwardingEPPFabricModuleAdditionalL2/L3LookupEgressACLPacketModificationParsingEPPEgressPipelineonPacketProcessorEgressI/OModuleMACMAC1G/10G/40G1G/10G/40GForwardingBehavior–Unicast

Pipeline–Nexus9500OverviewParserTunnelTerminationL2/L3LookupIngressACLBufferingandSchedulingIngressPipelineonPacketProcessorIngressI/OModuleUnicastVoQNXOSModeOnlyForwardingBehavior–Unicast

PacketProcessorPipeline–IntelligentParserExaminesingresspacketsfromallphysicalportsEthernetPortsHiGigportsCMICportParsethefirst128bytesofpackettoextractinformationincluding:Layer2headerEtherTypeL3headerTCP/IPprotocolsTheextractedinformationissavedfordifferentsearchenginestouse.ParserTunnelTerminationL2/L3LookupIngressACLBufferingandSchedulingIngressPipelineonPacketProcessorNXOSModeOnlyForwardingBehavior–Unicast

PacketProcessorPipeline–TunnelTerminationTunnelTerminationdetermineswhetherthedeviceisthetunnelendpointfortheincomingtunnelpackets(IP,VxLAN,etc).

IfthetunnelheaderlookupresolvesamatchinMY_STATIONtable,thenthedeviceisbethetunnelendpoint,willproceedforthefurtherprocessofinnerpacket.ParserTunnelTerminationL2/L3LookupIngressACLBufferingandSchedulingIngressPipelineonPacketProcessorNXOSModeOnlyForwardingBehavior–Unicast

PacketProcessorPipeline–Layer2/Layer3LookupL2Switchinglogicperforms:VLANlookupL2unicastlookupL2multicastlookupMACsourceaddresslookupsforhardware-basedlearningL3Routinglogicperforms:L3unicastlookupL3multicastlookupLPMlookupLineCardonlyinstalls/0inLPMtableuRPFchecksParserTunnelTerminationL2/L3LookupIngressACLBufferingandSchedulingIngressPipelineonPacketProcessorNXOSModeOnlyForwardingBehavior–Unicast

PacketProcessorPipeline–ForwardingTableScalingThepacketProcessorusesUnifiedForwardingTable(UFT)toflexiblyaccommodatethreeforwardingtablesbasedondifferentdeploymentscenarios:Layer2TableLayer3HostRoutesTableLPM(LongestPrefixMatch)TableParserTunnelTerminationL2/L3LookupIngressACLBufferingandSchedulingIngressPipelineonPacketProcessorNXOSModeOnly4kx420bits4kx420bitsbank-0bank-116kx420bits16kx420bits16kx420bits16kx420bitsbank-2bank-3bank-4bank-51kx420bits1kx420bits1kx420bits1kx420bitsbank-6bank-7bank-8bank-9DedicatedL2MACEntries:32kx105bitsSharedEntries:256kx105bitsDedicatedL3HostEntries:16kx105bitsModeL2L3HostsLPM0288K16K01224K56K02160K88K0396K129K0432K16K128KSUPPORTEDCOMBINATIONSThePacketProcessorhasa16KtraditionalLPMTCAM.Inadditiontoit,thePacketProcessorhasthefollowingUnifiedForwardingTable:FabricmodulePacketprocessorisprogrammedinMode4togetthemaxLPMtable.LinecardPacketProcessorisprogrammedinMode2togetlargeandbalancedLayer-2MACtableandLayer-3Hosttable.ForwardingBehavior–Unicast

PacketProcessorPipeline–UnifiedForwardingTableNXOSModeOnlyForwardingBehavior–Unicast

UnicastScaleonNexus9500withMerchant+LeveragePacketProcessorUFT(UnifiedForwardingTable)todistributeforwardinginformationacrossLineCardandFabricModuleTables.Layer-2MACTableandLayer-3HostRoutesTableareonLineCardsLPMRouteTableisonFabricModulesInstalladefaultroute/0onLineCardsusingthevirtualMODIDofFabricModuleastheDMODtoforceLineCardstoforwardLPMpacketstoFabricModules;FabricModulesperformLPMlookupandforwardpacketstotheresolvedDMOD/DPORTPPFabricCardPPPPEPPLineCardFeatureScaleLPMRoutes128KFeatureScaleHostRoutes88K*MACAddresses160K*SharedwithmulticastNXOSModeOnlyForwardingBehavior–Unicast

UnicastScaleonNexus9500withMerchant+OnlyLayer-2MACandLayer-3hostroutesarelookedupontheingressLineCard.AdefaultrouteisprogrammedontheLineCardtopointtoFabricModulesforLongestPrefixMatch(LPM)lookup.AlltheLineCardPacketProcessorASICshavethesameentries.ThisallowsscaletothecapacityofasinglechipofaLCforLayer-2MACaddressesandLayer-3hostroutes.AllPacketProcessorASICsontheFabricModuleshavethesameentriesscalingthecapacityofachipforLayer-3LPMlookups.Eachlookupprovidesaresultintermsofa(destination-module,destination-port)tuplethatallowsforpacketstobesenttotheappropriatelinecardandport.NXOSModeOnlyForwardingBehaviorNexus9500UnicastPacketWalkForwardingBehavior–UnicastPacketWalk

Layer-2FabricModulePPParserNetworkInterfacesL2/L3Lookup&pktrewriteEPP10GE40GEEACLEgressQVOQExaminesingresspacket.Getpacketheadersforprocessing.PPParserL2/L3Lookup&PktrewriteEPPEACLEgressQVOQPPTrafficClassification&RemarkingAdditionalbuffertoabsorbMicroburstandPortSpeedmismatchIACLTrafficClassification&RemarkingIACL*ForLineCardswithoutEPPASICs,theforwardingstepsbyEPPdonotapply.NetworkInterfaces10GE40GEL2/L3LookupfindsthedestinationMACinLayer-2MACtableandresolvesDMOD/DPORT.PacketissenttoFMwithDMOD/DPORTintheinternalheaderFMsendspackettoegressLCbasedonDMOD/DPORTintheinternalheaderEgressLCsendspackettotheegressportbasedonDMOD/DPORTintheinternalheaderNXOSModeOnlyForwardingBehavior–UnicastPacketWalk

Layer-3–

HostRouteFabricModulePPParserNetworkInterfacesL2/L3Lookup&pktrewriteEPP10GE40GEEACLEgressQVOQExaminesingresspacket.Getpacketheadersforprocessing.PPParserL2/L3Lookup&PktrewriteEPPEACLEgressQVOQPPTrafficClassification&RemarkingAdditionalbuffertoabsorbMicroburstandPortSpeedmismatchIACLTrafficClassification&RemarkingIACL*ForLineCardswithoutEPPASICs,theforwardingstepsbyEPPdonotapply.NetworkInterfaces10GE40GEL2/L3LookupfindsthedestinationIPaddressinLayer-3Hosttable,andresolvesDMOD/DPORT.PacketissenttoFabricModulewithDMOD/DPORTintheinternalheaderFMsendspackettoegressLCbasedonDMOD/DPORTEgressLCsendspackettotheegressportbasedonDMOD/DPORTNXOSModeOnlyForwardingBehavior–UnicastPacketWalk

Layer-3–LongestPrefixMatchFabricModulePPParserNetworkInterfacesL2/L3Lookup&pktrewriteNorthStar10GE40GEEACLEgressQVOQExaminesingresspacket.Getpacketheadersforprocessing.PPParserL2/L3Lookup&PktrewriteEPPEACLEgressQVOQPPTrafficClassification&RemarkingAdditionalbuffertoabsorbMicroburstandPortSpeedmismatchIACLTrafficClassification&RemarkingIACL*ForLineCardswithoutEPPASICs,theforwardingstepsbyEPPdonotapply.NetworkInterfaces10GE40GEL3LPMlkup&PcktRe-WriteL2/L3Lookuphitsthedefaultroute.PacketissenttoFabricModuleusingitsvirtualMODIDasDMODintheinternalheader.FabricModuledoesL3LPMlookupandresolvesDMOD/DPORTFabricModulesendspackettoegresslinecardwithDMOD/DPORTintheinternalheaderEgresslinecardsendspackettoegressportbasedonDMOD/DPORTNXOSModeOnlyFabricModulePPEPPFabricModuleFabricModule4:1Mux10GEPorts40GEPorts4:1Mux10GEPorts40GEPortsForwardingBehavior–UnicastPacketWalk

LocalSwitchingon48/4AccessLineCardsEPPEPPEPPPPPPTrafficfromfastporttoslowportisforwardedtoNorthStarforadditionalbuffer.TrafficfromslowporttofastportislocallyswitchedonTridentII.TrafficbetweensamespeedportsislocallyswitchedonTridentII.PPPPNXOSModeOnlyForwardingBehavior–UnicastPacketWalk

Nexus9500Layer2LookupExampleVVVVVVVVV48e1/1LC-1-EPPLC-1--PP48e5/1LC-5-EPPLC-5-PPFC-1TR2-1FC-1PP-2FC-1PP-1FabricModule(VirtualModule90)Module:1Module:5MACDST-MODDST-PORTNH01:01:01:01:01:0111-02:02:02:02:02:02548PC-0MACDST-MODDST-PORTNH01:01:01:01:01:0111PC-002:02:02:02:02:02548-PortChannel-0PortChannel-0PortChannel-1PortChannel-5PortChannel-1Port-Channel1MAC01:01:01:01:01:01learnedone1/1MAC02:02:02:02:02:02learnedone5/48L2MACEntriesonLineCardT2L2MACEntriesonLineCardT2LegendFC-<S>FabricCard–SlotLC-<S>-NSLineCard–Slot–NorthStarLC-<S>-T2LineCard–Slot–TridentIIT2-<C>TridentII-ChipNXOSModeOnlyVVVVVVForwardingBehavior–UnicastPacketWalk

Nexus9500Layer2LookupExample(Cont’d)VVV48e1/1LC-1-EPPLC-1--PP48e5/1LC-5-EPPLC-5-PPFC-1TR2-1FC-1PP-2FC-1PP-1Module:1Module:5MACDST-MODDST-PORTNH01:01:01:01:01:0111-02:02:02:02:02:02548PC-0MACDST-MODDST-PORTNH01:01:01:01:01:0111PC-002:02:02:02:02:02548-PortChannel0PortChannel0PortChannel-1PortChannel5PortChannel1PortChannel1Layer-2framedestinedto02:02:02:02:02:02arrivedonporte1/1.IthittheentryinMACtableandresolves5/48asDMOD/DPORTPacketissenttowardsFabricModulewith5/48asDMOD/DPORTintheinternalheaderFabricModuleforwardspackettowardsLineCard5basedonDMOD/DPORT5/48intheinternalheaderLineCard5sendspacketontoporte5/48basedonDMOD/DPORT5/48intheinternalheaderAsinglelookuponIngressLineCardFabricModule(VirtualModule90)NXOSModeOnlyForwardingBehavior–UnicastPacketWalk

Nexus9500Layer-3HostRouteLookupExampleVVVVVVVVV48e1/1LC-1-EPPLC-1-PP48e5/1LC-2-EPPLC-2-PPFC-1TR2-1FC-1PP-2FC-1PP-1Module:1Module:5MACDST-MODDST-PORTNext

Hop01:01:01:01:01:0111-02:02:02:02:02:02548PC-0MACDST-MODDST-PORTNextHop01:01:01:01:01:0111PC-002:02:02:02:02:02548-IPDST-MODDST-PORTNH/32---3/3211-/32---/32548PC-0/090PC-0IPDST-MODDST-PORTNH/32---3/3211PC-0/32---/32548-/090PC-0Port-Channel0Port-Channel0Port-Channel1Port-Channel5Port-Channel1Port-Channel1HostIP3learnedone1/1HostIPlearnedone5/48FabricModule(VirtualModule90)3/32and/32areinL3HostRoutesTable3/32and/32areinL3HostRoutesTableNXOSModeOnlyVVVVVVVVV48e1/1LC-1-EPP48e5/1LC-5-EPPLC-5-PPFC-1TR2-1FC-1PP-2FC-1PP-1Module:1Module:5MACDST-MODDST-PORTNext

Hop01:01:01:01:01:0111-02:02:02:02:02:02548PC-0MACDST-MODDST-PORTNextHop01:01:01:01:01:0111PC-002:02:02:02:02:02548-IPDST-MODDST-PORTNH/32---3/3211-/32---/32548PC-0/090PC-0IPDST-MODDST-PORTNH/32---3/3211PC-0/32---/32548-/090PC-0Port-Channel0Port-Channel0Port-Channel1Port-Channel5Port-Channel1Port-Channel1LineCard5sendspacketontoporte5/48basedonDMOD/DPORTintheinternalheaderIPpacketdestinedtoarrivedonporte1/1.Lookuphitsthehostroute/32inthehostroutetable,andresolves5/48asDMOD/DPORTLC-1-PPIPpacketissenttowardsFabricModulewith5/48asDMOD/DPORTintheinternalheaderFabricModuleforwardspackettoLineCard5basedDMOD/DPORT5/48intheinternalheaderFabricModule(VirtualModule90)AsinglelookuponIngressLineCardForwardingBehavior–UnicastPacketWalk

Nexus9500Layer-3HostRouteLookupExampleNXOSModeOnlyForwardingBehavior–UnicastPacketWalk

Nexus9500Layer-3HostRouteLookupExampleVVVVVVVVV48e1/1LC-1-EPPLC-1-PP48e5/1LC-2-EPPLC-2-PPFC-1TR2-1FC-1PP-2FC-1PP-1Module:1Module:5MACDST-MODDST-PORTNext

Hop01:01:01:01:01:0111-02:02:02:02:02:02548PC-0MACDST-MODDST-PORTNextHop01:01:01:01:01:0111PC-002:02:02:02:02:02548-IPDST-MODDST-PORTNH/32---3/3211-/32---/32548PC-0/090PC-0IPDST-MODDST-PORTNH/32---3/3211PC-0/32---/32548-/090PC-0Port-Channel0Port-Channel0Port-Channel1Port-Channel5Port-Channel1Port-Channel1FabricModule(VirtualModule90)AdefaultrouteisinstalledinLineCardtableusingFabricModulevirtualmoduleIDasDMODIPDST-MODDST-PORTNH/24548PC-5IPPrefix/24islearnedfromporte5/48andprogramedinFabricCardLPMtableAdefaultrouteisinstalledinLineCardtableusingFabricModulevirtualmoduleIDasDMODNXOSModeOnlyVVVVVVVVV48e1/1LC-1-EPP48e5/1LC-5-EPPLC-5-EPPFC-1TR2-1FC-1PP-2FC-1PP-1Module:1Module:5MACDST-MODDST-PORTNext

Hop01:01:01:01:01:0111-02:02:02:02:02:02548PC-0MACDST-MODDST-PORTNextHop01:01:01:01:01:0111PC-002:02:02:02:02:02548-IPDST-MODDST-PORTNH/32---3/3211-/32---/32548PC-0/090PC-0IPDST-MODDST-PORTNH/32---3/3211PC-0/32---/32548-/090PC-0Port-Channel0Port-Channel0Port-Channel1Port-Channel5Port-Channel1Port-Channel1LineCard5sendspacketontoporte5/48basedonDMOD/DPORTintheinternalheaderIPpacketdestinedtoarrivedonporte1/1.Lookuphitsthedefaultroute,andresolvesFabricModulevirtualmoduleID90asDMODLC-1-PPIPpacketissenttowardsFabricModulewith90asDMODtheinternalheaderFabricModuledoesanLPMlookupandhitstheentryfor/24FabricModule(VirtualModule90)IPDST-MODDST-PORTNH/24548PC-5FabricModulesendstraffictoLineCard5with5/48asDMOD/DPORTintheinternalheaderTwolookups,oneoningresslinecard,oneonfabricmoduleForwardingBehavior–UnicastPacketWalk

Nexus9500Layer-3LPMExampleNXOSModeOnlyForwardingBehaviorMulticastForwardingForwardingBehavior–Multicast

Nexus9500MulticastHighlightsHighPerformanceLinerateL2andL3multicastthroughputLowlatencyatscaleHighScalability40KmulticastroutesOptimizedmulticastlookupandreplicationIP-basedlookupforLayer-2andLayer-3multicasttoavoidaliasingprobleminmulticastIP-to-MACencodingMulti-stagepacketreplication:Ingress,FabricandegressreplicationSupportedMulticastFunctionsIGMPSnoopingIGMPv1,v2andv3supportPIM-SMPIM-ASM

Nexus9500SeriesSwitchesNXOSModeOnlyForwardingBehavior–Multicast

MulticastScaleonNexus9500PPFabricCardPPPPASICEPPLineCardFeatureScaleLPMRoutes128KFeatureScaleLayer-3HostRoutes88K*Layer-2MACaddresses160K*SharedwithmulticastSharedbetweenIPHostsandMulticastroutes.Eachmulticastroutetakes2entries.Intheory,thistablecanholdupto44Kmcastroutes.UnusedFeatureonFMScaleLayer-3HostRoutes16KLayer-2MACAddresses32KThese16Khostentrieswillbeusedtoprogramupto8Kmcastroutes.These32KcanbeusedtoprogramLayer-2mcastgroupsforadditionalmcastscalingbeyond8KonafabricmoduleNXOSModeOnlyForwardingBehavior–Multicast

AliasingProbleminMulticastIPtoMACMappingDuringMulticastIPtoMACmapping,5configurablebitsarelost.The5bitsarethemostsignificant5configurablebitsinanmulticastIPaddress.32multicastIPaddresseswillbeencodedintothesamemulticastMACaddress.1110xxxx|xxxxxxxx|xxxxxxxx|xxxxxxxx4bits28bitsMulticastIPAddressRange:~5501:00:5E:xx:xx:xx0xxxxxxxx24+1=25bits23bitsMulticastMACAddressRange:01:00:5E:00:00:00~01:00:5E:7F:FF:FFNXOSModeOnlyFirst,(S,G)lookupinIPmcasttable.IfnohitorRPFcheckfailed,lookinL2tableandforwardaccordinglyifanyhits.

ForwardingBehavior–Multicast

MulticastLookupandScalingMulticastandIPHostsharethesametableresource(88Konalinecardand16Konafabricmodule)Eachmulticastentriestake2entriesL3multicastentriesareprogrammedsymmetricallyonalllinecardswithallOIFsontheswitchL2multicastentriesareprogrammedwithlinecardlocalOIFsFabricModuleIPMcast+IPHost=88KL3McastGrp:GlobalOIFsL2McastGrp:LocalOIFsacopyissendtowardsFMVlan10Vlan10Vlan20EPPPPIngressLCIPMcast=16KEntries(8KIPmcastroutes)L2Mcast=32K(32KMACmcastgrps)PPIPMcast+IPHost=88KL3McastGrp:GlobalOIFsL2McastGrp:LocalOIFsacopyissendtowardsFMVlan10Vlan10Vlan20EPPPPEgressLCSystem-wide40KMulticastRoutesNXOSModeOnlyFabricModuleEPPTrident2IngressLCVlan10Vlan10Vlan20EPPTrident2EgressLCIPMcast=16K(8KIPmcastroutes)PPForwardingBehavior–Multicast

MulticastReplicationandForwardingIngresslinecardperformslocallookupandreplicationforlocalreceivingportsIngresslinecardsendsonecopyofmcastpackettoFabricModuleFabricModulelooksupforegresslinecardandsendsonecopytoeachegresslinecardEgresslinecardperformslocallookuptoreplicatepacketstoitslocalreceivingportsEachEgressporthas4mcastqueuesfor4serviceclassesVlan10Vlan10Vlan20IPMcast+IPHost=88KL3McastGrp:GlobalOIFsL2McastGrp:LocalOIFsacopyissendtowardsFMIPMcast+IPHost=88KL3McastGrp:GlobalOIFsL2McastGrp:LocalOIFsacopyissendtowardsFMFirst,(S,G)lookupinIPMcasttable.IfnohitorRPFcheckfailed,lookinL2tableandforwardaccordinglyifanyhits.L2Mcast=32K(32KMACmcastgrps)NXOSModeOnlyForwardingBehavior–Multicast

L2/L3MulticastPacketWalkFabricModulePPParserNetworkInterfacesL2/L3Lookup&pktrewriteEPP10GE40GEEACLEgressQMcastQPPParserL2/L3Lookup&PktrewriteEPPEACLEgressQMcastQPPIACLTrafficClassification&RemarkingIACLTrafficClassification&Remarking*ForLineCardsw/nEPPASICs,theforwardingstepsbyEPPdonotapply.NetworkInterfaces10GE40GELkupinHostTable&L2TableLookuptoresolveegr.modules;Sendsonecopytoeachegr.module;L2/L3mcastlkup;Replicatepcktstolocalreceivingports;Send1copytofabricmodule;Examinesingresspacket.Getpacketheadersforprocessing.NorthStarforwardpcktstoFabricModuleNorthStarforwardpcktstolocalT2Lookupforlocalreceivingports;replicatepktsontothoseports.NXOSModeOnlyForwardingBehavior–Multicast

StandaloneIGMPSnoopingSourceIPandgroupaddressbasedforwardingforIGMPv3snoopingevenwhenN9000isL2switchCanfiltertrafficbasedonsourceIPforIGMPv3NoconcernofoverlappingmulticastMACaddressesH0Group:Include:v3Report(2)MulticastMACbasedforwardingIPbasedforwardingVLAN100100.5E01.0101eth1/1VLAN10eth1/1NXOSModeOnlyForwardingBehaviorACLSupportForwardingBehavior–AccessControlLists

PacketProcessorPipeline–ForwardingTableScalingTheACLModule(AC)performsthefollowingfunctionsSecurityACLs:IFACL,VACL,RBACLQoSACLs:ClassificationSupervisorRedirect:TrafficbasedSPAN:Ingress/EgressSPANsessionclassification,packetsamplingNetworkAddressTranslation(NAT)PolicyBasedRouting(PBR)COPPtrafficclassificationParserTunnelTerminationL2/L3LookupIngressACLBufferingandSchedulingIngressPipelineonPacketProcessorNXOSModeOnlyForwardingBehavior–AccessControlLists

Nexus9500ACLSupportsNexus9500supportsawiderangeofACLtypes:(AllACLtypessupportIPv4,IPv6andMACwhenapplicable.)SupportedACLTypesSecurityACLPACL(PortACL)VACL(VLANACL)RACL(RouterACL)FEXPACL(FEXPortACL)QoS/ClassificationACLPortQoSACLVLANQoSACLL3QoSACLFEXQoSACLCoPPACLTrafficFilteringSPANACLSUPRedirect256256256256256256256256512512512512256256256256IngressEgressIngressACL:4Kentriesoneachlinecard(4x512banks+8x256banks)EgressACL:1Kentriesoneachlinecard(4x256banks)NXOSModeOnlyForwardingBehavior–AccessControlLists

Nexus9500DefaultACLTCAMAllocationTheallocationofbothingressandegressACLTCAMtodifferentACLtypesisuserconfigurable.Thedefaultsettingisshownbelow:9508-1#showhardwareaccess-listtcamregion|ex"=0"TCAMRegionSizes:IPV4PACLsize=512IPV4PortQoSsize=512IPV4VACLsize=256IPV4VLANQoSsize=256IPV4RACLsize=256EgressIPV4VACLsize=256EgressIPV4RACLsize=256IPV4L3QoSsize=256IngressSystemsize=256EgressSystemsize=256SPANsize=256IngressCOPPsize=2569508-1#[Note]ACLtypesthatarenotinthelisthavedefaultsizeof0Thissettingisuserconfigurable.Changestakeeffectonapermodulebasis.NeedtoreloadthemodulesorthesystemTheCLIcommandtoshowtheACLTCAMcarvingisshowhardwareaccess-listtcamregionTheCLIcommandtochangeACLTCAMcarvingishardwareaccess-listtcamregion[ACLtype][tcamsize]EachACLtypeneedsitsowndedicatedbank/banks;IPv4,IPv6orMACeachneedsdedicatedbank/banks;IPv6andMACACLsneedsdouble-widthentries,whichmeansIPv6orMACACLsneedatleast2banks;VACLisprogrammedsymmetricallyinbothegressACLandingressACL;NXOSModeOnly

ForwardingBehavior–AccessControlLists

Nexus9500ACLEntriesSharingWhensameACLpolicy(securityACLsuchasPACL,VACL,RACLorQoSACL)isappliedtomultipleinterfacesorVLANs,onlyonecopyisprogrammedinTCAMwhichissharedbythoseinterfacesandVLANs.EachACLpolicyhaslabel.ByassignsamelabeltomultipleinterfacesandVLANssameTCAMrulecanbeappliestomultipleinterfacesorVLANerfaceEthernet1/10ipportaccess-groupip-list-1ininterfaceEthernet1/11ipportaccess-groupip-list-1ininterfaceEthernet1/12ipportaccess-groupip-list-1inxyzeth1/10xyzeth1/11xyzeth1/12xyzLabelLabelipaccess-listip-list-110permitip/24/2420permitip/24/24NXOSModeOnlyForwardingBehaviorQoSandBufferManagementForwardingBehavior

QoS/BufferManagementIngressQoSClassificationPolicy-maptypeqos)MatchonCoS/IPPrecedence/DSCP/ACLSetqos-groupRemarkCoS/IPPrecedence/DSCPIngresspolicingNetwork-QoSPolicy-maptypenetwork-qosMatchonqos-groupEnablePFC

EgressQueuingandShapingPolicy-maptypequeueingEnableWREDorECN(defaultistaildrop)4user-definedclassesbasedonqos-group1controlclassforCPUand1classforSPANtraffic3PFCnon-dropqueues3PriorityqueuesNXOSModeOnlyShared12MBbufferShared10MBbufferforfabricboundtraffic;Shared30MBbufferforfrontpanelboundtraffic.UnicastVoQisusingthisbuffer.EPP10MB30MBToLocalPacketProcessorToFabricModulesPacketProcessor12MB(Shared)ModuleTypeBufferSize48-Port1/10GT+4-Port40G104MB48-Port1/10GT+4-Port40G104MB36-Port40G36MBNexus9508FabricModule24MBForwardingBehavior

QoS/BufferManagement-BufferAllocationNXOSModeOnly10MB20MB10MB12MBEPPPPFabricPorts0-11Higig2Ports0-11/0-71G/10Ports0-47/0-15ForwardingBehavior

QoS/BufferManagement-EPPBufferAllocationNXOSModeOnly10MB30MB12MBPP12MBPP12MBPP12MBPP10MB30MB12MBPP12MBPP12MBPPFabricModulePort1-48(10GE)Port49-52(40GE)Port1-12(40GE)Port13-24(40GE)Port25–36(40GE)EPPEPP48-Port1/10GT+4-Port40GI/OModule48-Port1/10GT+4-Port40GI/OModule36-Port40GI/OModuleForwardingBehavior

QoS/BufferManagement-BufferStructureNXOSModeOnlyFabricModuleFabricModuleFabricModuleTridentIINorthStar4:1MuxNorthStarTridentIITridentIITridentIITridentII1GE10GEForwardingBehavior

QoS/BufferManagement-LocalSwitching40GEEPP4:1MuxEPPPPIIPP1GE10GETrafficbetweenportsofthesamespeedislocallyswitchedonTridentII.TrafficfromfastporttoslowportisforwardedtoNorthStarforadditionalbuffers.TrafficfromslowporttofastportislocallyswitchedonTridentII.48/4AccessLineCardsNXOSModeOnlyForwardingBehavior

QoS/BufferManagement-EgressQueuingNexus9500switchesaredesignedwithegressqueuingarchitectureforsimpleandefficientbufferutilizationEPPASIConACIreadylinecardsprovidesadditionalbufferstosupportextendedegressqueuingforunicasttrafficEPPASIChasa30MBbufferfortrafficgoingtolinecardPPthatsupportsupto96x4extendedegressqueuesOOBFC(Out-of-BandFlowControl)SignalingbetweenlinecardPPandEPPcontrolsextendedegressqueuesonEPP.UnicasttrafficfromFabricmoduleandhair-pinnedlocalunicasttrafficfromlinecardPPgoesintotheextendedegressqueuesThePPhasadedicatedbufferpoolfortheextendedegressqueues.Othertraffic,includingPPlocallyswitchedUnicast,Multicast,andSPANtrafficshareanotherbufferpoolForeachUnicasttrafficclass,therearetwoqueuesontheegressTridentII,oneisfortrafficfromEPPextendedegressqueues,theotherisPPlocallyswitchedunicasttrafficNXOSModeOnlyAllusertraffic(unicast+multicast)andspantrafficControlTrafficDefaultSharedBuffer(12MB)Control

ForwardingBehavior

QoS/BufferManagementonPPThe12MBbufferonPPissharedforbothingressandegressandbyallTridentIIports.Thebufferiscarvedintotwoservicepools,includingcontrolanddefaultpools.Controlservicepoolisforcontroltrafficandisassigned450cells(~93KB)bydefault.Itsupports4user-defaultclassesinthedefaultservicepool,providing4uncastand4multicastuserdefinedqueuesandthespantrafficqueue.NXOSModeOnlyNon-OOBFCtraffic(locallyswitchedUnicast;Multicast;SPAN)ControlTrafficNon-OOBFCTrafficSharedBuffer(12MB)OOBFCUnicastControlOOBFCUnicastFraffic

ForwardingBehavior

QoS/BufferManagementonLine-CardPPThe12MBbufferonPPissharedforbothingressandegressandbyallPPports.Thebufferiscarvedintothreeservicepools,includingOut-of-bandFlowControl(OOBFC)traffic,Non-OOBFCtrafficandcontroltraffic.OOBFCclasstrafficisflow-controlledVoQunicasttraffic.Thereareupto96x4queues.Non-OOBFCclasstrafficincludesPPlocallys