Tag Archives: Brocade Certified Ethernet Fabric Professional

BCEFP 2015 – Studying for the exam – part 3

This third post  focuses on the remaining sources of information I had for studying for the BCEPF. At the time this post is published I have taken the exam.

When I make comments to CLI commands I put them after a #.

This is part of a series of posts on the topic of studying for Brocade’s Certified Ethernet Fabric Professional.

The two previous posts: Objectives and reading materialscourse and nutshell guide and NOS Admin Guide

 

VDX Troubleshooting Course

 

The material available also feels very short, same as the beta material available for the CEF300 , like only the parts of the slides that were updated for the BCEFP 2015 beta were included.
When a slide says “(cont.)” but there was no previous slides on this topic, that’s a hint :)
Take the (currently free) course on Brocade’s SABA – it’s under Education on my.brocade.com. It has way more slides and info.

 

Some notes from the course:

Firmware Upgrade

  • Can upgrade all/selected RBridges in a logical chassis: firmware download logical-chassis
  • FTP/SCP/SFTP/USB(only local switch with USB)
  • By default it stages firmware only – so no reboot or activate. By adding auto-activate it reboots all RBRidges at the same time, not recommended.

SNMP

  • When BNA discovers a switch it automagically configures the switch to send traps (UDP 162) to the BNA server.

Fabric Formation:

  • Requires: Licenses. Same VCS ID, unique RBridge ID and same VCS mode (Fabric Cluster or Logical Chassis)
  • Check:
    • ISL ports are operational (show fabric islports)
    • Incompatible Firmware Levels

ISLs:

  • no fabric isl enable # this disables ISL formation. This makes it an edge port
  • CPU could be too busy to send ISL keepalives
  • If ISL is segmented and interface is up/up – it’s probably a config issue.

 

vLAGs:

  • show running-config interface TenGigabitEthernet 1/0/2 # shows config
    • no shutdown
    • channel-group $NUMBER mode active type standard # active – LACP. Standard/Brocade proprietary.
  • show interface TenGigabitEthernet 1/0/2 # shows status
    • When counters are non-zero and looking for errors. Clear them and compare the delta.

 

Other:

  • show interface stats brief # shows discards, errors and CRC
  • VRRP:
    • show vrrp detail
    • pre-empting : if a virtual router comes online with higher priority than the current it will take over
    • VRRPE: Can enable short-path-forwarding. If one of the backup virtual routers (that don’t own the Virtual IP) can actually forward traffic if that is advantageous.

 

FCoE:

  • show running-config zoning # show FCoE zoning
  • show fabric all #
    • RBRidge with this name: fcr_fd_160 # this comes online when fabrics are connected and Fibre Channel Routing is used.
    • RBRidge with this name: fcr_xd_4_100 # this comes online when devices across FC Fabrics can communicate. Don’t see this? Check zoning.

iSCSI:

BCEFP practice questions / answers

http://community.brocade.com/t5/Certification/BCEFP-2013-Exam-150-180-Practice-Questions/ta-p/4099

These are decent practice questions and is nice because the answers give some explanation to the answers too.

Other

Intro to VCS Fabric Technology: http://www.brocade.com/downloads/documents/white_papers/intro-vcs-fabric-technology-wp.pdf

CFP- MSA CFP2 Hardweare Specs:

  • about the 40/100Gbps CFP2 SFP. MSA – multi-source agreement.
  • CFP2 module shall support LC, MTP12 and MTP24 optical connector types. MPO

NOS 4.1.1 release notes (p4,10,28,50): 

  • 4.1.0 and later support VRRP-E across VCS fabrics.
  • 4.1.0 and later have vlag ignore split on by default
  • clear mac-address-table can clear MAC addresses associated with vLAGs and on other switches
  • Page 50 Has a table of scalability numbers for various features such as (6710 VCS, 6740 VCS, 8770 VCS):
    • max members of a LAG (8,16,8)
    • max switches in a fabric/logical cluster (24,32,32)
    • max ECMP paths (8,8,16)
    • max member ports in a vLAG (64)
    • max member of VMs (8k)
    • max ARP entries (8k,12,50k)

 

Network OS Command Reference v4.1.1 53-1003226-01

Pages 299, 1258-1260,1266,1297,1317,1318

  • firmware download
  • snmp-server user # access
  • snmp-server v3host # trap recipients
  • spanning-tree edgeport # quickly transitions to forwarding state: only for RSTP/MSTP. Portfast for STP.
  • switchport access # only allows untagged and priority tagged
  • switchport trunk allowed vlan ${rspan-vlan} # add allowed VLAN on trunks on L2 interfaces in trunk mode
  • switchport trunk default-vlan # put all non-matching traffic into this VLAN

 

Hardware reference manuals

VDX 6740 Hardware Reference Manual 53-1002829-02: Page 1

  • 6470: 24 1/10GbE SFP+ ports.
  • 6740T: 24 RJ-45
  • 6740-1G: 48 RJ-45 Base-T. 10Gb with license.

VDX 8770-4 / 8770-8 Hardware Reference Manual 53-1002563-03: 

  • Chapter 1, Page 1:
    • Features CloudPlex.
    • Requires NOS 3.0.0 or greater.
    • 8770-8:
      • Up to 384 10GbE or 96 40GbE. Dual MM. 6 SFM. Max 8 PSU. 4 Fans. SX or LX 1Gbps SFP transceivers.
    • 8770-4:
  • Chapter 3, Page 32
    • For copper connections to < 1Gbps BaseT switches a crossover cable is needed (but it might not be if MDI/MDIX works..).
    • LC connectors for fiber ports

VDX 6730 Hardware Reference Manual 53-1002389-06: Pages 1,2,15

  • 6730-32: 32-ports. 6730-76: 76 ports. 8 or 16 x 8GB FC ports.

 

Network OS Software Licensing Guide v4.1 53-1003164-01

Pages 11-13

  • All have FCoE license (except 6710).
  • All have POD licenses (except 8770)
  • 6740 have 10/40GbE port upgrades
  • 8770 have L3 and Advanced Services

Notes:

  • for multi-hop FCoE it is needed on each node
  • L3: OSFP, VRRP, PIM-SM, Route-Maps, prefix list
  • Advanced: FCoE and L3
  • After installing a time-based license you cannot change system date or time. NTP is however not blocked. If you are using NTP, don’t change system date/time when a time-based license is installed.

BCEFP 2015 – Studying for the exam – part 2

This second post  focuses on the NOS Admin Guide.

When I make comments to CLI commands I put them after a #.

This is part of a series of posts on the topic of studying for Brocade’s Certified Ethernet Fabric Professional.

The two previous posts: Objectives and reading materials and course and nutshell guide

The NOS 4.1.1 Admin Guide

I’ve been reading the pages on paper (together with a highlighter :) that I printed with the help of my script below and there is lots of goodness in there.
For sure some topics are brought up without any preamble so for these I just make a note in the paper that I need to check out this other thing later.
Especially the Fibre Channel things take up quite a lot of pages. I thought in these devices FC would not be with so much focus but it seems like they do re-use a lot of the things in FC that works.

Notes and acronyms (page in NOS Admin Guide):

  • DCB – lossless. Able to allocate bandwidth on links.
  • TRILL – transparent interconnections of lots of links.
  • RBridge – Routing Bridge. Lowest WWN or priority.
  • Looks like on p54 only the text about Logical Chassis cluster config is applicable.
  • Trunking between VDX8770 and B8000 are not supported (B8000 is some early version of FCoE from Brocade, not visible on Brocade’s page where they list their switches)
  • ECMP – Equal-cost multi-path routing (p149)
  • AG – VCS must be enabled for Access Gateway
  • AMPP – Automatic Migration of Port Profiles – some OK pictures around p375
  • VRF – Virtual Routing and Forwarding

 

Questions:

  • There is also a Openstack Neutron Plugin (p29)
  • Would be good to include also page 114 before page 115 to see what they mean with leaf/spine/core (p115)
  • OOB access to console is via serial (p115)
  • How to reload a group of switches? (p115)
    • reload system rbridge-id all
  • Does trill use IS-IS type link-state? (p136) Yes
  • Can VF_Ports be anywhere in the fabric? (p202) Yes, they must be mapped to N_Ports.
  • Is there no web interface on the VDX? (p269) Probably not, there are some “http server” and “ip http-server” commands.
  • What are valid upgrade paths? Not so clear. 3.0.0 to 4.0.0 is not OK. 3.0.1 to 4.0.0 is OK. (p341)
  • What is this netinstall? (p371) – 10 hits on google: brocade “netinstall” vdx
  • What does the asterisk mean in the output of “do show vcs” ? (p597) The one you are running the command on? Is not principal RBRidge, that is >.

 

Commands (# comments) (page):

  • backup config: copy rbridge-running-config rbridge-id rbridge-id location_config
    • copy rbridge-running-config rbridge-id 2 scp://user:pw@host
  • vcs
    • no vcs logical-chassis enable # remove a node from logical chassis cluster (p76)
    • vcs replace rbridge-id 3 # replace RBridge with id 3 (p77)
    • enable (p139)
    • virtual ip address 10.1.1.1 (p143)
  • config terminal # to enter global exec mode (p94)
  • firmware download (p119)
  • logical-chassis principal-switchover (p138)
    • and logical-chassis principal-priority are the only logical-chassis commands
  • disabling a port:
    • shutdown # on an ISL brings down link and FSPF adjacency.
    • no fabric isl enable #  link stays up, shorter reconvergence
  • show
    • vcs virtual-ip (p143)
  • vcenter/vnetwork # used to connect to a vcenter and to discover hosts. (p243)
  • bind # create persistent binding between logical FCoE port and 10G/40G/LAG port. Port or MAC, not both. (p345)
  • enable statistics direction # for VXLAN tunnels to enable statistics on VLANs. (p365)
  • no spanning-tree shutdown # default for all VLANs – meaning it’s enabled. (p381)
  • lacp system-priority 25000 # For deciding which system is in charge of resolving LAG conflicts. (p437)
  • nas server-ip IP/PREFIX # Set IPs for AutoQoS for NAS (p506)
  • address-family ipv4 unicast # Used to enter IPv4 config in a VRF (p609)
  • debug lacp pdu # turn on debug (p714)
    • terminal monitor # view debug messages in terminal

Printing the NOS Admin Guide relevant pages:

 

Because the slides for the BCEFP course were insufficient I would get a lot of the basic information about the NOS from the NOS Admin Guide.
In the materials provided the NOS Admin Guide was separated into two documents. The guide is of course available in one pdf. Go to the web version and click on the pdf icon.
This makes printing based on the numbers provided easier. However the NOS Admin Guide for v4.1.1 referenced was one version below the one on the html version.

Now the numbers referenced are the numbers in the document, not the one told by the pdf viewer. So actually page 11 is page 13. Page 135 is 137. 311 is 313. 425 is 427. 517 is 519. 661 is 663. 714 is 716.
I checked a few to make sure there were no major increase due to version difference or elsewhere. One could with a bit of scripting increase each number with two like:

1,13-22,28-33,56-58,77-79,96,117,121,137-146,151,152,193,203-205,212,245-249,255,263,271,313-316,323,324,340-347,363-387,402,405,408,427-435,439,467,485,497,506,508,519-523,543,561,565,567,585,595,596,599,605-611,663-665,670,678,684,688,716,717

Cover page added to make it look nicer when printing. Old numbers:

Network OS Administrator’s Guide v4.1.1 53-1003225-01

Pages 11-20,26-31,54-56,75-77,94,115,119,135-144,149,150,191,201-203,210,243-247,253,261,269,311-314,321,322,338-345,361-385,400,403,406,425-433,437,465,483,495,504,506,517-521,541,559,563,565,583,593,594,597,603-609,661-663,668,676,682,686,714,715

 

BCEFP 2015 – Studying for the exam

In a previous post I listed a some of the sources Brocade listed that one should use when studying for the BCEFP exam. Here I’m going through a those I found some comments on what what they are and what I think of them.

Beta Course Material

The first of the beta material available is something called “Brocade Ethernet Fabric Administration“. This is a few pdfs/slides with notes on them. Introduction of various features and components. Not much detail in the first 10 modules and basically all the modules are awfully short, some are one slide even. Hopefully this is just because it’s a beta. Progressively they become more detailed, which is good to not overwhelm the reader I guess. Checking out the data sheet for the CEF 300 course should give you some idea what you should learn after going through the materials. There are free materials available for the Ethernet Fabric Specialist Accreditation – it’s even on the tube. The youtube video is quite long but it’s an introduction to the thought behind the Ethernet Fabrics. It’s a bit outdated already I hope as they the talk talks about immaturity a lot, less than a year old. The presenter – Chip Copper – also mentions a Fabric Essentials 201 that should be out “later on down the line” – which is not out yet. Boo Urns!

Questions I got while reading material:

  • What is a hard-drop option in an extended ACL?
  • What does “override the control packet trap entries” mean? Brocade communities to the rescue. Is for normal transit traffic and traffic to the CPU == the management interface?

BCEFP Nutshell

I usually print these out, read through a few times and note down anything I don’t get so that I can go through the course materials and user guides to completely understand it. This one is vital.

Some really useful sections:

  • VCS Data Path
  • VCS Fabric – Layer 3 Routing

Some questions I needed to clarify after reading the BCEFP nutshell guide (page numbers):

  • Are there any new hardware represented in the BCEFP 2015 compared to the BCEFP 2013?
    • 6740 – 10GbE, 10GbE/FC and 40GbE ports
    • 6740T – 48 x 1/10GbE
  • VDX6720:
    • Is the VDX 6720-60 oversubscribed?
    • Is the difference between switching and forwarding bandwidth that one is how much the backplane can handle and the other is how much the ports could do?
      • Looks like that, an older version of the 6720 Data Sheet shows this, it’s been removed in a future data sheet.
  • VCS / Logical chassis / Distributed:
    • VCS Modes:
      • Logical Chassis: Requires NOS 4.0.0. Data and config paths are distributed. All is configured from the principal node.
        • Distributed
      • Fabric Cluster Mode: Data paths are distributed. Config is done independently on each node.
        • 8770 and 6740* boot up into this mode by default.
        • Local Only
    • Standalone Mode: Only compact switches support this restricted mode – 6710-6730. Only support NOS 2.1 features. Only IP static routes and in-band management.
  • VDX 8770 and what does N+1 mean? Active passive.
    • 8770-8 is N+1 with loss of one SFM
      • So it can loose one SFM and it still has a redundant SFM? Aye, this can have up to 6 SFM.
    • 8770-4 is not N+1 if one SFM is lost
      • This can have 3 SFM
  • NOS 3 requires cold reboot of standby MM during failover & firmware upgrades. Does NOS 4 do too?
  • What is an unsigned integer? – Hop Count Field in the trill frame.
    • It cannot be negative.
  • VCS features:
    • VCS Edge Port config + LACP: With Brocade type are there more models than a CNA, VDX or Brocade 8000?
    • With NOS v2.0.0a max 8 ECMP paths per switch. Different with NOS 4?
  • From show vcs detail (shows switches in the fabric):
    • What is the Internal IP used for? Unclear, the pattern is: 127.1.0.RBRIDGE ID
    • What does the state “Testing” indicate? Unclear, perhaps when running “diag *” commands?
  • show fabric
    • “show fabric islports” is similar to switchshow shows islports only, how to see device ports
      • show interface switchport # shows all ports in L2 mode (VLAN1)
    • “show fabric all” shows a short list of switches in fabric, similar to fabricshow
  • What is  “Static MAC Pre-Provisioning on vLAG” ? (p55)
  • The fibre length of a link should have deskew value of 7 microseconds. Is this configurable?
    • Looks like it’s not. It’s not in the NOS 411 cmd reference guide anyway.
  • FCOE
    • FCF = FCoE Forwarder. A switch that does both Ethernet and FC
    • ENode = FCoE Node
    • FSB =  FIP Snooping Bridge (Can I get a Yay for nested acronyms?) A FCoE Switch that needs to be connected to an FCF (p67)
    • FCoE Profiles = (p84)
  • priority-table command is just messed up. What do the numbers mean? (p66)
    • It’s a mapping of Priority Groups to Classes of Services.
  • Are Virtual Fabrics on FCoE supported these days?
    • No. FCoE needs to be on VLANs with ID < 4096.
    • Btw, Virtual Fabrics is also a feature on Ethernet. Not only FC. Used when one needs overlapping VLAN IDs – multitenancy.
  • Is the max amount of RBridges in a fabric still 24? (p77)
    • Max 24 in Logical Chassis with VDX 6710-6730. Max 32 for 6740 and 8770.
    • It is the recommended amount. Theoretical max in NOS4 is 239. One below 1111000.
  • Is there a pattern to the MAC addresses of the Switches/RBridges/FD/XD?
  • What is a VMWare Port Group?
  • In RBAC what does it mean that one can access a command but not execute it? (p86)
    • It means one can view the settings, like a ‘show command’ works but not ‘command’ to set the setting.
    • Btw: admin/user accounts are locked, only pw can be changed
  • What are these FRUs: cid-card, compact-flash, mm, SFM? (p89)
    • MM – Management Module
    • SFM – Switch Fabric Modules
    • Compact-Flash – Supposedly where the firmware/configs are stored.
    • CID-Card – Chassis ID – each card has two EEPROM – one critical and a non-critical. The non-critical can be fixed with a “CID Recovery Tool”
  • oscmd – more details about this, how to run a command? (p96)
    • oscmd arp -a
    • oscmd scp localfile remote.server:

The below I’ll bring up in a later post:

VDX Troubleshooting Course

VDX Troubleshooting Course

BCEFP practice questions / answers

http://community.brocade.com/t5/Certification/BCEFP-2013-Exam-150-180-Practice-Questions/ta-p/4099

 

Other

Intro to VCS Fabric Technology: http://www.brocade.com/downloads/documents/white_papers/intro-vcs-fabric-technology-wp.pdf
CFP- MSA CFP2 Hardweare Specs: About the 40/100Gbps CFP2 SFP. MSA – multi-source agreement.
Code names of switches? Find the NOS firmware and look in the file “platform_names”. Quite a few bird names (nighthawk, dragon, superhawk, tomahawk ;), kestrel, falcon, blackbird).

Brocade Certified Ethernet Fabric Professional 2015 Beta Exam

Intro

http://community.brocade.com/t5/Certification/BCEFP-2015-Beta-Exam-Information-and-Study-Material/ta-p/58276

The course materials, including references to various resources such as the NOS Admin guide are available on the page above.

The Advanced Ethernet Fabric Troubleshooting (VDX-TS 300-WBT) has the pdf’s on the link above, but it’s also currently free on brocade’s saba education page.

 

Objectives for 2013 exam

Objectives for the exam (2013 version, so might be different for 2015) are:

Theory and Concepts

  • Describe the VCS implementations of TRILL
  • Describe the rate-limiting features in a VCS fabric
  • Identify basic routing concepts and how they interact with an Ethernet fabric
  • Identify VDX hardware components support.

Design

  • Describe the benefits of using TRILL
  • Describe QoS in a VCS fabric
  • Demonstrate knowledge of various types of link aggregation in a VCS fabric
  • Describe VDX hardware used in the design of a VCS fabric
  • Describe AMPP concepts

Implementation and Configuration

  • Demonstrate knowledge of sharing native FC storage with FCoE devices in a VCS fabric
  • Describe the implementation of lossless Ethernet for FCoE and iSCSI traffic
  • Describe how to integrate AMPP into a vCenter environment
  • Demonstrate knowledge how to implement Layer2/Layer3 ACLs in a VCS fabric
  • Demonstrate knowledge how to configure VRRP/VRRP-E on a VDX
  • Demonstrate knowledge how to configure a VCS fabric to connect to traditional Layer 2/Layer 3 switches
  • Demonstrate knowledge how to implement vLAGs

Management

  • Demonstrate knowledge of VDX management features

Troubleshooting

  • Demonstrate advanced troubleshooting knowledge
  • Demonstrate knowledge how to troubleshoot native FCoE and VCS to FC SAN bridging
  • Demonstrate knowledge how to troubleshoot VCS to an IP network

 

 

Page numbers for 2015 beta exam below:

Network OS Administrator’s Guide v4.1.1 53-1003225-01

Pages 11-20,26-31,54-56,75-77,94,115,119,135-144,149,150,191,201-203,210,243-247,253,261,269,311-314,321,

322,338-345,361-385,400,403,406,425-433,437,465,483,495,504,506,517-521,541,559,563,565,583,593,594,597,

603-609,661-663,668,676,682,686,714,715

 

Network OS Command Reference v4.1.1 53-1003226-01

Pages 299, 1258-1260,1266,1297,1317,1318

 

Network OS v4.1.1 Brocade VDX Release Notes

Pages 4,10,28,50

 

Network OS Software Licensing Guide v4.1 53-1003164-01

Pages 11-13

 

VDX 6740 Hardware Reference Manual 53-1002829-02

Page 1
VDX 8770-4 Hardware Reference Manual 53-1002563-03

Chapter 1, Page 1; Chapter 3, Page 32

 

VDX 8770-8 Hardware Reference Manual 53-1002564-03

Chapter 1, Page 1
VDX 6730 Hardware Reference Manual 53-1002389-06

Pages 1,2,15

 

Brocade VDX 8770 Switch Data Sheet GA-DS-1701-04

 

CFP2 Hardware Specification Draft Revision 0.3

Page 46