Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[voq] Test plan and testcase updates for multiasic #3463

Merged
merged 2 commits into from Jul 8, 2021

Conversation

tcusto
Copy link
Contributor

@tcusto tcusto commented May 11, 2021

VoQ test cases updates for multiasic

Summary:
Updates VoQ test plan and test scripts for multiasic line cards.

Type of change

  • Bug fix
  • Testbed and Framework(new/improvement)
  • Test case(new/improvement)

Approach

What is the motivation for this PR?

To run the init, neighbor and IP forwarding tests on chassis with multiasic linecards.

How did you do it?

Scripts in tests/voq were enhanced to handle multiasic cards:

  • All test cases were changed so that ASICs with no neighbors or router interfaces will be skipped.
  • The HIDE_INTERNAL route map is let in place and tests in ipfwd script that are affected by it are removed.
  • CLI and database checks where enhanced to look in the correct namespace on multiasic cards.

Other enhancements:

  • Neighbor script cleanup was enhanced be more robust when restoring configuration.
  • PTF port selection was centralized and now uses minigraph.
  • TTL checks were made optional for running ipfwd script on VS testbed.
  • Test plan was updated with these changes.

How did you verify/test it?

Ran test suite on VoQ chassis.

Any platform specific information?

No

Supported testbed topology if it's a new test case?

T2

Documentation

@tcusto tcusto requested review from wangxin, yxieca and a team as code owners May 11, 2021 17:20
@yxieca yxieca requested a review from arlakshm May 16, 2021 04:38
@yxieca
Copy link
Collaborator

yxieca commented May 16, 2021

@arlakshm please review this test plan.

@anshuv-mfst
Copy link

@arlakshm - can you please review and approve at the earliest, thanks

1 similar comment
@anshuv-mfst
Copy link

@arlakshm - can you please review and approve at the earliest, thanks

Copy link
Contributor

@arlakshm arlakshm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

as comments

tests/voq/voq_helpers.py Outdated Show resolved Hide resolved
@@ -386,6 +387,9 @@ def check_ip_mtu(self):

masked_exp_pkt = Mask(exp_pkt)
masked_exp_pkt.set_do_not_care_scapy(scapy.Ether, "dst")
if self.ignore_ttl:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why we need to ignore_ttl in VoQ chassis ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This gets set when we are on VS and the behavior is different than with HW.

tests/voq/conftest.py Outdated Show resolved Hide resolved
tests/voq/test_voq_nbr.py Outdated Show resolved Hide resolved
tests/voq/test_voq_nbr.py Outdated Show resolved Hide resolved
tests/voq/test_voq_nbr.py Outdated Show resolved Hide resolved
tests/voq/test_voq_nbr.py Show resolved Hide resolved
tests/voq/test_voq_nbr.py Outdated Show resolved Hide resolved
tests/voq/test_voq_nbr.py Outdated Show resolved Hide resolved
@anshuv-mfst
Copy link

@tcusto - please address review comments asap, thanks

@arlakshm
Copy link
Contributor

arlakshm commented Jul 7, 2021

/Azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

Copy link
Contributor

@arlakshm arlakshm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@shubav
Copy link
Contributor

shubav commented Jul 7, 2021

@wangxin or @yxieca could you kindly merge this as soon as possible. There's a PR coming up for gen-mg support for multi-asic DUTs, following which we will send another PR with modifications for these voq tests based on the minigraph. Due to these dependencies, request you to kindly get this merged quickly, we're holding a lot of code we would like to upstream. Thanks.

@wangxin wangxin merged commit 10f0fc8 into sonic-net:master Jul 8, 2021
vmittal-msft pushed a commit to vmittal-msft/sonic-mgmt that referenced this pull request Sep 28, 2021
What is the motivation for this PR?
To run the init, neighbor and IP forwarding tests on chassis with multiasic linecards.

How did you do it?
Scripts in tests/voq were enhanced to handle multiasic cards:

All test cases were changed so that ASICs with no neighbors or router interfaces will be skipped.
The HIDE_INTERNAL route map is let in place and tests in ipfwd script that are affected by it are removed.
CLI and database checks where enhanced to look in the correct namespace on multiasic cards.
Other enhancements:

Neighbor script cleanup was enhanced be more robust when restoring configuration.
PTF port selection was centralized and now uses minigraph.
TTL checks were made optional for running ipfwd script on VS testbed.
Test plan was updated with these changes.

How did you verify/test it?
Ran test suite on VoQ chassis.

Co-authored-by: Tom Custodio <thomas.custodio@nokia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants