Skip to Content.

rare-dev - Re: [rare-dev] issues with tofino2

Subject: Rare project developers

List archive


Re: [rare-dev] issues with tofino2


Chronological Thread 
  • From: mc36 <>
  • To: Frédéric LOUI <>
  • Cc: "" <>
  • Subject: Re: [rare-dev] issues with tofino2
  • Date: Wed, 2 Nov 2022 16:02:30 +0100

hi,
nope, i went the 3rd way, as it gets set by default in the current p4src...
br,
cs


On 11/2/22 16:00, Fr d ric LOUI wrote:
HI,

Thanks for this confirmation.
We reached the same observation with 9.7.2 and 9.10.0 (using NixPkgs binaries)
Now we are in a situation where INTEL asked us to provide traces in a form of
ptf test.

1- with bf_router.p4 compiled for "tna" and compiled for TOFINO1 (use of
--arch=tf1)
2- with bf_router.p4 compiled for "tna" and compiled for TOFINO2 (use of
--arch=tf2)
3- with bf_router.p4 compiled with "t2na.p4" TNA and compiled for TOFINO2
(use of --arch=tf2)

Did you try -2- ? According to Vladimir s first answer, tna.p4 is a
portable network architecture and should result in the same behaviour on
TOFINO 1 and TOFINO 2 ?

I tried myself -2- and the problem is consistent and persist.

Frederic

Le 2 nov. 2022 12:20, mc36 <> a crit :

hi,
on tofino2 with sde910 i was able to start the minimal bf_router and found
that
the constant table ig_ctl_pkt_pre_emit get compiled badly... first thing to
note
here is the functions all point to to_cpu and running the program through it
does
not hit anything...
br,
cs


:11-02 07:17:20.021628: :0x8:-:<0,0,->:------------ Stage 3 ------------
:11-02 07:17:20.022014: :0x8:-:<0,0,3>:Ingress : Table
ig_ctl.ig_ctl_pkt_pre_emit.tbl_pkt_pre_emit is miss
:11-02 07:17:20.022048: :0x8:-:<0,0,3>:Key:
:11-02 07:17:20.022100: :0x8:-:<0,0,3>: ig_md.mpls0_remove[0:0] = 0x0
:11-02 07:17:20.022123: :0x8:-:<0,0,3>: ig_md.mpls1_remove[0:0] = 0x0
:11-02 07:17:20.022146: :0x8:-:<0,0,3>:
ig_md.mpls_encap_decap_sap_type[2:0] = 0x4
:11-02 07:17:20.022160: :0x8:-:<0,0,3>:
ig_md.mpls_encap_l2vpn_valid[0:0] = 0x0
:11-02 07:17:20.022174: :0x8:-:<0,0,3>:
ig_md.mpls_encap_l3vpn_valid[0:0] = 0x0
:11-02 07:17:20.022193: :0x8:-:<0,0,3>:
ig_md.mpls_encap_rawip_valid[0:0] = 0x0
:11-02 07:17:20.022208: :0x8:-:<0,0,3>: ig_md.nexthop_id[15:0] = 0xB4A6
:11-02 07:17:20.022226: :0x8:-:<0,0,3>:
ig_md.srv_encap_l3vpn_valid[0:0] = 0x0
:11-02 07:17:20.022240: :0x8:-:<0,0,3>: ig_md.srv_remove[0:0] = 0x0
:11-02 07:17:20.022257: :0x8:-:<0,0,3>:Execute Default Action: NoAction
:11-02 07:17:20.022281: :0x8:-:<0,0,3>:Action Results:
:11-02 07:17:20.022298: :0x8:-:<0,0,3>:Next Table = --END_OF_PIPELINE--


bfrt.bf_router.pipe.ig_ctl.ig_ctl_pkt_pre_emit> dump
----------------------------------------------> dump()
----- tbl_pkt_pre_emit Dump Start -----
Default Entry:
Entry data (action : NoAction):

Entry 0:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x0
ig_md.mpls1_remove : 0x0
ig_md.mpls_encap_decap_sap_type : 0x0
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 0
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 1:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x0
ig_md.mpls1_remove : 0x1
ig_md.mpls_encap_decap_sap_type : 0x0
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 1
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 2:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x1
ig_md.mpls1_remove : 0x0
ig_md.mpls_encap_decap_sap_type : 0x0
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 2
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 3:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x1
ig_md.mpls1_remove : 0x1
ig_md.mpls_encap_decap_sap_type : 0x0
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 3
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 4:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x0
ig_md.mpls1_remove : 0x0
ig_md.mpls_encap_decap_sap_type : 0x4
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 4
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 5:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x0
ig_md.mpls1_remove : 0x1
ig_md.mpls_encap_decap_sap_type : 0x4
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 5
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 6:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x1
ig_md.mpls1_remove : 0x0
ig_md.mpls_encap_decap_sap_type : 0x4
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 6
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 7:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x1
ig_md.mpls1_remove : 0x1
ig_md.mpls_encap_decap_sap_type : 0x4
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 7
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 8:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x0
ig_md.mpls1_remove : 0x0
ig_md.mpls_encap_decap_sap_type : 0x6
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 8
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 9:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x0
ig_md.mpls1_remove : 0x1
ig_md.mpls_encap_decap_sap_type : 0x6
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 9
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 10:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x1
ig_md.mpls1_remove : 0x0
ig_md.mpls_encap_decap_sap_type : 0x6
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 10
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

Entry 11:
Entry key:
ig_md.srv_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_rawip_valid : 0x0
ig_md.mpls_encap_l3vpn_valid : 0x0
ig_md.mpls_encap_l2vpn_valid : 0x0
ig_md.srv_remove : 0x0
ig_md.mpls0_remove : 0x1
ig_md.mpls1_remove : 0x1
ig_md.mpls_encap_decap_sap_type : 0x6
ig_md.nexthop_id : ('0x0002', '0xFFFF')
$MATCH_PRIORITY : 11
Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):

----- tbl_pkt_pre_emit Dump End -----


bfrt.bf_router.pipe.ig_ctl.ig_ctl_pkt_pre_emit>


On 11/2/22 11:33, mc36 wrote:
hi,
i tried to reproduce the tofino2 issue with the latest sde911 but i get the
below error...
the forwarder errors out pointing to the sde itself... it works if i start
for tofino1...
any idea on how to proceed?
thanks,
cs
bf_forwarder.py running on: ACCTON_WEDGE100BF_32X
Connected to control plane 10.10.10.227:9080
GRPC_ADDRESS: 127.0.0.1:50052
P4_NAME: bf_router
CLIENT_ID: 0
Subscribe attempt #1
Subscribe response received 0
Connected to grcp server
Traceback (most recent call last):
File
"/home/mc36/bf-sde-9.11.0/install/lib/python3.9/site-packages/tofino/bfrt_grpc/client.py",
line 494, in bfrt_info_get
msg = self.stub.GetForwardingPipelineConfig(req)
File "/usr/lib/python3/dist-packages/grpc/_channel.py", line 826, in
__call__
return _end_unary_response_blocking(state, call, False, None)
File "/usr/lib/python3/dist-packages/grpc/_channel.py", line 729, in
_end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated
with:
status = StatusCode.UNKNOWN
details = "Unexpected error in RPC handling"
debug_error_string = "{"created","description":"Error received from peer
ipv4:127.0.0.1:50052","file":"src/core/lib/surface/call.cc","file_line":1055,"grpc_message":"Unexpected error in RPC
handling","grpc_status":2}"

During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/mc36/rare/bfrt_python/bf_forwarder.py", line 100, in <module>
bf_client, bf_client_id = newClient(bind = True)
File "/home/mc36/rare/bfrt_python/bf_forwarder.py", line 85, in newClient
client = BfRuntimeGrpcClient(
File "/home/mc36/rare/bfrt_python/rare/bf_grpc_client/__init__.py", line
40, in __init__
self.bfrt_info = self.interface.bfrt_info_get()
File
"/home/mc36/bf-sde-9.11.0/install/lib/python3.9/site-packages/tofino/bfrt_grpc/client.py",
line 496, in bfrt_info_get
raise BfruntimeForwardingRpcException(e)
File
"/home/mc36/bf-sde-9.11.0/install/lib/python3.9/site-packages/tofino/bfrt_grpc/client.py",
line 266, in __init__
assert(grpc_error.code() != grpc.StatusCode.UNKNOWN)
AssertionError




Archive powered by MHonArc 2.6.19.

Top of Page