Rare project developers

[Frédéric LOUI <>]

HI,

Thanks for this confirmation. 
We reached the same observation with 9.7.2 and 9.10.0 (using NixPkgs 
binaries) 
Now we are in a situation where INTEL asked us to provide traces in a form of 
ptf test.

1- with bf_router.p4 compiled for "tna" and compiled for TOFINO1 (use of 
--arch=tf1)
2- with bf_router.p4 compiled for "tna" and compiled for TOFINO2 (use of 
--arch=tf2)
3- with bf_router.p4 compiled with "t2na.p4" TNA and compiled for TOFINO2 
(use of --arch=tf2)

Did you try -2- ? According to Vladimir’s first answer, tna.p4 is a portable 
network architecture and should result in the same behaviour on TOFINO 1 and 
TOFINO 2 ?

I tried myself -2- and the problem is consistent and persist.

Frederic

> Le 2 nov. 2022 à 12:20, mc36 <> a écrit :
> 
> hi,
> on tofino2 with sde910 i was able to start the minimal bf_router and found 
> that
> the constant table ig_ctl_pkt_pre_emit get compiled badly... first thing to 
> note
> here is the functions all point to to_cpu and running the program through 
> it does
> not hit anything...
> br,
> cs
> 
> 
> :11-02 07:17:20.021628:    :0x8:-:<0,0,->:------------ Stage 3 ------------
> :11-02 07:17:20.022014:    :0x8:-:<0,0,3>:Ingress : Table 
> ig_ctl.ig_ctl_pkt_pre_emit.tbl_pkt_pre_emit is miss
> :11-02 07:17:20.022048:        :0x8:-:<0,0,3>:Key:
> :11-02 07:17:20.022100:        :0x8:-:<0,0,3>: ig_md.mpls0_remove[0:0] = 0x0
> :11-02 07:17:20.022123:        :0x8:-:<0,0,3>: ig_md.mpls1_remove[0:0] = 0x0
> :11-02 07:17:20.022146:        :0x8:-:<0,0,3>: 
> ig_md.mpls_encap_decap_sap_type[2:0] = 0x4
> :11-02 07:17:20.022160:        :0x8:-:<0,0,3>: 
> ig_md.mpls_encap_l2vpn_valid[0:0] = 0x0
> :11-02 07:17:20.022174:        :0x8:-:<0,0,3>: 
> ig_md.mpls_encap_l3vpn_valid[0:0] = 0x0
> :11-02 07:17:20.022193:        :0x8:-:<0,0,3>: 
> ig_md.mpls_encap_rawip_valid[0:0] = 0x0
> :11-02 07:17:20.022208:        :0x8:-:<0,0,3>: ig_md.nexthop_id[15:0] = 
> 0xB4A6
> :11-02 07:17:20.022226:        :0x8:-:<0,0,3>: 
> ig_md.srv_encap_l3vpn_valid[0:0] = 0x0
> :11-02 07:17:20.022240:        :0x8:-:<0,0,3>: ig_md.srv_remove[0:0] = 0x0
> :11-02 07:17:20.022257:        :0x8:-:<0,0,3>:Execute Default Action: 
> NoAction
> :11-02 07:17:20.022281:        :0x8:-:<0,0,3>:Action Results:
> :11-02 07:17:20.022298:        :0x8:-:<0,0,3>:Next Table = 
> --END_OF_PIPELINE--
> 
> 
> bfrt.bf_router.pipe.ig_ctl.ig_ctl_pkt_pre_emit> dump
> ----------------------------------------------> dump()
> ----- tbl_pkt_pre_emit Dump Start -----
> Default Entry:
> Entry data (action : NoAction):
> 
> Entry 0:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x0
>    ig_md.mpls1_remove             : 0x0
>    ig_md.mpls_encap_decap_sap_type : 0x0
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 0
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 1:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x0
>    ig_md.mpls1_remove             : 0x1
>    ig_md.mpls_encap_decap_sap_type : 0x0
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 1
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 2:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x1
>    ig_md.mpls1_remove             : 0x0
>    ig_md.mpls_encap_decap_sap_type : 0x0
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 2
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 3:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x1
>    ig_md.mpls1_remove             : 0x1
>    ig_md.mpls_encap_decap_sap_type : 0x0
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 3
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 4:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x0
>    ig_md.mpls1_remove             : 0x0
>    ig_md.mpls_encap_decap_sap_type : 0x4
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 4
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 5:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x0
>    ig_md.mpls1_remove             : 0x1
>    ig_md.mpls_encap_decap_sap_type : 0x4
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 5
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 6:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x1
>    ig_md.mpls1_remove             : 0x0
>    ig_md.mpls_encap_decap_sap_type : 0x4
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 6
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 7:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x1
>    ig_md.mpls1_remove             : 0x1
>    ig_md.mpls_encap_decap_sap_type : 0x4
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 7
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 8:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x0
>    ig_md.mpls1_remove             : 0x0
>    ig_md.mpls_encap_decap_sap_type : 0x6
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 8
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 9:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x0
>    ig_md.mpls1_remove             : 0x1
>    ig_md.mpls_encap_decap_sap_type : 0x6
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 9
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 10:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x1
>    ig_md.mpls1_remove             : 0x0
>    ig_md.mpls_encap_decap_sap_type : 0x6
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 10
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> Entry 11:
> Entry key:
>    ig_md.srv_encap_l3vpn_valid    : 0x0
>    ig_md.mpls_encap_rawip_valid   : 0x0
>    ig_md.mpls_encap_l3vpn_valid   : 0x0
>    ig_md.mpls_encap_l2vpn_valid   : 0x0
>    ig_md.srv_remove               : 0x0
>    ig_md.mpls0_remove             : 0x1
>    ig_md.mpls1_remove             : 0x1
>    ig_md.mpls_encap_decap_sap_type : 0x6
>    ig_md.nexthop_id               : ('0x0002', '0xFFFF')
>    $MATCH_PRIORITY                : 11
> Entry data (action : ig_ctl.ig_ctl_pkt_pre_emit.act_pkt_send_to_cpu):
> 
> ----- tbl_pkt_pre_emit Dump End -----
> 
> 
> bfrt.bf_router.pipe.ig_ctl.ig_ctl_pkt_pre_emit>
> 
> 
> On 11/2/22 11:33, mc36 wrote:
>> hi,
>> i tried to reproduce the tofino2 issue with the latest sde911 but i get 
>> the below error...
>> the forwarder errors out pointing to the sde itself... it works if i start 
>> for tofino1...
>> any idea on how to proceed?
>> thanks,
>> cs
>> bf_forwarder.py running on: ACCTON_WEDGE100BF_32X
>> Connected to control plane 10.10.10.227:9080
>> GRPC_ADDRESS: 127.0.0.1:50052
>> P4_NAME: bf_router
>> CLIENT_ID: 0
>> Subscribe attempt #1
>> Subscribe response received 0
>> Connected to grcp server
>> Traceback (most recent call last):
>>    File 
>> "/home/mc36/bf-sde-9.11.0/install/lib/python3.9/site-packages/tofino/bfrt_grpc/client.py",
>>  line 494, in bfrt_info_get
>>        msg = self.stub.GetForwardingPipelineConfig(req)
>>    File "/usr/lib/python3/dist-packages/grpc/_channel.py", line 826, in 
>> __call__
>>        return _end_unary_response_blocking(state, call, False, None)
>>    File "/usr/lib/python3/dist-packages/grpc/_channel.py", line 729, in 
>> _end_unary_response_blocking
>>        raise _InactiveRpcError(state)
>> grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated 
>> with:
>>         status = StatusCode.UNKNOWN
>>         details = "Unexpected error in RPC handling"
>>         debug_error_string = 
>> "{"created","description":"Error received from 
>> peer 
>> ipv4:127.0.0.1:50052","file":"src/core/lib/surface/call.cc","file_line":1055,"grpc_message":"Unexpected
>>  error in RPC handling","grpc_status":2}"
>> >
>> During handling of the above exception, another exception occurred:
>> Traceback (most recent call last):
>>    File "/home/mc36/rare/bfrt_python/bf_forwarder.py", line 100, in 
>> <module>
>>        bf_client, bf_client_id = newClient(bind = True)
>>    File "/home/mc36/rare/bfrt_python/bf_forwarder.py", line 85, in 
>> newClient
>>        client = BfRuntimeGrpcClient(
>>    File "/home/mc36/rare/bfrt_python/rare/bf_grpc_client/__init__.py", 
>> line 40, in __init__
>>        self.bfrt_info = self.interface.bfrt_info_get()
>>    File 
>> "/home/mc36/bf-sde-9.11.0/install/lib/python3.9/site-packages/tofino/bfrt_grpc/client.py",
>>  line 496, in bfrt_info_get
>>        raise BfruntimeForwardingRpcException(e)
>>    File 
>> "/home/mc36/bf-sde-9.11.0/install/lib/python3.9/site-packages/tofino/bfrt_grpc/client.py",
>>  line 266, in __init__
>>        assert(grpc_error.code() != grpc.StatusCode.UNKNOWN)
>> AssertionError