Rare project developers

[Marcos Felipe Schwarz <>]

Hi Alex,

Thanks for the feedback.
I asked the local team and they'll interconnect ports 4 and 6. I'll let you 
know as soon as it's done.

Regards,

Marcos Schwarz

-----Mensagem original-----
De: Alexander Gall <> 
Enviada em: quarta-feira, 12 de abril de 2023 05:46
Para: Marcos Felipe Schwarz <>
Cc: Frédéric LOUI <>; Maria Del Carmen Misa Moreira 
<>; ; Ricardo Tombi 
<>
Assunto: Testing the APS 9.11 BSP on RIO0021

[ Changed the subject to reflect the actual topic ]

Hi Marco

Sorry to bother you again. I would appreciate if I could do some more tests 
with port #2 to make sure our implementation works correctly. To do that I 
would need to be able to change the configuration of eno2, i.e. use 
/sbin/ethtool, /sbin/ip and /usr/sbin/tcpdump as root.

What irritates me a bit is that eno2 transitioned to up right after
192.168.110.12 was booted

alex@dtn02:~$ grep eno2 /var/log/dmesg
[    5.952495] kernel: igb 0000:18:00.1 eno2: renamed from eth3
[   13.459954] kernel: 8021q: adding VLAN 0 to HW filter on device eno2
[   16.444503] kernel: igb 0000:18:00.1 eno2: igb: eno2 NIC Link is Up 1000 
Mbps Full Duplex, Flow Control: RX/TX
[   16.445031] kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eno2: link becomes ready

That was before I started my tests and I would expect that the port on the 
Tofino goes down when bf_switchd and the gearbox daemon are restarted. Also, 
AN is enabled

alex@dtn02:~$ ethtool eno2 | grep Auto
        Auto-negotiation: on

However, according to APS, the gearbox ports currently have AN disabled (and 
there is no support to enable it). That would mean the port shouldn't come up 
at all.

An alternative would be to connect two ports on the Tofino back-to-back if 
that's possible.

Regards,
Alex

On Thu, 6 Apr 2023 17:34:41 +0200, Alexander Gall <> said:

> On Thu, 6 Apr 2023 14:25:23 +0000, Marcos Felipe Schwarz 
> <> said:
>> eno2 should be connected to port2

> The I guess something is not working properly. I can see packet 
> counters increasing on the gearbox port but nothing is counted on eno2 
> and vice versa.  I'd have to be root to check with tcpdump if anything 
> arrives on eno2 (also to configure the interface for more testing).

> I'm leaving now for Easter holidays :)

> Regards,
> Alex

>> -----Mensagem original-----
>> De: Alexander Gall <>
>> Enviada em: quinta-feira, 6 de abril de 2023 11:21
>> Para: Marcos Felipe Schwarz <>
>> Cc: Frédéric LOUI <>; Maria Del Carmen Misa 
>> Moreira <>; ; 
>> Ricardo Tombi <>
>> Assunto: Re: RES: RES: RES: RES: RES: RES: RES: [rare-dev] rare on 
>> tofinio2

>> Hi Marcos

>> I have finished my work. AFAICT eno2 on 192.168.110.12 is not connected to 
>> any of the gearbox ports right now (also, since I'm not root there I 
>> couldn't do a lot of testing in any case).  I think there are two SFP 
>> plugins in Ports 1 and 2 and both of them come up when configured from 
>> freertr (port 1 is also part of the current config as sdn1), but I don't 
>> know what they are connected to.

>> I'd be happy to do more testing when the ports are in a known state where 
>> I have access to the other end.

>> I have restored the state of the machine to what it was before my 
>> work, hopefully I didn't break anything this time :) Here is the 
>> current state of the ports

>> RIO0021#sh int desc                                                        
>>                                                                            
>>                                                                           
>> interface      state  description
>> template1      admin  core links
>> loopback0      up     RIO0021@lo0
>> loopback20965  up
>> ethernet0      up     CPU_PORT _NEVER_EVER_ CONFIGURE IT
>> ethernet1      up     out of band management port
>> ethernet2      up     linux tuntap management interface
>> sdn1           up
>> sdn1.1500      up
>> sdn49          down
>> sdn49.1500     down
>> sdn50          up     DTN2
>> sdn50.10       up
>> sdn50.100      up
>> sdn50.20       up
>> sdn50.200      up
>> sdn51          down
>> sdn53          up     Cassini2
>> sdn53.300      up
>> sdn55          up
>> sdn55.458      up      ->  
>> [RNP-SP-RJ-45875193]
>> sdn55.459      up      ->  [RNP-ES-RJ]
>> sdn56          up     Cassini1
>> tunnel123      up     WG-NMAAS

>> Regards,
>> Alex

>> On Wed, 5 Apr 2023 18:52:59 +0000, Marcos Felipe Schwarz 
>> <> said:

>>> We are using the switch for tests on a internal project. But I reserved 
>>> the equipment for you this Thursday and Friday (06-07/04) from 00:00 to 
>>> 12:00 BRT (05:00 to 17:00 GMT+2).
>>> I'm asking the local team to connect a port between 1-16 to port eno2 
>>> from the server that you access for the USB-console connection 
>>> (192.168.110.12).

>>> Regards,

>>> Marcos Schwarz

>>> -----Mensagem original-----
>>> De: Alexander Gall <>
>>> Enviada em: terça-feira, 4 de abril de 2023 05:24
>>> Para: Marcos Felipe Schwarz <>
>>> Cc: Frédéric LOUI <>; Maria Del Carmen Misa 
>>> Moreira <>; 
>>> Assunto: Re: RES: RES: RES: RES: RES: RES: [rare-dev] rare on 
>>> tofinio2

>>> Hi Marcos

>>> I'd like to finish the work on the BSP for 9.11. If you can spare 
>>> your box one more time for a day, I hope to be able to finish it 
>>> this time
>>> :) If you can connect some of the gearbox ports (i.e. ports 1-16) I could 
>>> test our code more thoroughly (port status, counters etc.).

>>> Regards,
>>> Alex

>>> On Tue, 14 Mar 2023 08:18:06 +0100, Alexander Gall <> said:

>>>> Hi Marcos
>>>> On Mon, 13 Mar 2023 17:22:33 +0000, Marcos Felipe Schwarz 
>>>> <> said:

>>>>> I talked to you too soon,
>>>>> Got them up, after some reconfiguration.

>>>> Sorry about that. I did check that the ports were up after I was 
>>>> done :/ Did I change the configuration by accident? The system 
>>>> should have been in the exact same state as before.

>>>> --
>>>> Alex

>>>>> -----Mensagem original-----
>>>>> De: Alexander Gall <> Enviada em: sexta-feira, 10 de 
>>>>> março de 2023 13:16
>>>>> Para: Marcos Felipe Schwarz <>
>>>>> Cc: Frédéric LOUI <>; Maria Del Carmen 
>>>>> Misa Moreira <>; 
>>>>> 
>>>>> Assunto: Re: RES: RES: RES: RES: RES: [rare-dev] rare on tofinio2

>>>>> Hi Marcos

>>>>> On Thu, 9 Mar 2023 13:33:28 +0000, Marcos Felipe Schwarz 
>>>>> <> said:

>>>>>> Great, keep us updated.

>>>>> I was too optimistic, of course :( Adapting the control-plane to the 
>>>>> new interface of the gearbox chip is a lot more work than anticipated.

>>>>> I'll have to do some more planning before asking you for more time on 
>>>>> the device. It should now be in the same state it was before.

>>>>> Regards,
>>>>> Alex

>>>>>> Thanks

>>>>>> -----Mensagem original-----
>>>>>> De: Alexander Gall <> Enviada em: quinta-feira, 9 
>>>>>> de março de 2023 10:33
>>>>>> Para: Marcos Felipe Schwarz <>
>>>>>> Cc: Frédéric LOUI <>; Maria Del Carmen 
>>>>>> Misa Moreira <>; 
>>>>>> 
>>>>>> Assunto: Re: RES: RES: RES: RES: [rare-dev] rare on tofinio2

>>>>>> On Thu, 9 Mar 2023 13:27:15 +0000, Marcos Felipe Schwarz 
>>>>>> <> said:

>>>>>>> You can start as soon as you are available.

>>>>>> Ok. I'll start immediately and hopefully finish by tomorrow. I'll let 
>>>>>> you know.

>>>>>> Thanks,
>>>>>> Alex

>>>>>>> -----Mensagem original-----
>>>>>>> De: Alexander Gall <> Enviada em: quinta-feira, 9 
>>>>>>> de março de 2023 10:26
>>>>>>> Para: Marcos Felipe Schwarz <>
>>>>>>> Cc: Frédéric LOUI <>; Maria Del Carmen 
>>>>>>> Misa Moreira <>; 
>>>>>>> 
>>>>>>> Assunto: Re: RES: RES: RES: [rare-dev] rare on tofinio2

>>>>>>> Hi Marcos

>>>>>>> On Thu, 9 Mar 2023 13:20:54 +0000, Marcos Felipe Schwarz 
>>>>>>> <> said:

>>>>>>>> How long do you expect this process to take?
>>>>>>>> We'll need to use it for another project, but we can let it 
>>>>>>>> available for one day or two.

>>>>>>> I hope one day is enough. When would it suite you?

>>>>>>> --
>>>>>>> Alex

>>>>>>>> The console is available on the used place:
>>>>>>>> - Jump host:  -p 2200
>>>>>>>> - Server with USB console (/dev/ttyUSB0): 

>>>>>>>> Regards,

>>>>>>>> Marcos Schwarz

>>>>>>>> -----Mensagem original-----
>>>>>>>> De: Alexander Gall <> Enviada em: quinta-feira, 9 
>>>>>>>> de março de 2023 06:19
>>>>>>>> Para: Marcos Felipe Schwarz <>
>>>>>>>> Cc: Frédéric LOUI <>; Maria Del Carmen 
>>>>>>>> Misa Moreira <>; 
>>>>>>>> 
>>>>>>>> Assunto: Re: RES: RES: [rare-dev] rare on tofinio2

>>>>>>>> Hi Marcos

>>>>>>>> I'm finally ready to start work on the 9.11.0 (APS still considers 
>>>>>>>> it as beta but I guess it's good to go for us). They made a major 
>>>>>>>> change regarding the gearbox so I'll have to do some coding to make 
>>>>>>>> it work with our control-plane.  Is it still ok for me to use the 
>>>>>>>> RIO APS2556X?

>>>>>>>> Regards,
>>>>>>>> Alex

>>>>>>>> On Tue, 31 Jan 2023 14:12:43 +0100, Alexander Gall <> 
>>>>>>>> said:

>>>>>>>>> On Tue, 31 Jan 2023 13:00:05 +0000, Marcos Felipe Schwarz 
>>>>>>>>> <> said:
>>>>>>>>>> It's ok for me, Carmen is using SAO0021, so RIO is available.

>>>>>>>>> Great. It will probably be a while before I have the time to 
>>>>>>>>> work on this. I'll let you know before I start.

>>>>>>>>> --
>>>>>>>>> Alex

>>>>>>>>>> -----Mensagem original-----
>>>>>>>>>> De: Frédéric LOUI <> Enviada em: 
>>>>>>>>>> terça-feira,
>>>>>>>>>> 31 de janeiro de 2023 09:23
>>>>>>>>>> Para: Marcos Felipe Schwarz <>
>>>>>>>>>> Cc: Maria Del Carmen Misa Moreira 
>>>>>>>>>> <>; Alexander Gall 
>>>>>>>>>> <>; 
>>>>>>>>>> Assunto: Re: RES: [rare-dev] rare on tofinio2

>>>>>>>>>> Alex is planning to bump RARE/freeRtr SDE for TOFINO [1|2] to 
>>>>>>>>>> SDE version 9.11.0 (newest LTS)

>>>>>>>>>> As RARE/freeRtr is trying to support hardware that our user base 
>>>>>>>>>> purchased, APS2556X-1T and APS6064X is on this support list.
>>>>>>>>>> APS released recently newest BSP support for SDE 9.11.0.
>>>>>>>>>> This allows us to bump to SDE 9.11.0.

>>>>>>>>>> In order to elaborate/test this release we would need RIO0021 
>>>>>>>>>> access (inbound + serial).

>>>>>>>>>> So the question is:
>>>>>>>>>> Is it OK for you ? :-)

>>>>>>>>>> If yes, can you please sync with Alex off-line ?
>>>>>>>>>> RIO0021 is not part of Carmen’s demo.

>>>>>>>>>> Thanks !
>>>>>>>>>> Frederic

>>>>>>>>>>> Le 31 janv. 2023 à 13:08, Marcos Felipe Schwarz 
>>>>>>>>>>> <> a écrit :
>>>>>>>>>>> 
>>>>>>>>>>> Sorry Frederic, I think I missed something...
>>>>>>>>>>> 
>>>>>>>>>>> What is the request? Either way, RIO0021 is avaiilable for use.
>>>>>>>>>>> 
>>>>>>>>>>> De: Maria Del Carmen Misa Moreira 
>>>>>>>>>>> <> Enviada em: terça-feira, 31 de 
>>>>>>>>>>> janeiro de 2023 08:58
>>>>>>>>>>> Para: ; Marcos Felipe Schwarz 
>>>>>>>>>>> <>; Alexander Gall <>
>>>>>>>>>>> Cc: 
>>>>>>>>>>> Assunto: Re: [rare-dev] rare on tofinio2
>>>>>>>>>>> 
>>>>>>>>>>> Hi,
>>>>>>>>>>> 
>>>>>>>>>>> I´m not using RIO node.
>>>>>>>>>>> 
>>>>>>>>>>> Cheers,
>>>>>>>>>>> Carmen Misa
>>>>>>>>>>> From: Frédéric LOUI <>
>>>>>>>>>>> Sent: 31 January 2023 11:46
>>>>>>>>>>> To: Marcos Schwarz <>; Maria Del Carmen 
>>>>>>>>>>> Misa Moreira <>; Alexander Gall 
>>>>>>>>>>> <>
>>>>>>>>>>> Cc:  <>
>>>>>>>>>>> Subject: Re: [rare-dev] rare on tofinio2
>>>>>>>>>>> 
>>>>>>>>>>> Hi
>>>>>>>>>>> 
>>>>>>>>>>> @Marcos,
>>>>>>>>>>> How does it sounds for you ? 
>>>>>>>>>>> 
>>>>>>>>>>> @Carmen,
>>>>>>>>>>> As you are currently using GP4L is it OK to use RIO0021 node
>>>>>>>>>>> 
>>>>>>>>>>> @Alex
>>>>>>>>>>> With a quick sync with Carmen I presume you can use RIO0021
>>>>>>>>>>> (APS2556X-1T)
>>>>>>>>>>> 
>>>>>>>>>>> For what is worth, RIO0021 is already accessible via SSH OOBM.
>>>>>>>>>>> 
>>>>>>>>>>> For serial access, I presume that you’d need Marcos/RNP 
>>>>>>>>>>> agreement
>>>>>>>>>>> 
>>>>>>>>>>> > Le 31 janv. 2023 à 11:30, Alexander Gall <> a 
>>>>>>>>>>> > écrit :
>>>>>>>>>>> > 
>>>>>>>>>>> > On Tue, 31 Jan 2023 10:53:04 +0100, mc36 <> said:
>>>>>>>>>>> > 
>>>>>>>>>>> >> stordis provided a bsp for sde9.11 on their support 
>>>>>>>>>>> >> forum, also mirrored on my nas under /inet/barefoot/ :)
>>>>>>>>>>> > 
>>>>>>>>>>> > Netberg also appears to support 9.11.0 by now. I will need 
>>>>>>>>>>> > to re-acquire access to the devices in Brazil (or wherever 
>>>>>>>>>>> > they are, I
>>>>>>>>>>> > forgot) to start testing. But probably no sooner than in 
>>>>>>>>>>> > two weeks or so.
>>>>>>>>>>> > 
>>>>>>>>>>> > --
>>>>>>>>>>> > Alex
>>>>>>>>>>> > 
>>>>>>>>>>> >> br,
>>>>>>>>>>> >> cs
>>>>>>>>>>> > 
>>>>>>>>>>> >> On 1/31/23 10:24, Alexander Gall wrote:
>>>>>>>>>>> >>> On Tue, 31 Jan 2023 10:13:56 +0100, Fr  d  ric LOUI 
>>>>>>>>>>> >>> <> said:
>>>>>>>>>>> >>> 
>>>>>>>>>>> >>>> SDE 9.12.0 is out and should include the TOFINO 2 fix !
>>>>>>>>>>> >>> 
>>>>>>>>>>> >>> And we're still stuck with 9.7 :( I'll have to check 
>>>>>>>>>>> >>> with Stordis and Netberg to see what the common most 
>>>>>>>>>>> >>> recent SDE version is. For Inventec we'll go with the 
>>>>>>>>>>> >>> BSP-less approach anyway. Once I find the time to work on 
>>>>>>>>>>> >>> this...
>>>>>>>>>>> >>> 
>>>>>>>>>>> >>> But at least 9.7 also works on the Tofino2 with the 
>>>>>>>>>>> >>> workaround that csaba has implemented.
>>>>>>>>>>> >>> 
>>>>>>>>>>>