Rare project developers

[Alexander Gall <>]

Hi Eoin

On Tue, 12 Jul 2022 14:27:23 +0000, Eoin Kenny <> said:

> Hi Alex,
> I need some more help, if you don't mind. I am working from the docs here:
> http://docs.freertr.org/guides/installation/wedge100bf32/interface/

> Firstly, when I run bfshell 
> root@localhost:~# bfshell
> connect: Connection refused

That means that the bf_switchd process isn't running.

> root@localhost:~# 

> Also the "show p4land p4" now requires an additional parameter. The docs 
> must be showing a different version of code for this command.

Yes, csaba has made significant changes since release 1 and you're
running now very new freertr code. The "port-names" option must have
been added pretty recently as well, I've never seen it myself :)

It seems that version release-1-61-g2a33342 is bad :( The bf_switchd
process (or rather the APS 2556-sepcific "SAL") is failing with

/nix/store/jqm46f8ccl4dcdq6cwm4lwrg5mmshlyn-aps-sal-refapp-9.7.2/bin/salRefApp:
 symbol lookup error: 
/nix/store/fbwz8nc3nqvl2d6h7031ky9bkqgjds4s-bf-sde-aps_bf2556-runtime-9.7.2-bf_router-artifacts/lib/libdriver.so:
 undefined symbol: rl_instream

That's also why bfshell doesn't work.  I'll look into it and get back
to you.

-- 
Alex

> rare#show p4lang p4 port-names                                              
>    
> num  name

> rare#                                                                       
>    

> I assume I should be seeing my P4 ports. Attached is a copy of my 
> rtr-hw.txt file from /etc/feertr. Any suggestions?

> Thanks for your help.
> Regards
> Eoin

> rare#show p4lang p4 status                                                  
>    
> category       value
> peer           ::
> closed         3
> reconn         0
> since          1970-01-01 00:59:59
> for            never
> capability     null
> platform       null
> cpuport        0
> dynamicid      65536 131072
> messages sent  0
> messages got   0
> rounds done    0
> last done      1970-01-01 00:59:59 (never ago)
> time took      0
> rounds skip    0
> last skip      1970-01-01 00:59:59 (never ago)

> rare#             






> ________________________________________
> From: Alexander Gall <>
> Sent: Monday 11 July 2022 09:59
> To: Eoin Kenny
> Cc: ; ; 
> Subject: RE: [rare-dev] [RARE-users] RARE/freeRtr first release for [Wedge 
> 100BF-32X, Wedge 100BF-32QS, Wedge 100BF-64X and APS6064X]

> CAUTION[External]: This email originated from outside of the organisation. 
> Do not click on links or open the attachments unless you recognise the 
> sender and know the content is safe.


> Hi Eoin

> On Mon, 11 Jul 2022 08:23:44 +0000, Eoin Kenny <> said:

>> I suspect, I should have used DHCP rather than statically configuring the 
>> IP address/default route when doing the installation from ONIE. Anyway, I 
>> added a public IP/Default gateway to the Debian Host, installed git and 
>> then the tna-? Commands worked fine.

> Ok, happy to hear that :)

>> One thing that was missing was adding the oath to release-manger for the 
>> root user. I had to add the path 
>> /nix/var/nix/profiles/RARE/bin/release-manager and then I was able to run 
>> the command  "release-manager --switch-to-generation 2" as the root user.

> Yes, PATH is set via /etc/profile.d/RARE.sh, which is only read for
> login shells, i.e. not if you use sudo. I should probably make this
> work for non-login root shells as well.

>> rare#tna-list-installed
>> Generation Current Release Git Tag                    KernelID       
>> Kernel Release            Platform                   Install date
>> -----------------------------------------------------------------------------------------------------------------------------------------------------------
>> 1         1       release-1                  Debian11_0     5.10.0-8-amd64 
>>            stordis_bf2556x_1t         2022-07-08 01:00:18.258226175 +0200
>> 2 *       2       release-1-61-g2a33342-free Debian11_0     5.10.0-8-amd64 
>>            stordis_bf2556x_1t         2022-07-11 10:04:07.215572514 +0200


>> rare#exit

>> Here is the log of what I did, in case  you want to have a look.
>> https://github.com/sonicepk/BF2556X-1T-ONIE-freeRouter/blob/main/tna-install

> Good, that looks as expected. Please don't hesitate to ask if anything
> is unlcear, confusing or broken :) And, yes, we're working on
> documentation...

> --
> Alex

>> Thanks for your help, so far.

>> Regards
>> Eoin



>> -----Original Message-----
>> From: Alexander Gall <>
>> Sent: Monday 11 July 2022 07:56
>> To: Eoin Kenny <>
>> Cc: ; ; 
>> Subject: Re: [rare-dev] [RARE-users] RARE/freeRtr first release for [Wedge 
>> 100BF-32X, Wedge 100BF-32QS, Wedge 100BF-64X and APS6064X]

>> CAUTION[External]: This email originated from outside of the organisation. 
>> Do not click on links or open the attachments unless you recognise the 
>> sender and know the content is safe.


>> Hi Eoin

>> Sorry, I had already left for the weekend.

>> On Fri, 8 Jul 2022 15:07:56 +0000, Eoin Kenny <> said:

>>> Hi Alex,
>>> Sorry for the delay.
>>> I have rare-nix now on the box.

>>> How do I use install this TNA version from freeRouter cli?

>> Let me explain a bit about how this works. First of all, the 
>> "tna-install-*" commands in the freerouter CLI actually just execute 
>> variants of the "release-manager" command, which should be in your PATH.  
>> Some variants have to be run as root, so you either have to use the full 
>> path /nix/var/nix/profiles/RARE/bin/release-manager, start a root login 
>> shell (e.g. with "sudo su -") or source /etc/profile.d/RARE.sh when you 
>> try to run them from Linux.

>> To install the latest development version, use "tna-install-latest" or 
>> "release-manager --install-git origin/master". Alternatively, you can 
>> clone the rare-nix repo and execute "make install". All three will have 
>> the same result. However, the version of freerouter that will be installed 
>> will be the one that has been committed to the rare-nix
>> repo:
>> https://bitbucket.software.geant.org/projects/RARE/repos/rare-nix/browse/overlay/freerouter/repo.nix

>> In general, this will not be the newest version from 
>> https://github.com/rare-freertr/freeRtr. To install the latest commit of 
>> that repo, you have to use "tna-install-experimental" or "release-manager 
>> --install-experimental".  There currently is no simple equivalent with a 
>> Makefile target to achieve the same.  When you do this, you have to be 
>> aware that it can result in a build failure or a non-working system.

>> Having said that, we still need to understand why some of these commands 
>> are not working on your system. It appears that you can clone the rare-nix 
>> repository but access to the Bitbucket API fails.

>> The trace of the command you sent shows that curl terminates with status 
>> code 6:

>>>> + '[' 6 -gt 0 -a 6 -ne 255 ']'
>>>> + echo 'Unexpected error, aborting'

>> According to the curl man page, this means:

>> 6      Couldn't resolve host. The given remote host was not resolved.

>> This doesn't really make sense since at least git was able to resolve 
>> bitbucket.software.geant.org when you cloned the repo, but that's where I 
>> would start the investigation.

>> --
>> Alex

>>> Thanks & regards
>>> Eoin


>>> rare@localhost:~/rare-nix$ ls
>>> default.nix  rare             scripts                update-dataplane.sh
>>> Makefile     release-manager  services               update-freerouter.sh
>>> onie         release.nix      spec.json              update-freerouter.txt
>>> overlay      release-notes    spec-ONIE-SWITCH.json
>>> rare@localhost:~/rare-nix$
>>> ________________________________________
>>> From: Alexander Gall <>
>>> Sent: Friday 8 July 2022 15:00
>>> To: Eoin Kenny
>>> Cc: ; ; 
>>> Subject: Re: [rare-dev] [RARE-users] RARE/freeRtr first release for
>>> [Wedge 100BF-32X, Wedge 100BF-32QS, Wedge 100BF-64X and APS6064X]

>>> CAUTION[External]: This email originated from outside of the 
>>> organisation. Do not click on links or open the attachments unless you 
>>> recognise the sender and know the content is safe.


>>> On Fri, 8 Jul 2022 13:22:12 +0000, Eoin Kenny <> said:

>>>> Interesting, git is not found.

>>> Yes, that's why I said you might have to install it first :) The
>>> update mechanism doesn't use the Debian packages, in case you're
>>> wondering.

>>> The debugging doesn't show a clear error, except that the curl command
>>> doesn't get what it expects. Can you execute this please:

>>> curl 
>>> 'https://bitbucket.software.geant.org/rest/api/1.0/projects/RARE/repos/RARE-NIX/tags?limit=1000'

>>> --
>>> Alex

>>>> root@localhost:/home/rare# git clone
>>>> https://bitbucket.software.geant.org/scm/rare/rare-nix.git
>>>> bash: git: command not found
>>>> root@localhost:/home/rare# cd /
>>>> root@localhost:/# ls
>>>> bin   home            lib32       media  __platforms  sbin  usr
>>>> boot  initrd.img      lib64       mnt    proc         srv   var
>>>> dev   initrd.img.old  libx32      nix    root         sys   vmlinuz
>>>> etc   lib             lost+found  opt    run          tmp   vmlinuz.old
>>>> root@localhost:/#



>>>> Also output below from

>>>> $ bash -x /nix/var/nix/profiles/RARE/bin/release-manager
>>>> --list-available

>>>> Regards
>>>> Eoin
>>>> rare@localhost:~$ bash -x
>>>> /nix/var/nix/profiles/RARE/bin/release-manager --list-available
>>>> + set -e
>>>> + set -o pipefail
>>>> + shopt -s extglob
>>>> + shopt -s inherit_errexit
>>>> + PROFILE=/nix/var/nix/profiles/RARE
>>>> + LIB=/nix/store/50wh9p15nlqbg3mc7snfhnmzhmi12lw6-release-manager-1/l
>>>> + ib
>>>> + REPO_URL=https://bitbucket.software.geant.org/scm/rare/rare-nix.git
>>>> + API_URL=https://bitbucket.software.geant.org/rest/api/1.0/projects/
>>>> + RARE/repos/RARE-NIX
>>>> + FREERTR_API_URL=https://api.github.com/repos/rare-freertr/freeRtr
>>>> + FREERTR_REPO_URL=https://github.com/rare-freertr/freeRtr
>>>> + PATH=/nix/var/nix/profiles/default/bin:/nix/store/z1qvlavy35wanw5k5
>>>> + 4fvvfffws5bvigj-coreutils-8.31/bin:/nix/store/3zbrk6iinij83qn4x139x
>>>> + 4b8vr1b94ax-util-linux-2.36-binn
>>>> + NIX_PATH=
>>>> ++ basename /nix/var/nix/profiles/RARE/bin/release-manager
>>>> + self=release-manager
>>>> ++ getopt -l list-installed:: -l list-available -l
>>>> ++ switch-to-generation: -l install-release: -l install-git: -l
>>>> ++ install-local: -l install-experimental -l update-release
>>>> + opts=' --list-available --'
>>>> + '[' 0 -eq 0 ']'
>>>> + '[' 1 -eq 0 ']'
>>>> + eval set -- --list-available --
>>>> ++ set -- --list-available --
>>>> + '[' 2 -gt 0 ']'
>>>> + case "$1" in
>>>> + list_available=1
>>>> + shift
>>>> + '[' 1 -gt 0 ']'
>>>> + case "$1" in
>>>> + break
>>>> + '[' 1 -gt 1 ']'
>>>> + paths_to_rm=()
>>>> + trap _cleanup EXIT TERM INT
>>>> ++ tput colors
>>>> + '[' -t 0 -a -1 -gt 1 ']'
>>>> + declare -A gens gens_by_id gens_by_gitTag install_dates
>>>> + installed_releases available_releases for path in $PROFILE-*-link
>>>> + '[' -h /nix/var/nix/profiles/RARE-1-link ']'
>>>> + add_path /nix/var/nix/profiles/RARE-1-link local path slice id gen
>>>> + version gitTag rest path=/nix/var/nix/profiles/RARE-1-link
>>>> ++ cat /nix/var/nix/profiles/RARE-1-link/slice
>>>> + slice=Debian11_0:5.10.0-8-amd64:stordis_bf2556x_1t
>>>> ++ cat /nix/var/nix/profiles/RARE-1-link/version
>>>> + id=1:release-1:Debian11_0:5.10.0-8-amd64:stordis_bf2556x_1t
>>>> ++ gen_from_path /nix/var/nix/profiles/RARE-1-link echo
>>>> ++ /nix/var/nix/profiles/RARE-1-link sed -e
>>>> ++ 's/.*-\([0-9]*\)-link$/\1/'
>>>> + gen=1
>>>> + '[' -n '' ']'
>>>> + gens[$gen]=1:release-1:Debian11_0:5.10.0-8-amd64:stordis_bf2556x_1t
>>>> + gens_by_id[$id]=1
>>>> ++ stat -c %z /nix/var/nix/profiles/RARE-1-link
>>>> + install_dates[$gen]='2022-07-08 01:00:18.258226175 +0200'
>>>> + read version gitTag rest
>>>> ++ echo 1:release-1:Debian11_0:5.10.0-8-amd64:stordis_bf2556x_1t
>>>> ++ tr : ' '
>>>> + installed_releases[$version]=' release-1'
>>>> + gens_by_gitTag[$gitTag]=1
>>>> +++ readlink /nix/var/nix/profiles/RARE
>>>> ++ gen_from_path RARE-1-link
>>>> ++ echo RARE-1-link
>>>> ++ sed -e 's/.*-\([0-9]*\)-link$/\1/'
>>>> + current_gen=1
>>>> ++ uname -r
>>>> + kernel_release=5.10.0-8-amd64
>>>> + . /etc/machine.conf
>>>> ++ onie_version=master-201912041918stordis_bf2556x_1t_v1.20-dirty
>>>> ++ onie_vendor_id=70567
>>>> ++ onie_build_machine=stordis_bf2556x_1t
>>>> ++ onie_machine_rev=0
>>>> ++ onie_arch=x86_64
>>>> ++ onie_build_platform=x86_64-stordis_bf2556x_1t-r0
>>>> ++ onie_config_version=1
>>>> ++ onie_build_date=2019-12-04T19:18-05:00
>>>> ++ onie_partition_type=gpt
>>>> ++ onie_kernel_version=4.9.95
>>>> ++ onie_firmware=auto
>>>> ++ onie_switch_asic=bft
>>>> ++ onie_skip_ethmgmt_macs=no
>>>> ++ onie_grub_image_name=grubx64.efi
>>>> ++ onie_uefi_boot_loader=grubx64.efi
>>>> ++ onie_uefi_arch=x64
>>>> ++ onie_machine=stordis_bf2556x_1t
>>>> ++ onie_platform=x86_64-stordis_bf2556x_1t-r0
>>>> + platform=stordis_bf2556x_1t
>>>> + '[' -z stordis_bf2556x_1t ']'
>>>> + .
>>>> + /nix/store/50wh9p15nlqbg3mc7snfhnmzhmi12lw6-release-manager-1/lib/a
>>>> + ctivation.sh
>>>> ++ SYSTEMD_DIR=/etc/systemd/system
>>>> ++ CONFIG_DIR=/etc/freertr
>>>> ++ CONFIG_SW=/etc/freertr/rtr-sw.txt
>>>> ++ CONFIG_HW=/etc/freertr/rtr-hw.txt
>>>> ++ SNMP_CONFIG_DIR=/etc/snmp
>>>> ++ SNMPD_CONFIG=/etc/snmp/snmpd.conf
>>>> ++ IFINDEX=/etc/snmp/ifindex.init
>>>> ++ SNMP_STATE_DIR=/var/lib/snmp
>>>> ++ INTERFACE_CONFIG=/var/lib/snmp/interface.conf
>>>> ++ SHELL_PROFILE=/etc/profile.d/RARE.sh
>>>> + .
>>>> + /nix/store/50wh9p15nlqbg3mc7snfhnmzhmi12lw6-release-manager-1/lib/a
>>>> + pi.sh
>>>> + '[' -n '' ']'
>>>> + '[' -n 1 ']'
>>>> + list_available
>>>> + local version up_to_date tag branch_commits commit commit_head
>>>> + commit_tag get_available_releases local tags tag version INFO
>>>> + 'Checking for release tags of 
>>>> https://bitbucket.software.geant.org/scm/rare/rare-nix.git'
>>>> + echo 'INFO: Checking for release tags of 
>>>> https://bitbucket.software.geant.org/scm/rare/rare-nix.git'
>>>> INFO: Checking for release tags of
>>>> https://bitbucket.software.geant.org/scm/rare/rare-nix.git
>>>> ++ get_tags
>>>> ++ local result
>>>> +++ api_call '/tags?limit=1000'
>>>> +++ local url api_url out http_code result api_url=
>>>> +++ 
>>>> url='https://bitbucket.software.geant.org/rest/api/1.0/projects/RARE/repos/RARE-NIX/tags?limit=1000'
>>>> ++++ curl -s --write-out '\n%{http_code}\n' 
>>>> 'https://bitbucket.software.geant.org/rest/api/1.0/projects/RARE/repos/RARE-NIX/tags?limit=1000'
>>>> +++ out='
>>>> 000'
>>>> ++ result=
>>>> + tags=
>>>> + _cleanup
>>>> + '[' 6 -gt 0 -a 6 -ne 255 ']'
>>>> + echo 'Unexpected error, aborting'
>>>> Unexpected error, aborting
>>>> rare@localhost:~$


>>>> ________________________________________
>>>> From: Alexander Gall <>
>>>> Sent: Friday 8 July 2022 12:36
>>>> To: Eoin Kenny
>>>> Cc: ; ; 
>>>> Subject: Re: [rare-dev] [RARE-users] RARE/freeRtr first release for
>>>> [Wedge 100BF-32X, Wedge 100BF-32QS, Wedge 100BF-64X and APS6064X]

>>>> CAUTION[External]: This email originated from outside of the 
>>>> organisation. Do not click on links or open the attachments unless you 
>>>> recognise the sender and know the content is safe.


>>>> On Fri, 8 Jul 2022 12:28:32 +0200, Alexander Gall <> said:

>>>>> On Fri, 8 Jul 2022 09:55:03 +0000, Eoin Kenny <> 
>>>>> said:
>>>>>> Hi all,
>>>>>> Thank you for your help and patience. Happy to help with the docs if I 
>>>>>> can.

>>>>>> I have Internet access from the box but tna-list-available and 
>>>>>> tna-install-experimental both fail. See below, any suggestions?

>>>>> It seems like you can't reach bitbucket.software.geant.org. Can you
>>>>> try (you might have to install git first)

>>>>> git clone https://bitbucket.software.geant.org/scm/rare/rare-nix.git

>>>> Or, maybe better, you can send me the output of

>>>> $ bash -x /nix/var/nix/profiles/RARE/bin/release-manager
>>>> --list-available

>>>> --
>>>> Alex

>>>>> --
>>>>> Alex

>>>>>> DNS is working. I also cannot find bf_shell.

>>>>>> Thanks
>>>>>> Eoin

>>>>>> rare#ping www.freertr.org vrf oob
>>>>>> resolving www.freertr.org for ipv4 ok!
>>>>>> pinging 81.2.241.46, src=null, vrf=oob, cnt=5, len=64, tim=1000,
>>>>>> gap=0, ttl=255, tos=0, sgt=0, flow=0, fill=0, sweep=false, multi=false 
>>>>>> !!!!!
>>>>>> result=100%, recv/sent/lost/err=5/5/0/0, rtt
>>>>>> min/avg/max/sum=36/36/37/183, ttl min/avg/max=235/235/235, tos 
>>>>>> min/avg/max=164/164/164 rare#tna-list-installed
>>>>>> Generation Current Release Git Tag                    KernelID       
>>>>>> Kernel Release            Platform                   Install date
>>>>>> -----------------------------------------------------------------------------------------------------------------------------------------------------------
>>>>>> 1 *       1       release-1                  Debian11_0     
>>>>>> 5.10.0-8-amd64            stordis_bf2556x_1t         2022-07-08 
>>>>>> 01:00:18.258226175 +0200


>>>>>> rare#tna-list-available
>>>>>> INFO: Checking for release tags of
>>>>>> https://bitbucket.software.geant.org/scm/rare/rare-nix.git
>>>>>> Unexpected error, aborting


>>>>>> rare#tna-install-experimental
>>>>>> child 14518 created on 3
>>>>>> child started
>>>>>> Unexpected error, aborting

>>>>>> process exited with 1536 code
>>>>>> % returned 6
>>>>>> rare#


>>>>>> ________________________________________
>>>>>> From: 
>>>>>> <> on behalf of mc36 <>
>>>>>> Sent: Friday 8 July 2022 09:35
>>>>>> To: ; Alexander Gall;
>>>>>> 
>>>>>> Subject: Re: [RARE-users] [rare-dev] RARE/freeRtr first release for
>>>>>> [Wedge 100BF-32X, Wedge 100BF-32QS, Wedge 100BF-64X and APS6064X]

>>>>>> CAUTION[External]: This email originated from outside of the 
>>>>>> organisation. Do not click on links or open the attachments unless you 
>>>>>> recognise the sender and know the content is safe.


>>>>>> hi,

>>>>>> On 7/8/22 10:08, Alexander Gall wrote:
>>>>>>> On Fri, 8 Jul 2022 09:31:47 +0200, Fr  d  ric LOUI 
>>>>>>> <> said:
>>>>>>> 
>>>>>>>> Hi Eoin,
>>>>>>>> http://docs.freertr.org/guides/installation/wedge100bf32/onie-nos
>>>>>>>> -install/
>>>>>>> 
>>>>>>> I think the question was where the login credentials are
>>>>>>> documented. I can't find it myself on http://docs.freertr.org/ :(
>>>>>>> 

>>>>>> what if frederic adds you to the https://github.com/rare-freertr
>>>>>> org, then you can easily add/edit info there as it's a github pages?

>>>>>> thanks,
>>>>>> cs
>>> --
>>> Alexander Gall, Network

>>> SWITCH
>>> Werdstrasse 2, P.O. Box, 8021 Zurich, Switzerland phone +41 44 268 15
>>> 15, direct +41 44 268 15 22 https://switch.ch https://swit.ch/linkedin
>>> https://swit.ch/twitter