Subject: RARE user and assistance email list
List archive
- From: "mc36" <>
- To: ,
- Subject: Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK
- Date: Thu, 5 Jan 2023 02:48:54 +0100
- List-id: <freertr.groups.io>
- Mailing-list: list ; contact
one more hint, the veth0[ab] needs some tuning...
here is the black magic generated by the external forwardization process on
my side:
ip link add veth0a type veth peer name veth0
ip link set veth0 name veth0b
ip link set veth0a up multicast on promisc on mtu 8192
ethtool -K veth0a rx off
ethtool -K veth0a tx off
ethtool -K veth0a sg off
ethtool -K veth0a tso off
ethtool -K veth0a ufo off
ethtool -K veth0a gso off
ethtool -K veth0a gro off
ethtool -K veth0a lro off
ethtool -K veth0a rxvlan off
ethtool -K veth0a txvlan off
ethtool -K veth0a ntuple off
ethtool -K veth0a rxhash off
ethtool --set-eee veth0a eee off
ip link set veth0b up multicast on promisc on mtu 8192
ethtool -K veth0b rx off
ethtool -K veth0b tx off
ethtool -K veth0b sg off
ethtool -K veth0b tso off
ethtool -K veth0b ufo off
ethtool -K veth0b gso off
ethtool -K veth0b gro off
ethtool -K veth0b lro off
ethtool -K veth0b rxvlan off
ethtool -K veth0b txvlan off
ethtool -K veth0b ntuple off
ethtool -K veth0b rxhash off
ethtool --set-eee veth0b eee off
On 1/5/23 02:36, mc36 wrote:
hi,
imho you're on your way at least your configs look good except that
you have 2 physical interfaces binded to vfio so i bet you the p4dpdk
uses the cpuport index 2 (the 3rd interface) so please do the following in
-hw..txt instead:
proc p4emu /bin/p4dpdk.bin --vdev=net_af_packet1,iface=veth0b -- 127.0.0.1
9080 2
note the final 2... also you can split the load between the cores but let the
fine tuning after your first packets...
assuming nothing more logs on freerouter imho the dataplane is connected...
sho p4 p4 stat
sho p4 p4 port-na
if not, then "reload process p4emu stop" followed by "sudo /bin/p4dpdk.bin
--vdev=net_af_packet1,iface=veth0b -- 127.0.0.1 9080 2"
br,
cs
On 1/5/23 01:17, Christopher Adigun wrote:
Still not working, dpdk interface is still down.
One error (/etc/freerouter/errors.log) I noticed:
java.net.BindException: Permission denied (Bind failed) at java.net.PlainSocketImpl.socketBind:PlainSocketImpl.java:-2/java.net.AbstractPlainSocketImpl.bind:AbstractPlainSocketImpl.java:452/java.net.ServerSocket.bind:ServerSocket.java:395/java.net.ServerSocket.bind:ServerSocket.java:349/prtLocTcp.<init>:prtLocTc
p.java:60/prtLocTcp.startServer:prtLocTcp.java:78/cfgInit.executeHWcommands:cfgInit.java:433/cfgInit.doInit:cfgInit.java:959/cfgInit.doMain:cfgInit.java:1208/router.main:router.java:24/
java.net.BindException: Permission denied (Bind failed) at java.net.PlainSocketImpl.socketBind:PlainSocketImpl.java:-2/java.net.AbstractPlainSocketImpl.bind:AbstractPlainSocketImpl.java:452/java.net.ServerSocket.bind:ServerSocket.java:395/java.net.ServerSocket.bind:ServerSocket.java:349/prtLocTcp.<init>:prtLocTc
p.java:60/prtLocTcp.startServer:prtLocTcp.java:78/cfgInit.executeHWcommands:cfgInit.java:433/cfgInit.doInit:cfgInit.java:959/cfgInit.doMain:cfgInit.java:1208/router.main:router.java:24/
I think this had to do with the line /tcp2vrf 23 host 23/.
So I changed it to /tcp2vrf 2324 host 23/. and the error stopped
I want to start with basic step of just one DPDK interface (0000:00:06.0), is
the hw-config below ok:
hwid emu
tcp2vrf 2324 host 23
line tty1 127.0.0.1 20022 127.0.0.1 20021
tcp2vrf 2323 p4 23 127.0.0.1
tcp2vrf 9080 p4 9080 127.0.0.1
proc p4emu /bin/p4dpdk.bin --vdev=net_af_packet1,iface=veth0b -- 127.0.0.1
9080 1
int eth0 eth - 127.0.0.1 19999 127.0.0.1 19998
proc cpuport /bin/pcapInt.bin veth0a 19998 127.0.0.1 19999 127.0.0.1
[root@ip-172-31-38-199 freerouter]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group
default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group
default qlen 1000
link/ether 0a:4e:d7:7c:a3:c9 brd ff:ff:ff:ff:ff:ff
inet 172.31.38.199/20 brd 172.31.47.255 scope global dynamic eth0
valid_lft 2275sec preferred_lft 2275sec
5: veth0b@veth0a: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
state UP group default qlen 1000
link/ether b2:b5:b9:ca:9f:cd brd ff:ff:ff:ff:ff:ff
6: veth0a@veth0b: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
state UP group default qlen 1000
link/ether 0a:bd:95:93:53:77 brd ff:ff:ff:ff:ff:ff
/[ec2-user@ip-172-31-38-199 ~]$ dpdk-devbind.py -s/
Network devices using DPDK-compatible driver
============================================
0000:00:06.0 'Elastic Network Adapter (ENA) ec20' drv=vfio-pci unused=ena
0000:00:07.0 'Elastic Network Adapter (ENA) ec20' drv=vfio-pci unused=ena
Network devices using kernel driver
===================================
0000:00:05.0 'Elastic Network Adapter (ENA) ec20' if=eth0 drv=ena
unused=vfio-pci *Active*/
/
If freerouter is not able to use/detect dpdk interface, does it log the error
somewhere?
-=-=-=-=-=-=-=-=-=-=-=-
Groups.io Links: You receive all messages sent to this group.
View/Reply Online (#916): https://groups.io/g/freertr/message/916
Mute This Topic: https://groups.io/mt/96011193/6413194
Group Owner:
Unsubscribe: https://groups.io/g/freertr/unsub []
-=-=-=-=-=-=-=-=-=-=-=-
- [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/04/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/04/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/05/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/05/2023
- Message not available
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/05/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/05/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/05/2023
- Message not available
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/05/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/05/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/05/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/06/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/06/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/06/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/06/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/06/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/04/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/04/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, Christopher Adigun, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/02/2023
- Re: [RARE-users] [freertr] Freertr Install On AWS and DPDK, mc36, 01/02/2023
Archive powered by MHonArc 2.6.19.