理解 tc qdisc 和 iperf

Mat*_*dez 15 tc

我正在尝试使用 限制带宽tc并使用iperf. 我是这样开始的:

# iperf -c 192.168.2.1
------------------------------------------------------------
Client connecting to 192.168.2.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.2.7 port 35213 connected with 192.168.2.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec   830 MBytes   696 Mbits/sec
Run Code Online (Sandbox Code Playgroud)

两个实例通过以太网直接相连。

然后我设置了htb qdisc一个默认类以将带宽限制为 1mbit/sec:

# tc qdisc add dev bond0 root handle 1: htb default 12
# tc class add dev bond0 parent 1: classid 1:12 htb rate 1mbit
Run Code Online (Sandbox Code Playgroud)

但我没有得到我的期望:

# iperf -c 192.168.2.1
------------------------------------------------------------
Client connecting to 192.168.2.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.2.7 port 35217 connected with 192.168.2.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-12.8 sec   768 KBytes   491 Kbits/sec
Run Code Online (Sandbox Code Playgroud)

如果我将速率加倍,则测量的带宽不会改变。我错过了什么?为什么测量的带宽与rate参数中的 1mbit 不对应?我需要设置哪些参数才能将带宽限制为精确的给定速率?

但是,该man页面说这tbf应该是qdisc此任务的首选:

令牌桶过滤器适用于将流量减慢到精确配置的速率。可以很好地扩展到大带宽。

tbf需要参数rate,burst和 ( limit| latency)。所以我在不了解burst和(limit| latency)如何影响可用带宽的情况下尝试了以下操作:

# tc qdisc add dev bond0 root tbf rate 1mbit limit 10k burst 10k
Run Code Online (Sandbox Code Playgroud)

这为我提供了 113 Kbits/sec 的测量带宽。使用这些参数并没有太大变化,直到我注意到添加一个值会mtu发生巨大的变化:

# tc qdisc add dev bond0 root tbf rate 1mbit limit 10k burst 10k mtu 5000
Run Code Online (Sandbox Code Playgroud)

导致测量带宽为 1.00 Mbits/sec。

我需要设置哪些参数才能将带宽限制为确切的给定速率?

我应该为此使用htbtbf排队规则吗?

编辑

基于这些资源,我做了一些测试:

我尝试了以下设置。

在物理机上

/etc/network/interfaces

auto lo
iface lo inet loopback

auto br0
iface br0 inet dhcp
bridge_ports eth0
Run Code Online (Sandbox Code Playgroud)

测量iperf

# tc qdisc add dev eth0 root handle 1: htb default 12
# tc class add dev eth0 parent 1: classid 1:12 htb rate 1mbit
# iperf -c 192.168.2.1
------------------------------------------------------------
Client connecting to 192.168.2.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.2.4 port 51804 connected with 192.168.2.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-11.9 sec  1.62 MBytes  1.14 Mbits/sec
Run Code Online (Sandbox Code Playgroud)

iperf服务器计算了不同的带宽:

[  4] local 192.168.2.1 port 5001 connected with 192.168.2.4 port 51804
[  4]  0.0-13.7 sec  1.62 MBytes   993 Kbits/sec
Run Code Online (Sandbox Code Playgroud)

在没有绑定的虚拟机上

/etc/network/interfaces

auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp
Run Code Online (Sandbox Code Playgroud)

测量iperf

# tc qdisc add dev eth0 root handle 1: htb default 12
# tc class add dev eth0 parent 1: classid 1:12 htb rate 1mbit
# iperf -c 192.168.2.1
------------------------------------------------------------
Client connecting to 192.168.2.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.2.7 port 34347 connected with 192.168.2.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-11.3 sec  1.62 MBytes  1.21 Mbits/sec
Run Code Online (Sandbox Code Playgroud)

iperf服务器计算了不同的带宽:

[  4] local 192.168.2.1 port 5001 connected with 192.168.2.7 port 34347
[  4]  0.0-14.0 sec  1.62 MBytes   972 Kbits/sec
Run Code Online (Sandbox Code Playgroud)

在具有绑定的虚拟机上(在 eth0 上配置 tc)

/etc/network/interfaces

auto lo
iface lo inet loopback

auto eth0
allow-bond0 eth0
iface eth0 inet manual
    bond-master bond0
    bond-primary eth0 eth1

auto eth1
allow-bond0 eth1
iface eth1 inet manual
    bond-master bond0
    bond-primary eth0 eth1

auto bond0
iface bond0 inet dhcp
    bond-slaves none
    bond-mode 1
#    bond-arp-interval 250
#    bond-arp-ip-target 192.168.2.1
#    bond-arp-validate 3
Run Code Online (Sandbox Code Playgroud)

测量iperf

# tc qdisc add dev eth0 root handle 1: htb default 12
# tc class add dev eth0 parent 1: classid 1:12 htb rate 1mbit
# iperf -c 192.168.2.1
------------------------------------------------------------
Client connecting to 192.168.2.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.2.9 port 49054 connected with 192.168.2.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-11.9 sec  1.62 MBytes  1.14 Mbits/sec
Run Code Online (Sandbox Code Playgroud)

iperf服务器计算了不同的带宽:

[  4] local 192.168.2.1 port 5001 connected with 192.168.2.9 port 49054
[  4]  0.0-14.0 sec  1.62 MBytes   972 Kbits/sec
Run Code Online (Sandbox Code Playgroud)

在具有绑定的虚拟机上(在 bond0 上配置 tc)

/etc/network/interfaces

auto lo
iface lo inet loopback

auto eth0
allow-bond0 eth0
iface eth0 inet manual
    bond-master bond0
    bond-primary eth0 eth1

auto eth1
allow-bond0 eth1
iface eth1 inet manual
    bond-master bond0
    bond-primary eth0 eth1

auto bond0
iface bond0 inet dhcp
    bond-slaves none
    bond-mode 1
#    bond-arp-interval 250
#    bond-arp-ip-target 192.168.2.1
#    bond-arp-validate 3
Run Code Online (Sandbox Code Playgroud)

测量iperf

# tc qdisc add dev bond0 root handle 1: htb default 12
# tc class add dev bond0 parent 1: classid 1:12 htb rate 1mbit
# iperf -c 192.168.2.1
------------------------------------------------------------
Client connecting to 192.168.2.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.2.9 port 49055 connected with 192.168.2.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-13.3 sec   768 KBytes   475 Kbits/sec
Run Code Online (Sandbox Code Playgroud)

iperf服务器计算了不同的带宽:

[  4] local 192.168.2.1 port 5001 connected with 192.168.2.9 port 49055
[  4]  0.0-14.1 sec   768 KBytes   446 Kbits/sec
Run Code Online (Sandbox Code Playgroud)

如果我eth1从绑定中删除(被动接口),结果不会改变。

结论

绑定接口上的流量控制不起作用,或者至少不像预期的那样起作用。我将不得不进一步调查。

作为一种解决方法,可以将排队规则直接添加到属于绑定的接口中。

Mic*_*ega 2

当您不确定 tc 如何工作时,您仍然可以监视 tc 并查看数据包如何流动?您可以使用我的脚本来监视 tc,并且需要在具有提升权限的终端中运行它。您可以将 wlan0 更改为另一个接口,还需要 grep 和 awk:

      #!/bin/sh
      INTERVAL=15
      while sleep $INTERVAL
      do
             /usr/sbin/tc -s -d class show dev wlan0

             uptime
             more /proc/meminfo | grep MemFree | grep -v grep
             echo cache-name num-active-objs total-objs obj-size
             SKBUFF=`more /proc/slabinfo | grep skbuff | grep -v grep | awk 
             '{print $2} {print $3} {print $4}'`

             echo skbuff_head_cache: $SKBUFF
      done
Run Code Online (Sandbox Code Playgroud)