Hi,
I am Jianqing chen.In recently,I have implement mptcp experient and find a strange bug.I am not able to fix out,please help me.
The Bug phenomenon: the screen is black and no log. The keyboard and mouse have no reaction. The server is on hook state.After I reboot the server ,and look up the /var/log/message,there is no valid message .
Dec 19 19:46:00 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_close: Close of meta_sk with tok 0xa1eb92c4
Dec 19 19:46:00 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_sock_destruct destroying meta-sk
Dec 19 19:46:05 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_alloc_mpcb: created mpcb with token 0xa6d58b76
Dec 19 19:46:05 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_select_ack_sock pi 1 state 3 last_dseq 0
Dec 19 19:46:05 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_select_ack_sock pi 1 state 3 last_dseq 0
Dec 19 19:46:06 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_add_sock: token 0xa6d58b76 pi 2, src_addr:172.16.0.93:80 dst_addr:172.16.0.219:37469, cnt_subflows now 2
Dec 19 19:46:06 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_add_sock: token 0xa6d58b76 pi 3, src_addr:172.16.0.232:80 dst_addr:172.16.0.226:44161, cnt_subflows now 3
Dec 19 19:46:06 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_add_sock: token 0xa6d58b76 pi 4, src_addr:172.16.0.232:80 dst_addr:172.16.0.219:51016, cnt_subflows now 4
Dec 19 19:46:06 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_add_sock: token 0xa6d58b76 pi 5, src_addr:172.16.0.233:80 dst_addr:172.16.0.226:33406, cnt_subflows now 5
Dec 19 19:46:06 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_add_sock: token 0xa6d58b76 pi 6, src_addr:172.16.0.233:80 dst_addr:172.16.0.219:57595, cnt_subflows now 6
Dec 19 19:46:06 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_add_sock: token 0xa6d58b76 pi 7, src_addr:172.16.0.234:80 dst_addr:172.16.0.226:59579, cnt_subflows now 7
Dec 19 19:46:06 12007860 kernel: net/mptcp/mptcp_ctrl.c: mptcp_add_sock: token 0xa6d58b76 pi 8, src_addr:172.16.0.234:80 dst_addr:172.16.0.219:52350, cnt_subflows now 8
Dec 19 21:48:21 12007860 syslogd 1.4.1: restart.
Dec 19 21:48:21 12007860 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Dec 19 21:48:21 12007860 kernel: Linux version 3.11.3-002 ([email protected]) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-1) (GCC) ) #21 SMP Wed Dec 18 11:12:50 CST 2013
Dec 19 21:48:21 12007860 kernel: Command line: ro root=LABEL=/ crashkernel=128M@32M
Dec 19 21:48:21 12007860 kernel: e820: BIOS-provided physical RAM map:
I set up the environment in LAN and the client have the dual cards, server have the four cards.There is establlishing eight flow.It no behind NAT.
Apache is built on the server, and the client continuously to download the data from Apache.But the above phenomenon is appear in normal running a day.
The route table of server is
[root@12007860 crash]# ip route show
default via 172.16.0.254 dev eth0
169.254.0.0/16 dev eth3 scope link
172.16.0.0/24 dev eth0 proto kernel scope link src 172.16.0.93
172.16.0.0/24 dev eth1 proto kernel scope link src 172.16.0.232
172.16.0.0/24 dev eth2 proto kernel scope link src 172.16.0.233
172.16.0.0/24 dev eth3 proto kernel scope link src 172.16.0.234
[root@12007860 crash]# ifconfig
eth0 Link encap:Ethernet HWaddr BC:30:5B:F6:0A:A4
inet addr:172.16.0.93 Bcast:172.16.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:23605 errors:0 dropped:330 overruns:0 frame:0
TX packets:3275 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1845627 (1.7 MiB) TX bytes:343220 (335.1 KiB)
Memory:dcb00000-dcc00000
eth1 Link encap:Ethernet HWaddr BC:30:5B:F6:0A:A5
inet addr:172.16.0.232 Bcast:172.16.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1460 Metric:1
RX packets:19768 errors:0 dropped:324 overruns:0 frame:0
TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1529734 (1.4 MiB) TX bytes:84 (84.0 b)
Memory:dcc00000-dcd00000
eth2 Link encap:Ethernet HWaddr BC:30:5B:F6:0A:A6
inet addr:172.16.0.233 Bcast:172.16.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:19943 errors:0 dropped:327 overruns:0 frame:0
TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1542151 (1.4 MiB) TX bytes:84 (84.0 b)
Memory:dcd00000-dce00000
eth3 Link encap:Ethernet HWaddr BC:30:5B:F6:0A:A7
inet addr:172.16.0.234 Bcast:172.16.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:19908 errors:0 dropped:326 overruns:0 frame:0
TX packets:3 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1538760 (1.4 MiB) TX bytes:126 (126.0 b)
Memory:dce00000-dcf00000
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
[root@12007860 crash]# uname -a
Linux 12007860 3.11.3-002 #21 SMP Wed Dec 18 11:12:50 CST 2013 x86_64 x86_64 x86_64 GNU/Linux
[root@12007860 crash]# sysctl -p
net.ipv4.ip_forward = 0
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.default.accept_source_route = 0
kernel.sysrq = 0
kernel.core_uses_pid = 0
net.ipv4.tcp_syncookies = 1
kernel.msgmnb = 65536
kernel.msgmax = 65536
kernel.shmmax = 68719476736
kernel.shmall = 4294967296
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_max_tw_buckets = 4000
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.ip_local_port_range = 10000 61000
net.mptcp.mptcp_enabled = 1
net.mptcp.mptcp_checksum = 0
net.mptcp.mptcp_path_manager = fullmesh
net.mptcp.mptcp_debug = 1
the route table of the client is
[root@localhost ~]# ip route show
default via 172.16.0.254 dev eth0
169.254.0.0/16 dev eth1 scope link
172.16.0.0/24 dev eth0 proto kernel scope link src 172.16.0.226
172.16.0.0/24 dev eth1 proto kernel scope link src 172.16.0.219
[root@localhost ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 78:2B:CB:04:79:D2
inet addr:172.16.0.226 Bcast:172.16.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:4737499049 errors:51 dropped:83200 overruns:0 frame:51
TX packets:1066331153 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:7112109118772 (6.4 TiB) TX bytes:72871035067 (67.8 GiB)
eth1 Link encap:Ethernet HWaddr 78:2B:CB:04:79:D3
inet addr:172.16.0.219 Bcast:172.16.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:4104173 errors:0 dropped:83227 overruns:0 frame:0
TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:591296406 (563.9 MiB) TX bytes:128 (128.0 b)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:4474 errors:0 dropped:0 overruns:0 frame:0
TX packets:4474 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:443414 (433.0 KiB) TX bytes:443414 (433.0 KiB)
[root@localhost ~]# uname -a
Linux localhost.localdomain 3.11.3-001 #17 SMP Fri Nov 29 17:13:42 CST 2013 x86_64 x86_64 x86_64 GNU/Linux
net.mptcp.mptcp_enabled = 1
net.mptcp.mptcp_checksum = 0
net.mptcp.mptcp_path_manager = fullmesh
net.mptcp.mptcp_debug = 1
The version of multipath is v0.88.There is no useful information, I installed hung_task and start kdump on the server, but it does not have any panic information, just a black screen, keyboard and mouse have no reaction. The I had to manually restart.
Please help to find the problem, and then to guide me.Thanks!
Best Regards