Ticket ID: SIXXS #5213190 Ticket Status: Resolved PoP: usbos01 - OCCAID Inc. (Boston, Massachusetts)
route down for tunnel T43029?
Shadow Hawkins on Sunday, 17 July 2011 19:18:10
I'm not receiving any traffic on my heartbeat tunnel, T43029. This problem started Friday. Connectivity did exist for a couple of hours last night but is now lost again. There were no configuration changes since the last reboot of my gateway (glup.org) or any software restarts that could have caused it. IPv6 pings from elsewhere get a destination unreachable, suggesting the route is down, though the tunnel appears to be up. Using hping in traceroute mode with proto 41 packets suggests that outbound packets from the gateway to usbos01 are reaching their destination.
My gateway is running OpenBSD 4.3 and AICCU 2007.01.15-console-openbsd, installed from the OpenBSD 4.3 release package. IPv4 connectivity is from a cable modem with a static address, provided by RCN here in Boston.
"aiccu autotest" fails tests 6-8 (ping remote tunnel endpoint, IPv6 traceroutes). A local tcpdump shows proto-41 packets being sent by my gateway but none received from usbos01.
ipv4 traceroute:
traceroute to 216.93.250.26 (216.93.250.26), 64 hops max, 40 byte packets
1 * * *
2 vl200.aggr1.sbo.ma.rcn.net (209.6.160.100) 12.945 ms 10.70 ms 11.909 ms
3 tge2-1.core4.sbo.ma.rcn.net (207.172.15.156) 8.870 ms 23.456 ms 10.907 ms
4 vl135.core1.nyw.ny.rcn.net (207.172.19.221) 17.880 ms 23.470 ms 18.932 ms
5 port-chan1.border1.nyw.ny.rcn.net (207.172.15.76) 19.863 ms 16.475 ms 15.919 ms
6 ny-iix.above.net (198.32.160.22) 15.871 ms 16.989 ms 15.928 ms
7 xe-1-1-0.cr1.lga5.us.above.net (64.125.26.161) 17.907 ms 37.524 ms 18.917 ms
8 xe-1-1-0.mpr3.bos2.us.above.net (64.125.25.41) 23.383 ms 24.3 ms 23.414 ms
9 xe-0-0-0.mpr4.bos2.us.above.net (64.125.25.62) 21.389 ms 21.1 ms 21.428 ms
10 abovenet.ge2-1.ibr01.bos1.twdx.net (64.124.198.45) 18.374 ms 27.571 ms 16.922 ms
11 OCCAID-230.dcr03.bos1.twdx.net (216.93.255.6) 29.894 ms 17.472 ms 15.424 ms
12 usbos01.sixxs.net (216.93.250.26) 17.866 ms 15.983 ms 15.901 ms
hping proto 41 traces:
cgull@glup:/home/cgull 1 $ sudo hping -0 -t 1 -H 41 -T 216.93.250.26
HPING 216.93.250.26 (fxp0 216.93.250.26): raw IP mode set, 20 headers + 0 data bytes
^C
--- 216.93.250.26 hping statistic ---
8 packets tramitted, 0 packets received, 100% packet loss
round-trip min/avg/max = 0.0/0.0/0.0 ms
cgull@glup:/home/cgull 1 $ sudo hping -0 -t 2 -H 41 -T 216.93.250.26
HPING 216.93.250.26 (fxp0 216.93.250.26): raw IP mode set, 20 headers + 0 data bytes
hop=2 TTL 0 during transit from ip=209.6.160.100 name=vl200.aggr1.sbo.ma.rcn.net
hop=3 TTL 0 during transit from ip=207.172.15.156 name=tge2-1.core4.sbo.ma.rcn.net
hop=4 TTL 0 during transit from ip=207.172.19.221 name=tge1-4.core4.nyw.ny.rcn.net
hop=5 TTL 0 during transit from ip=207.172.15.76 name=port-chan1.border1.nyw.ny.rcn.net
hop=6 TTL 0 during transit from ip=198.32.160.22 name=ny-iix.above.net
hop=7 TTL 0 during transit from ip=64.125.26.161 name=xe-1-1-0.cr1.lga5.us.above.net
hop=8 TTL 0 during transit from ip=64.125.25.41 name=xe-1-1-0.mpr3.bos2.us.above.net
hop=9 TTL 0 during transit from ip=64.125.25.62 name=xe-0-0-0.mpr4.bos2.us.above.net
^C
--- 216.93.250.26 hping statistic ---
27 packets tramitted, 10 packets received, 63% packet loss
round-trip min/avg/max = 0.0/0.0/0.0 ms
cgull@glup:/home/cgull 0 $ sudo hping -0 -t 10 -H 41 -T 216.93.250.26
HPING 216.93.250.26 (fxp0 216.93.250.26): raw IP mode set, 20 headers + 0 data bytes
^C
--- 216.93.250.26 hping statistic ---
6 packets tramitted, 0 packets received, 100% packet loss
round-trip min/avg/max = 0.0/0.0/0.0 ms
cgull@glup:/home/cgull 1 $ sudo hping -0 -t 11 -H 41 -T 216.93.250.26
HPING 216.93.250.26 (fxp0 216.93.250.26): raw IP mode set, 20 headers + 0 data bytes
hop=11 TTL 0 during transit from ip=216.93.255.6 name=OCCAID-230.dcr03.bos1.twdx.net
^C
--- 216.93.250.26 hping statistic ---
8 packets tramitted, 1 packets received, 88% packet loss
round-trip min/avg/max = 0.0/0.0/0.0 ms
cgull@glup:/home/cgull 0 $ sudo hping -0 -t 14 -H 41 -T 216.93.250.26
HPING 216.93.250.26 (fxp0 216.93.250.26): raw IP mode set, 20 headers + 0 data bytes
^C
netstat -in /netstat -rn:
cgull@glup:/home/cgull 0 $ netstat -rn
Routing tables
Internet:
Destination Gateway Flags Refs Use Mtu Interface
default 207.172.212.129 UGS 7 2783 - fxp0
127/8 127.0.0.1 UGRS 0 0 33208 lo0
127.0.0.1 127.0.0.1 UH 2 299 33208 lo0
198.206.215.0/25 link#3 UC 4 0 - em0
198.206.215.1 00:0c:f1:9d:7a:01 UHLc 1 182 - lo0
198.206.215.4 00:15:f2:04:04:90 UHLc 0 3 - em0
198.206.215.10 link#3 UHLc 2 149 - em0
198.206.215.17 00:26:08:0b:83:4a UHLc 6 2794 - em0
207.172.212.128/27 link#2 UC 2 0 - fxp0
207.172.212.129 00:21:55:ca:a4:d9 UHLc 1 3 - fxp0
207.172.212.135 00:50:ba:74:73:09 UHLc 0 6 - lo0
224/4 127.0.0.1 URS 0 0 33208 lo0
Internet6:
Destination Gateway Flags Refs Use Mtu Interface
::/104 ::1 UGRS 0 0 - lo0
::/96 ::1 UGRS 0 0 - lo0
default 2001:4830:1100:e1::1 UGS 1 268 - gif0
::1 ::1 UH 14 6 33208 lo0
::127.0.0.0/104 ::1 UGRS 0 0 - lo0
::224.0.0.0/100 ::1 UGRS 0 0 - lo0
::255.0.0.0/104 ::1 UGRS 0 0 - lo0
::ffff:0.0.0.0/96 ::1 UGRS 0 0 - lo0
2001:4830:1100:e1::1 2001:4830:1100:e1::2 UH 1 3 - gif0
2001:4830:1100:e1::2 link#7 UHL 1 6 - lo0
2001:4830:1141:1::/64 link#3 UC 2 0 - em0
2001:4830:1141:1::1 00:0c:f1:9d:7a:01 UHL 0 0 - lo0
2001:4830:1141:1:226:8ff:fe0b:834a 00:26:08:0b:83:4a UHLc 0 5 - em0
2001:4830:1141:1:90ba:d9da:e0de:f413 04:1e:64:2e:74:eb UHLc 0 3 - em0
2002::/24 ::1 UGRS 0 0 - lo0
2002:7f00::/24 ::1 UGRS 0 0 - lo0
2002:e000::/20 ::1 UGRS 0 0 - lo0
2002:ff00::/24 ::1 UGRS 0 0 - lo0
fe80::/10 ::1 UGRS 0 0 - lo0
fe80::%fxp0/64 link#2 UC 0 0 - fxp0
fe80::250:baff:fe74:7309%fxp0 00:50:ba:74:73:09 UHL 0 0 - lo0
fe80::%em0/64 link#3 UC 1 0 - em0
fe80::20c:f1ff:fe9d:7a01%em0 00:0c:f1:9d:7a:01 UHL 0 0 - lo0
fe80::226:8ff:fe0b:834a%em0 00:26:08:0b:83:4a UHLc 0 9 - em0
fe80::%lo0/64 fe80::1%lo0 U 0 0 - lo0
fe80::1%lo0 link#5 UHL 0 0 - lo0
fe80::%gif0/64 link#7 UC 0 0 - gif0
fe80::250:fcff:feb3:7e7%gif0 link#7 UHL 0 0 - lo0
fec0::/10 ::1 UGRS 0 0 - lo0
ff01::/16 ::1 UGRS 0 0 - lo0
ff01::%fxp0/32 link#2 UC 0 0 - fxp0
ff01::%em0/32 link#3 UC 0 0 - em0
ff01::%lo0/32 ::1 UC 0 0 - lo0
ff01::%gif0/32 link#7 UC 0 0 - gif0
ff02::/16 ::1 UGRS 0 0 - lo0
ff02::%fxp0/32 link#2 UC 0 0 - fxp0
ff02::%em0/32 link#3 UC 0 0 - em0
ff02::%lo0/32 ::1 UC 0 0 - lo0
ff02::%gif0/32 link#7 UC 0 0 - gif0
cgull@glup:/home/cgull 0 $ netstat -in
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Colls
lo0 33208 <Link> 499 0 499 0 0
lo0 33208 127/8 127.0.0.1 499 0 499 0 0
lo0 33208 ::1/128 ::1 499 0 499 0 0
lo0 33208 fe80::%lo0/ fe80::1%lo0 499 0 499 0 0
rl0* 1500 <Link> 00:50:fc:b3:07:e7 0 0 0 0 0
fxp0 1500 <Link> 00:50:ba:74:73:09 22820 0 2815 0 0
fxp0 1500 207.172.212 207.172.212.135 22820 0 2815 0 0
fxp0 1500 fe80::%fxp0 fe80::250:baff:fe 22820 0 2815 0 0
em0 1500 <Link> 00:0c:f1:9d:7a:01 4386 0 3055 0 0
em0 1500 198.206.215 198.206.215.1 4386 0 3055 0 0
em0 1500 fe80::%em0/ fe80::20c:f1ff:fe 4386 0 3055 0 0
em0 1500 2001:4830:1 2001:4830:1141:1: 4386 0 3055 0 0
enc0* 1536 <Link> 0 0 0 0 0
pflog0 33208 <Link> 0 0 0 0 0
gif0 1280 <Link> 11 0 345 0 0
gif0 1280 fe80::%gif0 fe80::250:fcff:fe 11 0 345 0 0
gif0 1280 2001:4830:1 2001:4830:1100:e1 11 0 345 0 0
cgull@glup:/home/cgull 0 $
Also noteworthy: I configured my other tunnel T57753 on an Ubuntu Natty laptop, configured it using the standard Ubuntu configuration dialogs and briefly tried using it behind IPv4 NAT on this gateway. It also fails similarly; tcpdump on the gateway shows the tunnel being established but no AYIYA UDP packets returned in response to IPv6 pings from the laptop.
It looks to me like either 1) RCN or other transit is filtering both proto-41 and the AYIYA traffic to glup.org, or 2) there's an issue at usbos01.
Thanks for your help,
--jh
State change: resolved
Jeroen Massar on Sunday, 17 July 2011 19:20:37
The state of this ticket has been changed to resolved
Posting is only allowed when you are logged in. |