20220225 - Connection Issues (UK)

Here is the normal traceroute

6 26 ms 24 ms 19 ms m674-mp2.cvx1-b.lis.dial.ntli.net [62.254.42.162]
7 22 ms 21 ms 20 ms 213.46.182.162
8 25 ms 29 ms 25 ms adm-bb4-link.ip.twelve99.net [62.115.137.64]
9 22 ms 25 ms 21 ms adm-b10-link.ip.twelve99.net [62.115.120.229]
10 * 20 ms 21 ms cloudflare-ic342028-adm-b10.ip.twelve99-cust.net [62.115.172.231]
11 20 ms 18 ms 19 ms 172.65.201.188

And this is what I got during the DC…

6 21 ms 11 ms 12 ms tcma-ic-2-ae9-0.network.virginmedia.net [62.253.174.178]
7 14 ms 16 ms 22 ms 162.158.32.254
8 21 ms 19 ms 18 ms 162.158.32.11
9 * * 37 ms adm-b10-link.ip.twelve99.net [62.115.120.229]
10 21 ms * * cloudflare-ic342028-adm-b10.ip.twelve99-cust.net [62.115.172.231]
11 21 ms 26 ms 18 ms 172.65.201.188

That is the only time hops 6 onwards have been different in all the ones I have done since this issue started. It has now gone back to the original routing.

Let me know if you need the entire traceroute from the beginning CCP Explorer.

2 Likes

Thanks; the network people are now chewing on this.

BTW, 162.158.32.0/22 is AS13335, which is Cloudflare. So that last route is VM => CF => Telia => CF.

im in nottinghamshire and no connectivity issues and im with plusnet isp

2 Likes

I would love to get the full data; if you don’t want to post that here, then please file a support ticket and name drop me and GM Mechanic.

Will do

1 Like

Support ticket sent… ticket #1777448

Hopefully this helps pinpoint the problem.

Hello all Virgin Media UK EVE players!

Fantastic engagement in this thread here as we at CCP continue to feed information to Virgin Media UK and Cloudflare on this issue and great team work!!! Special thanks to @Jander_Massek for catching the route change and to @Harvy_Powney, @Cade102 and everyone else for spotting the regularity and sending us details.

We have a favour to ask you. There appear to be large disconnect spikes every 4 hours, most notably at 11:55, 15:55, 19:55, 23:55 (between midnight and noon then UK players are more offline so it’s difficult to tell) but possibly there it looks like there are also minor hourly disconnects (but sometimes none). This looks a bit like some regular processing that is happening in the approx. 10 minutes before the hour, most notable every 4 hours.

We would want to get more trace routes when the disconnects happens, so if you could run them at 11:55, 15:55, 19:55, 23:55 and if you disconnect to see if results are different than your regular non-disconnection routes. If they are different, please file a support ticket (name dropping me and GM Mechanic) with the full details.

Also, if you are tech-savy and know your way around Wireshark or similar tools, if you run a network capture during a disconnect, that would also be valuable information to us.

Finally, it would be interesting to hear if you run both a TQ client and a SiSi client at the same time, if the SiSi client stays connected but the TQ client disconnects.

7 Likes

I tried to capture it several times. The problem was that I only caught it by starting the traceroute before the DC actually happened. I was running one constantly for the few minutes prior to the expected disconnect so that might help anyone else trying to catch it.

6 Likes

We are amazed that you caught it; Cloudflare had been asking for this and we had been telling them this would be next to impossible.

BTW, we have already sent this to Cloudflare and Virgin Media. VM has already replied and escalated the case further.

6 Likes

Yeah, my 3rd or 4th attempt :stuck_out_tongue: Never used Wireshark but might download it. I should certainly be able to log on SiSi and see if the same happens there for the next expected DC.

2 Likes

Awesome work @Jander_Massek and @CCP_Explorer, I’ll try run a traceroute tonight just as the clock ticks 19:55 in an attempt to catch the next big DC.

Feel like this is great progress to identifying and resolving this issue!

2 Likes

Also very good to hear that VM are still involved and trying to resolve this too. Their forum seems to be turning into something of a witchhunt… I feel a bit sorry for them, particularly the poor Tech support people who are not in any position really to be able to help with this.
Please remember people, they are just trying to do their job as best they can.

2 Likes

Indeed, we think the trace route is “corrupt” in the sense that you started it when the new route was in effect and as the trace route was running then new old route came back into effect; so the result is a mix of the two. We are still hoping it provides insight to Cloudflare and Virgin Media, along with the discovery of the regularity, but more trace routes would help us and them piece together what that new route is.

I have a Wireshark trace I took a few days ago (screenshot)

How do I get the capture to you?

Ah ok, of course the traceroute takes some time to complete and the DC seems to be over very quickly. Hopefully if we can catch a few more it will help even more.

Absolutely.
The VM call centre people haven’t got the know-how for this kind of thing, all they have is a script and a flowchart to follow.
No wonder all they come up with is “reset your router”. It’s not their fault.

Their chat moderators probably fall into a similar category. They’re not network engineers.

:+1:

3 Likes

friend you misunderstood me. I am not pushing it. I am making an observation from my own experience. If you read my post, it clearly says that it might not be relevant but it seems to me that was it was like. there have been others who have commented that is what it looks like. Also, with all due respect, let the developer decide whether its relevant or not. thanks for your comment though I do appreciate you taking the time to get back to me.

1 Like

WHERE in Nottinghamshire
??? ehh? :slight_smile:

My apologies if that came across the wrong way. We all want the same thing which is to have this issue resolved.
I have been undocked all day today and only suffered the mass disconnects that have now been pinpointed to occur at 4 hour intervals, so 11.55 and 15.55 so far today. Of course your experience may differ slightly.

1 Like

20 m south nottingham city