Explainer · 8 min read

Why file transfers slow down over distance, and what actually fixes it

Latency and packet loss, not bandwidth, decide how fast a large file moves over a long link. How TCP's congestion control turns a gigabit into a trickle, what parallel streams and tuning can and cannot do, and where UDP-based transfer changes the arithmetic.

Author
RIPTON CLOUD team, Product and engineering
Technical review
RIPTON CLOUD engineering
Updated

Key takeaways

  • TCP throughput on a single stream is bounded by round-trip time and packet loss, not by link capacity.
  • At 150 ms and 3% loss, a single stream delivers a few megabits per second regardless of a gigabit link.
  • Parallel streams and window tuning help but need expertise per route and still restart on loss.
  • UDP-based transfer with its own rate control and block retransmission removes the per-loss collapse; in RIPTON CLOUD's published test a 1 GB file finished in 4 minutes against 30 for TCP on that path.

The symptom everyone recognises

You pay for a gigabit. A transfer to the office across town runs near that. The same transfer to a partner on another continent runs at a fraction of it, on the same tools, with the same files. Nothing is broken. The protocol is doing exactly what it was designed to do.

TCP was built to share a network fairly between many flows. Its congestion control treats every lost packet as a signal that the network is full, cuts its sending rate, and then grows back slowly, one round trip at a time. On a short link a round trip is a millisecond and the recovery is invisible. On a long link a round trip is 100 to 300 milliseconds and the recovery is most of the transfer.

The arithmetic

A widely used approximation (the Mathis model) says a single TCP stream's throughput is roughly the segment size divided by the round-trip time times the square root of the loss rate. Two things fall out of it: doubling the distance halves the rate, and loss hurts far more than its percentage suggests.

Round-trip timePacket lossRough single-stream ceiling
10 ms0.01%hundreds of Mbps
80 ms0.1%tens of Mbps
150 ms1%single-digit Mbps
150 ms3%a few Mbps

What helps while you stay on TCP

  • Parallel streams: several TCP connections share the loss between them, so each recovers independently. Tools such as rclone, lftp and parallel scp do this. It helps, and it also multiplies connections, complicates resume, and still collapses on a bursty link.
  • Window and buffer tuning: larger TCP windows let a stream keep more data in flight over a long path. It needs administrator access on both ends and is per-route work.
  • Newer congestion control: BBR-style algorithms estimate bandwidth and delay instead of reacting only to loss and do much better on lossy paths. They require kernel support on the sending side and are still one stream with TCP's semantics.
  • Compression and deduplication: reduce the bytes; do nothing for the protocol's behaviour, and most media and scientific data does not compress.

What a UDP-based transfer changes

UDP carries packets without TCP's built-in reaction to loss, so a transfer protocol on top of it can decide for itself how to respond. The protocols used by accelerated transfer products, including RIPTON's RIPT, send at a controlled rate, keep track of which blocks arrived, and retransmit only the missing blocks. A lost packet costs one retransmission, not a rate collapse and a slow climb back.

That is why the effect is largest exactly where TCP is weakest: long round trips and measurable loss. On a clean local link there is little to gain, and any honest vendor will tell you so.

What to do with this

  1. 1Measure the route: round-trip time with ping, loss over a few minutes, and the link speed each side actually has. The calculator turns those into an expected time for both approaches.
  2. 2If the link is short and clean, keep what you have and fix the disk or the application instead.
  3. 3If the link is long or lossy, try parallel streams first if you control both ends and the tooling is acceptable.
  4. 4If the route matters every day, test an accelerated transfer on it against your current tool and keep the numbers.

Related

Put your file size, link speed, latency and loss into the calculator and see how far the TCP ceiling is from the link you pay for.

Estimate your route