‹ BackHN Continuity

Thread

Homa: The end of TCP for AI clusters [video]

70 points · 35 comments · signa11

  1. throw0101c · · focus · HN ↗
    With regards to (~6:01) "congestion control is the responsibility of the sender" and "somehow we have to get the sending nodes to stop sending so fast". Does that not exist in Ethernet/RoCE?

    > Link Level Flow Control: InfiniBand uses a credit-based algorithm to guarantee lossless HCA-to-HCA communication. RoCE runs on top of Ethernet. Implementations may require lossless Ethernet network for reaching to performance characteristics similar to InfiniBand. Lossless Ethernet is typically configured via Ethernet flow control or priority flow control (PFC). Configuring a Data center bridging (DCB) Ethernet network can be more complex than configuring an InfiniBand network.[19]

    * <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;RDMA_over_Converged_Ethernet" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;RDMA_over_Converged_Ethernet

    &gt; A sending station (computer or network switch) may be transmitting data faster than the other end of the link can accept it. Using flow control, the receiving station can signal the sender requesting suspension of transmissions until the receiver catches up. Flow control on Ethernet can be implemented at the data link layer.

    * <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Ethernet_flow_control" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Ethernet_flow_control

    1. wmf · · focus · HN ↗
      Flow control is better than nothing but it can cause congestion spreading and bufferbloat. QCN, Falcon, and Ultra Ethernet provide much better congestion control for RoCE but they also require newer hardware compared to Homa.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.