dsl load balancing and ppp woes.

[Johanes Hofmann <john_(_at_)_openlsd_(_dot_)_org>]

Dear list,

some days ago I changed places to a dormitory which uses two DSL lines, so I offered to setup an openbsd
gateway capable of managing both of those lines. I used pf's route-to round-robin to achive load-balancing
for outgoing connections. Everything seemed to work just fine up until the first time ppp should have reconnected
the lines (german isp telecom uses 24h links with dynamical ips).
I searched google and there are quite some people that had the same problem, however I found no solution.
I checked the ppp.log and found some quite interessting entries which however I do not understand to their
full extend. (running GENERIC -current)

First of all, I'm getting those all day long, every 1-5 minutes:
youkai ppp[32376]: Phase: Unknown protocol 0x0045 (Fujitsu Link Backup and Load Balancing (LBLB)) 
youkai ppp[32376]: Phase: deflink: HDLC errors -> FCS: 0, ADDR: 0, COMD: 0, PROTO: 1 

Although it seems that they don't affect the connection I'd like where they are coming from and how to
deal with them in the correct way.

The real problem lies here:

ppp[26139]: Phase: deflink: Connected! 
ppp[26139]: Phase: deflink: opening -> dial 
ppp[26139]: Phase: deflink: dial -> carrier 
ppp[26139]: Phase: deflink: carrier -> login 
ppp[26139]: Phase: deflink: login -> lcp 
ppp[32376]: Phase: deflink: Connected! 
ppp[32376]: Phase: deflink: opening -> dial 
ppp[32376]: Phase: deflink: dial -> carrier 
ppp[32376]: Phase: deflink: carrier -> login 
ppp[32376]: Phase: deflink: login -> lcp 
ppp[26139]: Phase: bundle: Authenticate 
ppp[26139]: Phase: deflink: his = PAP, mine = none 
ppp[26139]: Phase: Pap Output: 000285659788520043121xyz#0001_(_at_)_t-online_(_dot_)_de ******** 
ppp[26139]: Phase: Pap Input: SUCCESS () 
ppp[26139]: Phase: deflink: lcp -> open 
ppp[26139]: Phase: bundle: Network 
ppp[26139]: Warning: iface add: ioctl(SIOCAIFADDR, 217.228.23.208/24 -> 217.5.98.84): File exists 
ppp[26139]: Error: ipcp_InterfaceUp: unable to set ip address 

This happens for both lines at reconnection -- but as I found out, there are times when the redialing process
works just fine:

ppp[32376]: Phase: deflink: open -> lcp 
ppp[32376]: Warning: 0.0.0.0/0: Change route failed: errno: No such process 
ppp[26139]: Phase: deflink: open -> lcp 
ppp[26139]: Phase: bundle: Terminate 
ppp[32376]: Phase: bundle: Terminate 
ppp[32376]: Warning: ipv4_Input: IPCP not open - packet dropped 
ppp[26139]: Phase: deflink: read (0): Connection reset by peer 
ppp[26139]: Phase: deflink: Disconnected! 
ppp[26139]: Phase: deflink: lcp -> logout 
ppp[26139]: Phase: deflink: Disconnected! 
ppp[32376]: Phase: deflink: logout -> hangup 
ppp[32376]: Phase: deflink: Connect time: 86404 secs: 4711336901 octets in, 674852869 octets out
ppp[26139]: Phase: deflink: 2406372 packets in, 1354319 packets out 
ppp[26139]: Phase:  total 38831 bytes/sec, peak 107125 bytes/sec on Fri Oct 15 21:01:41 2004 
ppp[26139]: Phase: deflink: HUPing 19033 
ppp[26139]: Phase: deflink: hangup -> opening 
ppp[26139]: Phase: bundle: Establish 
ppp[26139]: Phase: deflink: Enter pause (3) for redialing. 
ppp[32376]: Warning: ipv4_Input: IPCP not open - packet dropped 
ppp[32376]: Phase: deflink: read (0): Connection reset by peer 
ppp[32376]: Phase: deflink: Disconnected! 
ppp[32376]: Phase: deflink: lcp -> logout 
ppp[32376]: Phase: deflink: Disconnected! 
ppp[32376]: Phase: deflink: logout -> hangup 
ppp[32376]: Phase: deflink: Connect time: 86404 secs: 4711336901 octets in, 674852869 octets out 
ppp[32376]: Phase: deflink: 4263857 packets in, 3313971 packets out 
ppp[32376]: Phase:  total 62337 bytes/sec, peak 112003 bytes/sec on Fri Oct 15 17:08:35 2004 
ppp[32376]: Phase: deflink: HUPing 7611 
ppp[32376]: Phase: deflink: hangup -> opening 
ppp[32376]: Phase: bundle: Establish 
ppp[32376]: Phase: deflink: Enter pause (3) for redialing. 
ppp[26139]: Phase: deflink: Connected! 
ppp[26139]: Phase: deflink: opening -> dial 
ppp[26139]: Phase: deflink: dial -> carrier 
ppp[26139]: Phase: deflink: carrier -> login 
ppp[26139]: Phase: deflink: login -> lcp 
ppp[32376]: Phase: deflink: Connected! 
ppp[32376]: Phase: deflink: opening -> dial 
ppp[32376]: Phase: deflink: dial -> carrier 
ppp[32376]: Phase: deflink: carrier -> login 
ppp[32376]: Phase: deflink: login -> lcp 
ppp[26139]: Phase: bundle: Authenticate 
ppp[26139]: Phase: deflink: his = PAP, mine = none 
ppp[26139]: Phase: Pap Output: 000285659788520043121xyz#0001_(_at_)_t-online_(_dot_)_de ******** 
ppp[32376]: Phase: bundle: Authenticate 
ppp[32376]: Phase: deflink: his = PAP, mine = none 
ppp[32376]: Phase: Pap Output: 000370182367520037495xyz#0001_(_at_)_t-online_(_dot_)_de ******** 
ppp[26139]: Phase: Pap Input: SUCCESS () 
ppp[26139]: Phase: deflink: lcp -> open 
ppp[26139]: Phase: bundle: Network 
ppp[32376]: Phase: Pap Input: SUCCESS () 
ppp[32376]: Phase: deflink: lcp -> open 
ppp[32376]: Phase: bundle: Network 
ppp[32376]: Warning: 0.0.0.0/0: Change route failed: errno: No such process 

Below is my ppp.conf
default:
tdsl-flat1:
 set device "!/usr/sbin/pppoe -i rl0"
 disable acfcomp IPV6CP protocomp vjcomp deflate pred1 mppe
 set mru 1492
 set mtu 1492
 set speed sync
 accept lqr
 set dial
 set login
 disable IPV6CP
 set authname "000370182367520037495xyz#0001_(_at_)_t-online_(_dot_)_de"
 set authkey "abc"
 set ifaddr 10.0.0.1/0 10.0.0.2/0 255.255.255.0 0.0.0.0
 add! default HISADDR
 set timeout 0
 set reconnect 3 9999

tdsl-flat2:
 set device "!/usr/sbin/pppoe -i sis0"
 disable acfcomp IPV6CP protocomp vjcomp deflate pred1 mppe
 set mru 1492
 set mtu 1492
 set speed sync
 accept lqr
 set dial
 set login
 disable IPV6CP
 set authname "000285659788520043121xyz#0001_(_at_)_t-online_(_dot_)_de"
 set authkey "abc"
 set ifaddr 10.0.0.1/0 10.0.0.2/0 255.255.255.0 0.0.0.0
 add! default HISADDR
 set timeout 0
 set reconnect 3 9999

The smallest hint would be appreciated.

Thanks in advance,
 -john