Velocity wont accept another backend properly

I have a velocity network, and I want to add a login world, so after you authenticate it sends you to lobby. I set it up as a usual backend, but for some reason, velocity will not send players to it upon joining. It just hangs on the joining world screen and disconnects. The wierd thing is, if I set it so velocity sends you straight to lobby, I can do /server loginwrld and it will put me in the login world. What could be happening? I sent my velocity.toml if that helps