What you want is called DSR, meaning direct server return.
This is stateless load balancing, since the LB only balances the connection initially, and does nothing else.
The result will be that after initial balance to one of the servers, a client - server connection will not go thru LB after that.
It requires your load balanced servers to have VIP ip address defined on localhost interface (alias).
Also, your load balanced servers must not answer to ARP requests.
And a load balancer software which supports that functionality with a network environment which allows it, since this is MAC spoofing
Hope that helps
Regards
Peasant.