Using asynchronous I/O operations, like epoll, implement a I/O-managing kernel for TCP connections that scales well. I recommend implementing a very basic HTTP server using this system, so you can test with HTTP load testing tools. I recommend writing explicit I/O completion continuations, rather than trying to capture them automatically. Bonus omph for implementing your own user-level thread system, however.