Yes, it is pretty easy.
Host the server on 1 machine.
Make sure that all the machines are connected through LAN/adhoc or whatever.
Open command prompt (cmd) and type "ipconfig" on the host machine.
You will see a LAN IP address, it would be something like 169.254.*.*
Add that IP address to favorite list on the other machines, join, enjoy.