At each site, the inside port on the router needs to have an IP address that is in the same subnet as the computers on the local lan.
The subnet address range at each end must be different.
The WAN ports of the two routers must be on the same subnet, which must be different than either of the two offices.
If there is no internet connection at the Annex, the router inside address should be the default gateway of all machines. If there is currently an internet router there, leave the default gateways pointed at that existing router, and put a static route on that router that points traffic for the main office at the new router.
At the main office, which presumably has an internet router now, add a static route on the internet router what directs traffic for the Annex subnet to the new router (inside address).
Good luck.