IPv4 Address

If someone has my IPv4 Address can they monitor what I’m doing if I disable my wireless network? Under my WPA2-PSK Security Settings my Encryption is AES and I have a passphrase setup.

If I enable my wireless network if someone has my IPv4 Address will they show up on my Wireless Network Watcher? How do I kick them off permanently or do I just need to change my IPv4 Address?