Restricing access to folders in NTFS

I know there is a way to make this work, I must not be doing it right.

I need to restrict access to my personal dir on the server so that the files in there are not accessable by anyone but me. But when I add myself as full control in the security tab and remove full control from the everyone group, I still only have read-only access just like everyone (g) else has.

What am I doing wrong???