Yup it does sound a little bit weird since your name is Olivia, cute for now but won't be so much once he is a grown up man. Otherwise Oliver is a lovely name :)