Ti Kaye was the perfect spot for our honeymoon. For an unbelievably reasonably rate, we had a beautiful, private villa right on a cliff looking out over the Caribbean Sea with a private plunge pool (and air conditioning!) The outdoor shower was gorgeous, like showing in a tropical garden, and the staff even spelled out "Welcome" in flower petals on the bed when we arrived. I couldn't have asked for anything more. The restaurant was unique, beautiful (mostly outdoors, though covered) and had excellent local cuisine and a constantly changing menu.
You do have to be able to climb the 160-or-so steps down to the beach and back up, and the beach gets invaded by tourists on local catamaran tours in the afternoons - but we went to the beach in the morning when it was empty and relaxed in our hammock, our plunge pool, or the main pool (or by the bar!) during the afternoons.
If you tend to get motion sick, don't plan outings outside of the hotel because the island is very hilly and the car rides are rough, but we had a great time snorkeling at the hotel, taking a sunset sail which left from the hotel, and relaxing.
It was perfect!