reference semantic for pimpl class

[monarch_dodra]

I have a basic class with a pimpl, with agressive instantiation:

class MyClassImpl;

class MyClass
{
public:
  MyClass() : pImpl(new MyClassImpl) {}
  ~MyClass(){delete pImpl;}

private:
  MyClass(const MyClass&) = delete;
  MyClass& operator=(const MyClass&) = delete;

  MyClassImpl* pImpl;
};

Classic/Standard. However, I do hate having to use pointer semantics for all of my operations. So I thought: If I never ever manipulate the actual pointer itself, why not just keep a reference?

class MyClassImpl;

class MyClass
{
public:
  MyClass() : impl(*new MyClassImpl) {}
  ~MyClass(){delete &impl;}

private:
  MyClassImpl& impl;
};

Everything seems legit to me...

The only downside that I see, is that I can't swap or move, but this particular object is not meant to be swapped or moved.

Did I miss anything here, or can I go ahead and do this.