Owner-drawn list view & selection

I'm using an owner drawn list view to display a list of files along with some graphical data associated with them.

The problem is, the list view is always treated as if it had LVS_EX_FULLROWSELECT - even though I did not use that flag. For example, if I want to select multiple files, I have to start selecting from an area below or to the right of all labels, otherwise it will be treated as a drag operation. Furthermode, as I drag the selection rectangle, it only selects the items if their labels intersect the rectangle (the expected behavior) - which makes me believe its a bug.

Is there anything I can do about it without rewriting the entire selection process in subclass proc?