CSS Sibling selector doesn't work inside :not()

Issue

I know that with pure CSS it's impossible to select previous siblings of the element. But I try to fool browser with a complex selector.
Please see this jsFiddle. It contains several CSS rules that work fine except 2 of them:

//set border color to white for all elements before .selected and .selected itself
div:not(.selected ~ div) {
    border-color: #fff;
}

//set border color to green for the element previous to .selected
div:not(.selected ~ div):nth-last-child(2) {
    border-color: #0f0;
}

But seems that inside :not() sibling selector ~ doesn't work.
So there're 2 questions:

1. Is it expected that ~ doesn't work inside :not()?
2. Is there any work-around for such case?

EDIT:
The final idea is to make a nice hover effect with pure CSS like:
The hovered image is simply scaled, image to right of it could be found and styled easily but the left one... The example with divs is just an example.

Solution

:not() pseudo-class could not contain sibling selector.

http://dev.w3.org/csswg/selectors3/#negation

The negation pseudo-class, :not(X), is a functional notation taking a simple selector (excluding the negation pseudo-class itself) as an argument.

http://dev.w3.org/csswg/selectors3/#simple-selectors-dfn

A simple selector is either a type selector, universal selector, attribute selector, class selector, ID selector, or pseudo-class.

Answered By - Alexey Ten