[core] Fix assert when observer with variable pair term matches removed value pair